Jelle Bruineberg

In _Phenomenology of Perception_, Merleau-Ponty criticizes what he calls “Empiricist” and “Intellectualist” accounts of perception. One of his central criticisms is that both misconstrue the relationship between perception and attention. As a result, neither can tell a coherent story about the role of attention in perceptual knowledge. In this paper, we extract the core lessons of Merleau-Ponty’s discussion and apply them to some prominent contemporary accounts of the relation between attention and perception, namely Sebastian Watzl’s (2017) and Bill Brewer’s (2013). Although operating within very different frameworks—Watzl is a representationalist, whereas Brewer is a naïve realist—we show that they encounter a similar set of problems, which are highlighted in Merleau-Ponty’s discussion. We end by providing a set of constraints that any adequate account of the relation between attention and perception must meet, and sketch how the naïve realist and representationalist, each in their own way, might satisfy these constraints.

In this paper, we argue for a theoretical separation of the free-energy principle from Helmholtzian accounts of the predictive brain. The free-energy principle is a theoretical framework capturing the imperative for biological self-organization in information-theoretic terms. The free-energy principle has typically been connected with a Bayesian theory of predictive coding, and the latter is often taken to support a Helmholtzian theory of perception as unconscious inference. If our interpretation is right, however, a Helmholtzian view of perception is incompatible with Bayesian predictive coding under the free-energy principle. We argue that the free energy principle and the ecological and enactive approach to mind and life make for a much happier marriage of ideas. We make our argument based on three points. First we argue that the free energy principle applies to the whole animal–environment system, and not only to the brain. Second, we show that active inference, as understood by the free-energy principle, is incompatible with unconscious inference understood as analagous to scientific hypothesis-testing, the main tenet of a Helmholtzian view of perception. Third, we argue that the notion of inference at work in Bayesian predictive coding under the free-energy principle is too weak to support a Helmholtzian theory of perception. Taken together these points imply that the free energy principle is best understood in ecological and enactive terms set out in this paper.

The attention economy is the economic system in which human attention is the scarce resource. This literature takes a particular passage in Herbert Simon’s seminal Chapter Designing Organization for an Information-rich World as its point of departure: information abundance implies attention scarcity. My aim in this paper is firstly to provide an exposition of the assumptions that underlie Simon’s statement and the context in which he makes these remarks. I will then critically assess whether Simon’s assumptions hold in the face of contemporary work in the science and philosophy of attention. I will focus on two interrelated assumptions: the assumption that the distribution of attention is done by an allocator rather than distributed competition, and the assumption that attention is a unified an invariant resource that is required for any cognitive task involving the central-processing unit. Both of these assumptions are heavily criticized in the contemporary literature on attention. Without these assumptions in play Simon’s analysis does not come off the ground. It is not even clear that the term attention has a stable referent. In the last section, I discuss a number of options remaining for theorists of the attention economy.

The predictive processing literature contains at least two different versions of the framework with different theoretical resources at their disposal. One version appeals to so-called optimistic priors to explain agents’ motivation to act (call this optimistic predictive processing). A more recent version appeals to expected free energy minimization to explain how agents can decide between different action policies (call this preference predictive processing). The difference between the two versions has not been properly appreciated, and they are not sufficiently separated in the literature. They constitute two different theories with strikingly different accounts of motivation and action. By reducing all desire-like constructs to belief-like constructs, optimistic predictive processing entails a substantial revision of standard accounts of motivation and action in philosophy and cognitive science. By contrast, preference predictive processing introduces desire-like constructs that play Humean motivational roles in the explanation of action. In this Humean iteration, predictive processing resembles other prominent computational frameworks implementing a distinction between beliefs and desires, such as reinforcement learning and Bayesian decision theory. Ultimately, predictive processing faces a dilemma between parsimony of mental constructs and completeness of its explanations of agency and the mind.

Perception is, at least sometimes, something we do. This paper is concerned with how to account for perceptual agency (i.e., the active aspect of perception). Eilan divides accounts of perceptual agency up into two camps: enactivist theories hold that perceptual agency is accounted for by the involvement of bodily action, while mental theories hold that perceptual agency is accounted for by the involvement of mental action in perception. In Structuring Mind (2017), Sebastian Watzl aligns his ‘activity view’ with the mental action route and develops the view that the mental activity of attending infuses perceptual experience with agency. Moreover, Watzl claims that his view can accommodate enactivist intuitions, while rejecting their claims about embodiment.In this paper, we scrutinize the relevant notion of mental action involved in the mental action route. We analyze the involvement of the body in overt acts of attention (like sniffing and smelling) and argue that a constitutively embodied account of mental action provides a better analysis of overt attention than a conjunctive account in which overt attention involves a bodily and a (separate) mental action. Furthermore, we argue that the standard cases of covert attention (such as the Posner paradigm) involve the body in multiple ways.In closing, we discuss the relevance of our analysis for the debate on perceptual agency and the embodied mind thesis. We conclude that the embodied mental action route to theorizing perceptual agency provides the best analysis of perceptual agency but comes with significant commitments about the embodiment of attention.

The concept of affordances is rapidly gaining traction in the philosophy of mind and cognitive sciences. Affordances are opportunities for action provided by the environment. An important open question is whether affordances can be used to explain mental action such as attention, counting, and imagination. In this paper, we critically discuss McClelland’s (‘The Mental Affordance Hypothesis’, 2020, Mind, 129(514), pp. 401–427) mental affordance hypothesis. While we agree that the affordance concept can be fruitfully employed to explain mental action, we argue that McClelland’s mental affordance hypothesis contain remnants of a Cartesian understanding of the mind. By discussing the theoretical framework of the affordance competition hypothesis, we sketch an alternative research program based on the principles of embodied cognition that evades the Cartesian worries. We show how paradigmatic mental acts, such as imagination, counting, and arithmetic, are dependent on sensorimotor interaction with an affording environment. Rather than make a clear distinction between bodily and mental action, the mental affordances highlight the embodied nature of our mental action. We think that in developing our alternative research program on mental affordances, we can maintain many of the excellent insights of McClelland’s account without reintroducing the very distinctions that affordances were supposed to overcome.

The free energy principle, an influential framework in computational neuroscience and theoretical neurobiology, starts from the assumption that living systems ensure adaptive exchanges with their environment by minimizing the objective function of variational free energy. Following this premise, it claims to deliver a promising integration of the life sciences. In recent work, Markov blankets, one of the central constructs of the free energy principle, have been applied to resolve debates central to philosophy (such as demarcating the boundaries of the mind). The aim of this paper is twofold. First, we trace the development of Markov blankets starting from their standard application in Bayesian networks, via variational inference, to their use in the literature on active inference. We then identify a persistent confusion in the literature between the formal use of Markov blankets as an epistemic tool for Bayesian inference, and their novel metaphysical use in the free energy framework to demarcate the physical boundary between an agent and its environment. Consequently, we propose to distinguish between “Pearl blankets” to refer to the original epistemic use of Markov blankets and “Friston blankets” to refer to the new metaphysical construct. Second, we use this distinction to critically assess claims resting on the application of Markov blankets to philosophical problems. We suggest that this literature would do well in differentiating between two different research programmes: “inference with a model” and “inference within a model.” Only the latter is capable of doing metaphysical work with Markov blankets, but requires additional philosophical premises and cannot be justified by an appeal to the success of the mathematical framework alone.

In this paper, we argue for a theoretical separation of the free-energy principle from Helmholtzian accounts of the predictive brain. The free-energy principle is a theoretical framework capturing the imperative for biological self-organization in information-theoretic terms. The free-energy principle has typically been connected with a Bayesian theory of predictive coding, and the latter is often taken to support a Helmholtzian theory of perception as unconscious inference. If our interpretation is right, however, a Helmholtzian view of perception is incompatible with Bayesian predictive coding under the free-energy principle. We argue that the free energy principle and the ecological and enactive approach to mind and life make for a much happier marriage of ideas. We make our argument based on three points. First we argue that the free energy principle applies to the whole animal–environment system, and not only to the brain. Second, we show that active inference, as understood by the free-energy principle, is incompatible with unconscious inference understood as analagous to scientific hypothesis-testing, the main tenet of a Helmholtzian view of perception. Third, we argue that the notion of inference at work in Bayesian predictive coding under the free-energy principle is too weak to support a Helmholtzian theory of perception. Taken together these points imply that the free energy principle is best understood in ecological and enactive terms set out in this paper.

Smartphone use plays an increasingly important role in our daily lives. Philosophical research that has used first wave or second wave theories of extended cognition in order to understand our engagement with digital technologies has focused on the contribution of these technologies to the completion of specific cognitive tasks (e.g., remembering, reasoning, problem-solving, navigation).However, in a considerable number of cases, everyday smartphone use is task-unrelated. In psychological research, these cases have been captured by notions such as absent-minded smart-phone use (Marty-Dugas et al., 2018) or smartphone-related inattentiveness (Liebherr et al., 2020).Given the prevalence of these cases, we develop a conceptual framework that can accommodate the functional and phenomenological characteristics of task-unrelated smartphone use. To this end, we will integrate research on second wave extended cognition with mind-wandering research and introduce the concept of ‘extended mind-wandering’. Elaborating the family resemblances approach to mind-wandering (Seli, Kane, Smallwood, et al., 2018), we will argue that task-unrelated smartphone use shares many characteristics with mind-wandering. We will suggest that an empirically informed conceptual analysis of cases of extended mind-wandering can enrich current work on digitally extended cognition by specifying the influence of the attention economy on our cognitive dynamics.

The 35 commentaries cover a wide range of topics and take many different stances on the issues explored by the target article. We have organised our response to the commentaries around three central questions: Are Friston blankets just Pearl blankets? What ontological and metaphysical commitments are implied by the use of Friston blankets? What kind of explanatory work are Friston blankets capable of? We conclude our reply with a short critical reflection on the indiscriminate use of both Markov blankets and the free energy principle.

In everyday situations, and particularly in some sport and working contexts, humans face an inherently unpredictable and uncertain environment. All sorts of unpredictable and unexpected things happen but typically people are able to skillfully adapt. In this paper, we address two key questions in cognitive science. First, how is an agent able to bring its previously learned skill to bear on a novel situation? Second, how can an agent be both sensitive to the particularity of a given situation, while remaining flexibly poised for many other possibilities for action? We will argue that both the sensitivity to novel situations and the sensitivity to a multiplicity of action possibilities are enabled by the property of skilled agency that we will call metastable attunement. We characterize a skilled agent’s flexible interactions with a dynamically changing environment in terms of metastable dynamics in agent-environment systems. What we find in metastability is the realization of two competing tendencies: the tendency of the agent to express their intrinsic dynamics and the tendency to search for new possibilities. Metastably attuned agents are ready to engage with a multiplicity of affordances, allowing for a balance between stability and flexibility. On the one hand, agents are able to exploit affordances they are attuned to, while at the same time being ready to flexibly explore for other affordances. Metastable attunement allows agents to smoothly transition between these possible configurations so as to adapt their behaviour to what the particular situation requires. We go on to describe the role metastability plays in learning of new skills, and in skilful behaviour more generally. Finally, drawing upon work in art, architecture and sports science, we develop a number of perspectives on how to investigate metastable attunement in real life situations.

In this paper, we address the question of how an agent can guide its behavior with respect to aspects of the sociomaterial environment that are not sensorily present. A simple example is how an animal can relate to a food source while only sensing a pheromone, or how an agent can relate to beer, while only the refrigerator is directly sensorily present. Certain cases in which something is absent have been characterized by others as requiring ‘higher’ cognition. An example of this is how during the design process architects can let themselves be guided by the future behavior of visitors to an exhibit they are planning. The main question is what the sociomaterial environment and the skilled agent are like, such that they can relate to each other in these ways. We argue that this requires an account of the regularities in the environment. Introducing the notion of general ecological information, we will give an account of these regularities in terms of constraints, information and the form of life or ecological niche. In the first part of the paper, we will introduce the skilled intentionality framework as conceptualizing a special case of an animal’s informational coupling with the environment namely skilled action. We will show how skilled agents can pick up on the regularities in the environment and let their behavior be guided by the practices in the form of life. This conceptual framework is important for radical embodied and enactive cognitive science, because it allows these increasingly influential paradigms to extend their reach to forms of ‘higher’ cognition such as long-term planning and imagination.

This paper deals with the question of agency and intentionality in the context of the free-energy principle. The free-energy principle is a system-theoretic framework for understanding living self-organizing systems and how they relate to their environments. I will first sketch the main philosophical positions in the literature: a rationalist Helmholtzian interpretation (Hohwy 2013; Clark 2013), a cybernetic interpretation (Seth 2015b) and the enactive affordance-based interpretation (Bruineberg and Rietveld 2014; Bruineberg et al. 2016) and will then show how agency and intentionality are construed differently on these different philosophical interpretations. I will then argue that a purely Helmholtzian is limited, in that it can account only account for agency in the context of perceptual inference. The cybernetic account cannot give a full account of action, since purposiveness is accounted for only to the extent that it pertains to the control of homeostatic essential variables. I will then argue that the enactive affordance-based account attempts to provide broader account of purposive action without presupposing goals and intentions coming from outside of the theory. In the second part of the paper, I will discuss how each of these three interpretations conceives of the sense agency and intentionality in different ways.

In this paper, we set out to develop a theoretical and conceptual framework for the new field of Radical Embodied Cognitive Neuroscience. This framework should be able to integrate insights from several relevant disciplines: theory on embodied cognition, ecological psychology, phenomenology, dynamical systems theory, and neurodynamics. We suggest that the main task of Radical Embodied Cognitive Neuroscience is to investigate the phenomenon of skilled intentionality from the perspective of the self-organization of the brain-body-environment system, while doing justice to the phenomenology of skilled action. In previous work, we have characterized skilled intentionality as the organism's tendency toward an optimal grip on multiple relevant affordances simultaneously. Affordances are possibilities for action provided by the environment. In the first part of this paper, we introduce the notion of skilled intentionality and the phenomenon of responsiveness to a field of relevant affordances. Second, we use Friston's work on neurodynamics, but embed a very minimal version of his Free Energy Principle in the ecological niche of the animal. Thus amended, this principle is helpful for understanding the embeddedness of neurodynamics within the dynamics of the system “brain-body-landscape of affordances.” Next, we show how we can use this adjusted principle to understand the neurodynamics of selective openness to the environment: interacting action-readiness patterns at multiple timescales contribute to the organism's selective openness to relevant affordances. In the final part of the paper, we emphasize the important role of metastable dynamics in both the brain and the brain-body-environment system for adequate affordance-responsiveness. We exemplify our integrative approach by presenting research on the impact of Deep Brain Stimulation on affordance responsiveness of OCD patients.