Ronald A. Rensink

When looking at a scene, observers feel that they see its entire structure in great detail and can immediately notice any changes in it. However, when brief blank fields are placed between alternating displays of an original and a modified scene, a striking failure of perception is induced: identification of changes becomes extremely difficult, even when changes are large and made repeatedly. Identification is much faster when a verbal cue is provided, showing that poor visibility is not the cause of this difficulty. Identification is also faster for objects mentioned in brief verbal descriptions of the scene. These results support the idea that observers never form a complete, detailed representation of their surroundings. In addition, results also indicate that attention is required to perceive change, and that in the absence of localized motion signals it is guided on the basis of high-level interest.

Change blindness is the striking failure to see large changes that normally would be noticed easily. Over the past decade this phenomenon has greatly contributed to our understanding of attention, perception, and even consciousness. The surprising extent of change blindness explains its broad appeal, but its counterintuitive nature has also engendered confusions about the kinds of inferences that legitimately follow from it. Here we discuss the legitimate and the erroneous inferences that have been drawn, and offer a set of requirements to help separate them. In doing so, we clarify the genuine contributions of change blindness research to our understanding of visual perception and awareness, and provide a glimpse of some ways in which change blindness might shape future research

Five aspects of visual change detection are reviewed. The first concerns the concept of change itself, in particular the ways it differs from the related notions of motion and difference. The second involves the various methodological approaches that have been developed to study change detection; it is shown that under a variety of conditions observers are often unable to see large changes directly in their field of view. Next, it is argued that this “change blindness” indicates that focused attention is needed to detect change, and that this can help map out the nature of visual attention. The fourth aspect concerns how these results affect our understanding of visual perception—for example, the implication that a sparse, dynamic representation underlies much of our visual experience. Finally, a brief discussion is presented concerning the limits to our current understanding of change detection

“Pick a card, any card. This has to be a completely free choice.” the magician tells you. But is it really? Although we like to think that we are using our free will to make our decisions, research in psychology has shown that many of our behaviours are automatic and unconsciously influenced by external stimuli (Ariely, 2008; Bargh & Chartrand, 1999; Newell & Shanks, 2014; Nisbett & Wilson, 1977), and that we are often oblivious to the cognitive mechanisms that underpin our decision (Wegner, 2002, 2003). Magicians have exploited this illusory sense of agency for a long time, and have developed a wide range of techniques to influence and control spectators’ choices of such things as card, word, or number (Annemann, 1933; Banachek, 2002a; Jones, 1994; Turner, 2015). These techniques are instances of what is called forcing. Many forces are extremely effective, illustrating various weaknesses in our sense of control over decisions and their outcomes. Researchers have started to investigate them in various ways (Kuhn, Pailh s, & Lan, 2020; Olson, Amlani, Raz, & Rensink, 2015; Pailhes & Kuhn, 2020b, 2020c; Shalom et al., 2013) and are beginning to obtain valuable insights into decision-making processes as well as a better understanding of the cognitive mechanisms that lead people to experience an illusory sense of free will and of agency. Although magicians have acquired large amounts of knowledge in covertly controlling people’s choices, much of this knowledge is only discussed in the context of individual magic tricks, or in books that are not readily accessible to non-magicans. As we and others have argued elsewhere (Ekroll, Sayim, & Wagemans, 2017; Kuhn, 2019; Kuhn, Amlani, & Rensink, 2008; Kuhn, Caffaratti, Teszka, & Rensink, 2014; Macknik et al., 2008; Olson et al., 2015; Olson, Landry, Appourchaux, & Raz, 2016; Shalom et al., 2013; Thomas, Didierjean, Maquestiaux, & Gygax, 2015), a particularly effective way of making this knowledge more available is via the creation of taxonomies centered around psychological mechanisms (Rensink & Kuhn, 2015). For example, the psychologically based taxonomy of misdirection (Kuhn et al., 2014) helps draw links between misdirection and formal theories of perception and cognition. Our aim here is to apply a similar process to the knowledge magicians have about forcing. The present paper develops a psychologically based taxonomy of forcing techniques with two goals in mind. Firstly, it should help uncover the various psychological mechanisms that underlie forcing techniques. Secondly, it should facilitate knowledge transfer between magicians and psychologists. Among other things, this knowledge will allow researchers to gain new insights into the mechanisms underlying decision-making, and the feeling of free will and of agency over choice. We start by defining the magician’s force and then look at some of the past classifications of forcing.

One of the more powerful impressions created by vision is that of a coherent, richly-detailed world where everything is present simultaneously. Indeed, this impression is so compelling that we tend to ascribe these properties not only to the external world, but to our internal representations as well. But results from several recent experiments argue against this latter ascription. For example, changes in images of real-world scenes often go unnoticed when made during a saccade, flicker, blink, or movie cut. This "change blindness" provides strong evidence against the idea that our brains contain a picture-like representation of the scene that is everywhere detailed and coherent

It is argued here that cognitive science currently neglects an important source of insight into the human mind: the effects created by magicians. Over the centuries, magicians have learned how to perform acts that are perceived as defying the laws of nature, and that induce a strong sense of wonder. This article argues that the time has come to examine the scientific bases behind such phenomena, and to create a science of magic linked to relevant areas of cognitive science. Concrete examples are taken from three areas of magic: the ability to control attention, to distort perception, and to influence choice. It is shown how such knowledge can help develop new tools and indicate new avenues of research into human perception and cognition.

Advances in neuroscience implicate reentrant signaling as the predominant form of communication between brain areas. This principle was used in a series of masking experiments that defy explanation by feed-forward theories. The masking occurs when a brief display of target plus mask is continued with the mask alone. Two masking processes were found: an early process affected by physical factors such as adapting luminance and a later process affected by attentional factors such as set size. This later process is called masking by object substitution, because it occurs whenever there is a mismatch between the reentrant visual representation and the ongoing lower level activity. Iterative reentrant processing was formalized in a computational model that provides an excellent fit to the data. The model provides a more comprehensive account of all forms of visual masking than do the long-held feed-forward views based on inhibitory contour interactions.

When brief blank fields are placed between alternating displays of an original and a modified scene, a striking failure of perception is induced: the changes become extremely difficult to notice, even when they are large, presented repeatedly, and the observer expects them to occur (Rensink, O'Regan, & Clark, 1997). To determine the mechanisms behind this induced "change blindness", four experiments examine its dependence on initial preview and on the nature of the interruptions used. Results support the proposal that representations at the early stages of visual processing are highly volatile, and that focused attention is needed to stabilize them sufficiently to support the perception of change.

Large changes that occur in clear view of an observer can become difficult to notice if made during an eye movement, blink, or other such disturbance. This change blindness is consistent with the proposal that focused visual attention is necessary to see change, with a change becoming difficult to notice whenever conditions prevent attention from being automatically drawn to it. It is shown here how the phenomenon of change blindness can provide new results on the nature of visual attention, including estimates of its capacity and the extent to which it can bind visual properties into coherent descriptions. It is also shown how the resultant characterization of attention can in turn provide new insights into the role that it plays in the perception of scenes and events.

Our visual experience of the world is one of diverse objects and events, each with particular colors, shapes, and motions. This experience is so coherent, so immediate, and so effortless that it seems to result from a single system that lets us experience everything in our field of view. But however appealing, this belief is mistaken: there are severe limits on what can be visually experienced. For example, in a display for air-traffic control it is important to track all moving items. For a single item, this can be done without problem. Three or four can also be tracked, although some degree of effort may be needed. As the number is increased further, accurate tracking becomes more and more difficult—and eventually, impossible. Performance is evidently affected by a factor within the observer which enables certain kinds of perception to occur, but is limited in some way. This factor is generally referred to as attention. At various times, attention has been associated with clarity of perception, intensity of perception, consciousness, selection, or the allocation of a limited “resource” enabling various operations (see Hatfield, 1998). During the past several decades, considerable progress has been achieved by focusing on the idea of selection (Broadbent, 1982). In particular, attention can be productively viewed as contingently selective processing. This can be embodied in various ways by various processes—there need not be a single quantity identified with all forms of attention, or a single site where it operates (Allport, 1993; Tsotsos, 2011). Although “paying attention” is often considered to be a unitary operation, it may simply refer to the control of one or more selective processes, ideally in a co-ordinated way. While this view has some cost in terms of conceptual simplicity, it can help make sense of a large set of phenomena. This article surveys several of the major issues in our understanding of attention and how it relates to perception. It focuses on vision, since many—if not all—considerations are similar for all sensory modalities, and the level of understanding achieved in this domain is currently the most advanced.

Several studies (e.g., Becklen & Cervone, 1983; Mack & Rock, 1998; Neisser & Becklen, 1975) have found that observers attending to a particular object or event often fail to report the presence of unexpected items. This has been interpreted as inattentional blindness (IB), a failure to see unattended items (Mack & Rock, 1998). Meanwhile, other studies (e.g., Pashler, 1988; Phillips, 1974; Rensink et al., 1997; Simons, 1996) have found that observers often fail to report the presence of large changes in a display when these changes occur simultaneously with a transient such as an eye movement or flash of the display. This has been interpreted as change blindness (CB), a failure to see unattended changes (Rensink et al., 1997). In both cases there is a striking failure to report an object or event that would be quite visible under other circumstances. And in both cases there is a widespread (although not universal) belief that the underlying cause has to do with the absence of attention. The question then arises as to how these effects might be related. Is CB the same thing as IB? If not, what is the relation between them? And given that these phenomena deal with failures of subjective perception, what can they teach us about the nature of our visual experience? In particular, what can they teach us about the role played by visual attention?

As observers, we generally have a strong impression of seeing everything in front of us at any moment. But compelling as it is, this impression is false – there are severe limits to what we can consciously experience in everyday life. Much of the evidence for this claim has come from two phenomena: change blindness (CB) and inattentional blindness (IB). CB refers to the failure of an observer to visually experience changes that are easily seen once noticed. This can happen even if the changes are large, constantly repeat, and the observer has been informed that they will occur. A related phenomenon is IB – the failure to visually experience an object or event when attention is directed elsewhere. For example, observers may fail to notice an unexpected object that enters their visual field, even if this object is large, appears for several seconds, and has important consequences for the selection of action. Both phenomena involve a striking failure to report an object or event that is easily seen once noticed. As such, both are highly counterintuitive, not only in the subjective sense that observers have difficulty believing they could fail so badly at seeing but also in the objective sense that these findings challenge many existing ideas about how we see. But as counterintuitive as these phenomena are, progress has been made in understanding them. Indeed, doing so has allowed us to better understand the limitations of human perception in everyday life and to gain new insights into how our visual systems create the picture of the world that we experience each moment our eyes are open.

Observers inspected normal, high quality color displays of everyday visual scenes while their eye movements were recorded. A large display change occurred each time an eye blink occurred. Display changes could either involve "Central Interest" or "Marginal Interest" locations, as determined from descriptions obtained from independent judges in a prior pilot experiment. Visual salience, as determined by luminance, color, and position of the Central and Marginal interest changes were equalized. The results obtained were very similar to those obtained in prior experiments showing failure to detect changes occurring simultaneously with saccades, flicker, or “mudsplashes” in the visual scene: Many changes were very hard to detect, and Marginal Interest changes were harder to detect than Central Interest changes. Analysis of eye movements showed, as expected, that the probability of detecting a change depended on the eye’s distance from the change location. However a surprising finding was that both for Central and Marginal Interest changes, evenwhen observers were directly fixating the change locations (within 1 degree),more than 40% of the time they still failed to see the changes. It seems that looking at something does not guarantee you “ see” it.

We present a rigorous way to evaluate the visual perception of correlation in scatterplots, based on classical psychophysical methods originally developed for simple properties such as brightness. Although scatterplots are graphically complex, the quantity they convey is relatively simple. As such, it may be possible to assess the perception of correlation in a similar way. Scatterplots were each of 5.0  extent, containing 100 points with a bivariate normal distribution. Means were 0.5 of the range of the points, and standard deviations 0.2 of this range. Precision was determined via an adaptive algorithm to find the just noticeable differences (jnds) in correlation, i.e., the difference between two side-by-side scatterplots that could be discriminated 75% of the time. Accuracy was measured by direct estimation, using reference scatterplots with fixed upper and lower values, with a test scatterplot adjusted so that its correlation appeared to be halfway between these. This process was recursively applied to yield several further estimates. Results of the discrimination tests show jnd(r) = k (1/b – r), where r is the Pearson correlation, and parameters 0 < k, b < 1. Integration yields a subjective estimate of correlation g(r) = ln(1 – br) / ln(1– b). The values of b found via discrimination closely match those found via direct estimation. As such, it appears that the perception of correlation in a scatterplot is completely described by two related performance curves, specified by two easily-measured parameters.

Our recent opinion article [1] examined what change blindness can and cannot tell us about visual representations. Among other things, we argued that change blindness can tell us a lot about how visual representations can be used, but little about their extent. We and others found the ‘sparse representations’ view appealing (and still do), and initially made the overly strong claim that change blindness supports the conclusion of sparse representations [2,3]. We wrote our article because change blindness continues to be taken as evidence for sparse – or even absent – representations, and we used O’Regan and Noë’s influential paper [4] as an example. However, as has been noted for some time [5–8], this conclusion is logically flawed: lack of ability need not be caused by lack of representation.

Our perceptual experience is largely based on prediction, and as such can be influenced by knowledge of forthcoming events. This susceptibility is commonly exploited by magicians. In the Vanishing Ball Illusion, for example, a magician tosses a ball in the air a few times and then pretends to throw the ball again, whilst secretly concealing it in his hand. Most people claim to see the ball moving upwards and then vanishing, even though it did not leave the magician’s hand (Kuhn & Land, 2006; Triplett, 1900). But what exactly can such illusions tell us? We investigated here whether seeing a real action before the pretend one was necessary for the Vanishing Ball Illusion. Participants either saw a real action immediately before the fake one, or only a fake action. Nearly one third of participants experienced the illusion with the fake action alone, while seeing the real action beforehand enhanced this effect even further. Our results therefore suggest that perceptual experience relies both on long-term knowledge of what an action should look like, as well as exemplars from the immediate past. In addition, whilst there was a forward displacement of perceived location in perceptual experience, this was not found for oculomotor responses, consistent with the proposal that two separate systems are involved in visual perception.

Forcing occurs when a magician influences the audience's decisions without their awareness. To investigate the mechanisms behind this effect, we examined several stimulus and personality predictors. In Study 1, a magician flipped through a deck of playing cards while participants were asked to choose one. Although the magician could influence the choice almost every time (98%), relatively few (9%) noticed this influence. In Study 2, participants observed rapid series of cards on a computer, with one target card shown longer than the rest. We expected people would tend to choose this card without noticing that it was shown longest. Both stimulus and personality factors predicted the choice of card, depending on whether the influence was noticed. These results show that combining real-world and laboratory research can be a powerful way to study magic and can provide new methods to study the feeling of free will.

Ideomotor actions are behaviours that are unconsciously initiated and express a thought rather than a response to a sensory stimulus. The question examined here is whether ideomotor actions can also express nonconscious knowledge. We investigated this via the use of implicit long-term semantic memory, which is not available to conscious recall. We compared accuracy of answers to yes/no questions using both volitional report and ideomotor response . Results show that when participants believed they knew the answer, responses in the two modalities were similar. But when they believed they were guessing, accuracy was at chance for volitional report , but significantly higher for Ouija response . These results indicate that implicit semantic memory can be expressed through ideomotor actions. They also suggest that this approach can provide an interesting new methodology for studying implicit processes in cognition

In the not-too-distant past, vision was often said to involve three levels of processing: a low level concerned with descriptions of the geometric and photometric properties of the image, a high level concerned with abstract knowledge of the physical and semantic properties of the world, and a middle level concerned with anything not handled by the other two. The negative definition of mid-level vision contained in this description reflected a rather large gap in our understanding of visual processing: How could the here-and-now descriptions of the low levels combine with the enduring knowledge of the high levels to produce our perception of the surrounding world? A number of experimental and theoretical efforts have been made over the past few decades to solve this "mid-level crisis". One of the more recent of these is based on the phenomenon of change blindness—the difficulty in seeing a large change in a scene when the transients accompanying that change no longer convey information about its location (Rensink, O'Regan, & Clark, 1997; Rensink, 2000a). Phenomenologically, this effect is quite striking: the change typically is not seen for several seconds, after which it suddenly snaps into awareness. During the time the change remains "invisible", there is an apparent disconnection of the low-level descriptions (which respond to the change) from subjective visual experience (which does not). As such, this effect would seem to have the potential to help us understand how mid-level mechanisms might knit low- and high-level processes into a coherent representation of our surroundings. It is argued here that this potential can indeed be realized, and that change blindness can teach us much about the nature of mid-level vision.3 A number of studies are first reviewed showing that the perception of a scene does not involve a steady buildup of detailed representation: rather, it is a dynamic process, with focused attention playing one of the main roles, viz., forming coherent object representations whenever needed. It is then argued that change blindness can also shed considerable light on the nature of focused attention itself, such as its speed, capacity, selectivity, and ability to bind together visual properties into coherent structures.

A set of visual search experiments tested the proposal that focused attention is needed to detect change. Displays were arrays of rectangles, with the target being the item that continually changed its orientation or contrast polarity. Five aspects of performance were examined: linearity of response, processing time, capacity, selectivity, and memory trace. Detection of change was found to be a self-terminating process requiring a time that increased linearly with the number of items in the display. Capacity for orientation was found to be about 5 items, a value comparable to estimates of attentional capacity. Observers were able to filter out both static and dynamic variations in irrelevant properties. Analysis also indicated a memory for previously-attended locations. These results support the hypothesis that the process needed to detect change is much the same as the attentional process needed to detect complex static patterns. Interestingly, the features of orientation and polarity were found to be handled in somewhat different ways. Taken together, these results not only provide evidence that focused attention is needed to see change, but also show that change detection itself can provide new insights into the nature of attentional processing.

It has often been assumed that when we use vision to become aware of an object or event in our surroundings, this must be accompanied by a corresponding visual experience (i.e., seeing). The studies reported here show that this assumption is incorrect. When observers view a sequence of displays alternating between an image of a scene and the same image changed in some way, they often feel (or sense) the change even though they have no visual experience of it. The subjective difference between sensing and seeing is mirrored in several behavioral differences, suggesting that these are two distinct modes of conscious visual perception.

One of the more compelling beliefs about vision is that it is based on representations that are coherent and complete, with everything in the visual field described in great detail. However, changes made during a visual disturbance are found to be difficult to see, arguing against the idea that our brains contain a detailed, picture-like representation of the scene. Instead, it is argued here that a more dynamic, "just-in-time" representation is involved, one with deep similarities to the way that users interact with external displays. It is further argued that these similarities can provide a basis for the design of intelligent display systems that can interact with humans in highly effective and novel ways.

Four experiments investigated the extent to which abstract quantitative information can be conveyed by basic visual features. This was done by asking observers to estimate and discriminate Pearson correlation in graphical representations where the first data dimension of each element was encoded by its horizontal position, and the second by the value of one of its visual features; perceiving correlation then requires combining the information in the two encodings via a common abstract representation. Four visual features were examined: luminance, color, orientation, and size. All were able to support the perception of correlation. Indeed, despite the strikingly different appearances of the associated stimuli, all gave rise to performance that was much the same: just noticeable difference was a linear function of distance from complete correlation, and estimated correlation a logarithmic function of this distance. Performance differed only in regards to the level of noise in the feature, with these values compatible with estimates of channel capacity encountered in classic experiments on absolute perceptual magnitudes. These results suggest that quantitative information can be conveyed by visual features that are abstracted at relatively low levels of visual processing, with little representation of the original sensory property. It is proposed that this is achieved via an abstract parameter space in which the values in each perceptual dimension are normalized to have the same means and variances, with perceived correlation based on the shape of the joint probability density function of the resultant elements.

Magicians use misdirection to prevent you from realizing the methods used to create a magical effect, thereby allowing you to experience an apparently impossible event. Magicians have acquired much knowledge about misdirection, and have suggested several taxonomies of misdirection. These describe many of the fundamental principles in misdirection, focusing on how misdirection is achieved by magicians. In this article we review the strengths and weaknesses of past taxonomies, and argue that a more natural way of making sense of misdirection is to focus on the perceptual and cognitive mechanisms involved. Our psychologically-based taxonomy has three basic categories, corresponding to the types of psychological mechanisms affected: perception, memory, and reasoning. Each of these categories is then divided into subcategories based on the mechanisms that control these effects. This new taxonomy can help organize magicians' knowledge of misdirection in a meaningful way, and facilitate the dialog between magicians and scientists.

Large changes in a scene often become difficult to notice if made during an eye movement, image flicker, movie cut, or other such disturbance. It is argued here that this _change blindness_ can serve as a useful tool to explore various aspects of vision. This argument centers around the proposal that focused attention is needed for the explicit perception of change. Given this, the study of change perception can provide a useful way to determine the nature of visual attention, and to cast new light on the way that it is?and is not?involved in visual perception. To illustrate the power of this approach, this paper surveys its use in exploring three different aspects of vision. The first concerns the general nature of _seeing_. To explain why change blindness can be easily induced in experiments but apparently not in everyday life, it is proposed that perception involves a _virtual representation_, where object representations do not accumulate, but are formed as needed. An architecture containing both attentional and nonattentional streams is proposed as a way to implement this scheme. The second aspect concerns the ability of observers to detect change even when they have no visual experience of it. This _sensing_ is found to take on at least two forms: detection without visual experience (but still with conscious awareness), and detection without any awareness at all. It is proposed that these are both due to the operation of a nonattentional visual stream. The final aspect considered is the nature of visual attention itself?the mechanisms involved when _scrutinizing_ items. Experiments using controlled stimuli show the existence of various limits on visual search for change. It is shown that these limits provide a powerful means to map out the attentional mechanisms involved.

It is suggested that the relationship between visual attention and conscious visual experience can be simplified by distinguishing different aspects of both visual attention and visual experience. A set of principles is first proposed for any possible taxonomy of the processes involved in visual attention. A particular taxonomy is then put forward that describes five such processes, each with a distinct function and characteristic mode of operation. Based on these, three separate kinds—or possibly grades—of conscious visual experience can be distinguished, each associated with a particular combination of attentional processes.

Experiments are presented showing that visual search for Mueller-Lyer (ML) stimuli is based on complete configurations, rather than component segments. Segments easily detected in isolation were difficult to detect when embedded in a configuration, indicating preemption by low-level groups. This preemption—which caused stimulus components to become inaccessible to rapid search—was an all-or-nothing effect, and so could serve as a powerful test of grouping. It is shown that these effects are unlikely to be due to blurring by simple spatial filters at early visual levels. It is proposed instead that they are due to more sophisticated processes that rapidly bind contour fragments into spatially-extended assemblies. These results support the view that rapid visual search cannot access the primitives formed at the earliest stages of visual processing; rather, it can access only higher-level, more ecologically-relevant structures.

This article discusses several key issues concerning the study of attention and its relation to visual perception, with an emphasis on behavioral and experiential aspects. It begins with an overview of several classical works carried out in the latter half of the 20th century, such as the development of early filter and spotlight models of attention. This is followed by a survey of subsequent research that extended or modified these results in significant ways. It covers current work on various forms of induced blindness and on the capabilities of nonattentional processes. It also includes proposals about how a "just-in-time" allocation of attention can create the impression that we see our surroundings in coherent detail everywhere, as well as how the failure of such allocation can result in various perceptual deficits. The final section examines issues that have received little consideration to date, but may be important for new lines of research in the near future. These include the prospects for a better characterization of attention, the possibility of more systematic explanations, factors that may significantly modulate attentional operation, and the possibility of several kinds of visual attention and visual experience.

Human vision briefly retains a trace of a stimulus after it disappears. This trace—iconic memory—is often believed to be a surrogate for the original stimulus, a representational structure that can be used as if the original stimulus were still present. To investigate its nature, a flicker-search paradigm was developed that relied upon a full scan (rather than partial report) of its contents. Results show that for visual search it can indeed act as a surrogate, with little cost for alternating between visible and iconic representations. However, the duration over which it can be used depends on the type of task: some tasks can use iconic memory for at least 240 ms, others for only about 190 ms, while others for no more than about 120 ms. The existence of these different limits suggests that iconic memory may have multiple layers, each corresponding to a particular level of the visual hierarchy. In this view, the inability to use a layer of iconic memory may reflect an inability to maintain feedback connections to the corresponding representation.