James Ward

In this report, the phenomenology of two blind users of a sensory substitution device – “The vOICe” – that converts visual images to auditory signals is described. The users both report detailed visual phenomenology that developed within months of immersive use and has continued to evolve over a period of years. This visual phenomenology, although triggered through use of The vOICe, is likely to depend not only on online visualization of the auditory signal but also on the users’ previous (albeit distant) experience of veridical vision (e.g. knowledge of shapes and visual perspective). Once established, the sensory substitution mapping between the auditory and visual domains is not confined to when the device is worn and, thus, may constitute an example of acquired synaesthesia.

In the concluding chapter of this handbook, I consider some of the wider challenges that research into synaesthesia faces. I start with a brief overview of the first 200 years of synaesthesia research. I then go on to consider the issue of how synaesthesia might be defined and the kinds of phenomena that could fall under that umbrella term. In the second part of the chapter, I consider how science can study a subjective experience, the challenges in identifying the causes and consequences of synaesthesia, and finally some of the wider implications of synaesthesia for understanding the 'normal' mind and brain.

Grapheme-colour synaesthesia is a perceptual experience where graphemes, letters or words evoke a specific colour, which are experienced either as spatially coincident with the grapheme inducer (projector sub-type) or elsewhere, perhaps without a definite spatial location (associator sub-type). Here, we address the question of whether synaesthesia can be rapidly produced using a hypnotic colour suggestion to examine the possibility of ‘hypnotic synaesthesia’, i.e. subjectively experienced colour hallucinations similar to those experienced by projector synaesthetes. We assess the efficacy of this intervention using an “embedded figures” test, in which participants are required to detect a shape (e.g., a square) composed of local graphemic elements. For grapheme-colour synaesthetes, better performance on the task has been linked to a higher proportion of graphemes perceived as coloured. We found no performance benefits on this test when using a hypnotic suggestion, as compared to a no-suggestion control condition. The same result was found when participants were separated according to the degree to which they were susceptible to the suggestion (number of coloured trials perceived). However, we found a relationship between accuracy and subjective reports of colour in those participants who reported a large proportion of coloured trials: trials in which the embedded figure was accurately recognised (relative to trials in which it was not) were associated with reports of more intense colours occupying a greater spatial extent. Collectively, this implies that hypnotic colour was only perceived after shape detection rather than aiding in shape detection via colour-based perceptual grouping. The results suggest that hypnotically induced colours are not directly comparable to synaesthetic ones.

Synaesthesia is a heterogeneous phenomenon, even when considering one particular sub-type. The purpose of this study was to design a reliable and valid questionnaire for grapheme-colour synaesthesia that captures this heterogeneity. By the means of a large sample of 628 synaesthetes and a factor analysis, we created the Coloured Letters and Numbers questionnaire with 16 items loading on 4 different factors . These factors were externally validated with tests which are widely used in the field of synaesthesia research. The questionnaire showed good test–retest reliability and construct validity . Our findings are discussed in the light of current theories and new ideas in synaesthesia research. More generally, the questionnaire is a useful tool which can be widely used in synaesthesia research to reveal the influence of individual differences on various performance measures and will be useful in generating new hypotheses

Recent research has suggested that not all grapheme-colour synaesthetes are alike. One suggestion is that they can be divided, phenomenologically, in terms of whether the colours are experienced in external or internal space. Another suggestion is that they can be divided according to whether it is the perceptual or conceptual attributes of a stimulus that is critical. This study compares the behavioural performance of 7 projector and 7 associator synaesthetes. We demonstrate that this distinction does not map on to behavioural traits expected from the higher–lower distinction. We replicate previous research showing that projectors are faster at naming their synaesthetic colours than veridical colours, and that associators show the reverse profile. Synaesthetes who project colours into external space but not on to the surface of the grapheme behave like associators on this task. In a second task, graphemes presented briefly in the periphery are more likely to elicit reports of colour in projectors than associators, but the colours only tend to be accurate when the grapheme itself is also accurately identified. We propose an alternative model of individual differences in grapheme-colour synaesthesia that emphasises the role of different spatial reference frames in synaesthetic perception. In doing so, we attempt to bring the synaesthesia literature closer to current models of non-synaesthetic perception, attention and binding.

Mirror-touch synaesthesia is a condition where observing touch to another’s body induces a subjective tactile sensation on the synaesthetes body. The present study explores which characteristics of the inducing stimulus modulate the synaesthetic touch experience. Fourteen mirror-touch synaesthetes watched videos depicting a touch event while indicating whether the video induced a tactile sensation, on which side of their body they felt this sensation and the intensity of the experienced sensation. Results indicate that the synaesthetes experience stronger tactile sensations when observing touch to real bodies, whereas observing touch to dummy bodies, pictures of bodies and disconnected dummy body parts elicited weaker sensations. These results suggest that mirror-touch synaesthesia is not entirely bottom-up driven, but top-down information, such as knowledge about real and dummy body parts, also modulate the intensity of the experience