Marc Leman

In diverse interaction processes that characterize music experience, the human hand can be seen as a mediator and facilitator for the brain’s processing of musical expressive patterns. After a brief overview on the human expressive system for music, we consider gestures and hand articulations in music production and performance, focusing on hand dexterity and hand dystonia. Then, we discuss the role of the hand in music listening, conducting, and learning, showing that both in sound-generation and sound-accompaniment the hand mediates and facilitates action and perception in relation to musical expression. The recent use of technology in the domain of music is also considered throughout the chapter, with particular reference to sensing and motion technologies that allow users to control music parameters through hand–body movements. The hand can be considered as a co-articulated organ of the brain’s action–perception machinery. Therefore, future research on hand and music should adopt a multiperspective approach that integrates different disciplines, from motor control to music performance and expression theories.

In a century where humans and machines—powered by artificial intelligence or not—increasingly work together, it is of interest to understand human processing of multi-sensory stimuli in relation to attention and working memory. This paper explores whether and when supporting visual information with rhythmic auditory stimuli can optimize multi-sensory information processing. In turn, this can make the interaction between humans or between machines and humans more engaging, rewarding and activating. For this purpose a novel working memory paradigm was developed where participants are presented with a series of five target digits randomly interchanged with five distractor digits. Their goal is to remember the target digits and recall them orally. Depending on the condition support is provided by audio and/or rhythm. It is expected that the sound will lead to a better performance. It is also expected that this effect of sound is different in case of rhythmic and non-rhythmic sound. Last but not least, some variability is expected across participants. To make correct conclusions, the data of the experiment was statistically analyzed in a classic way, but also predictive models were developed in order to predict outcomes based on a range of input variables related to the experiment and the participant. The effect of auditory support could be confirmed, but no difference was observed between rhythmic and non-rhythmic sounds. Overall performance was indeed affected by individual differences, such as visual dominance or perceived task difficulty. Surprisingly a music education did not significantly affect the performance and even tended toward a negative effect. To better understand the underlying processes of attention, also brain activation data, e.g., by means of electroencephalography, should be recorded. This approach can be subject to a future work.

Musical life became disrupted in 2020 due to the COVID-19 pandemic. Many musicians and venues turned to online alternatives, such as livestreaming. In this study, three livestreamed concerts were organized to examine separate, yet interconnected concepts—agency, presence, and social context—to ascertain which components of livestreamed concerts facilitate social connectedness. Hierarchical Bayesian modeling was conducted on 83 complete responses to examine the effects of the manipulations on feelings of social connectedness with the artist and the audience. Results showed that in concert 1, where half of the participants were allowed to vote for the final song to be played, this option did not result in the experience of more agency. Instead, if their preferred song was played (regardless of voting ability) participants experienced greater connectedness to the artist. In concert 2, participants who attended the concert with virtual reality headsets experienced greater feelings of physical presence, as well as greater feelings of connectedness with the artist, than those that viewed a normal YouTube livestream. In concert 3, attendance through Zoom led to greater experience of social presence, but predicted less connectedness with the artist, compared to a normal YouTube livestream. Crucially, a greater negative impact of COVID-19 (e.g., loneliness) predicted feelings of connectedness with the artist, possibly because participants fulfilled their social needs with this parasocial interaction. Examining data from all concerts suggested that physical presence was a predictor of connectedness with both the artist and the audience, while social presence only predicted connectedness with the audience. Correlational analyses revealed that reductions in loneliness and isolation were associated with feelings of shared agency, physical and social presence, and connectedness to the audience. Overall, the findings suggest that in order to reduce feelings of loneliness and increase connectedness, concert organizers and musicians could tune elements of their livestreams to facilitate feelings of physical and social presence.

Taking regular walks when living with Parkinson’s disease has beneficial effects on movement and quality of life. Yet, patients usually show reduced physical activity compared to healthy older adults. Using auditory stimulation such as music can facilitate walking but patients vary significantly in their response. An individualized approach adapting musical tempo to patients’ gait cadence, and capitalizing on these individual differences, is likely to provide a rewarding experience, increasing motivation for walk-in PD. We aim to evaluate the observance, safety, tolerance, usability, and enjoyment of a new smartphone application. It was coupled with wearable sensors and delivered individualized musical stimulation for gait auto-rehabilitation at home. Forty-five patients with PD underwent a 1-month, outdoor, uncontrolled gait rehabilitation program, using the BeatWalk application. The music tempo was being aligned in real-time to patients’ gait cadence in a way that could foster an increase up to +10% of their spontaneous cadence. Open-label evaluation was based on BeatWalk use measures, questionnaires, and a six-minute walk test. Patients used the application 78.8% of the prescribed duration and enjoyed it throughout the program. The application was considered “easy to use” by 75% of the patients. Pain, fatigue, and falls did not increase. Fear of falling decreased and quality of life improved. After the program, patients improved their gait parameters in the six-minute walk test without musical stimulation. BeatWalk is an easy to use, safe, and enjoyable musical application for individualized gait rehabilitation in PD. It increases “walk for exercise” duration thanks to high observance.Clinical Trial Registration: ClinicalTrials.gov Identifier: NCT02647242.

The Routledge Companion to Embodied Music Interaction captures a new paradigm in the study of music interaction, as a wave of recent research focuses on the role of the human body in musical experiences. This volume brings together a broad collection of work that explores all aspects of this new approach to understanding how we interact with music, addressing the issues that have roused the curiosities of scientists for ages: to understand the complex and multi-faceted way in which music manifests itself not just as sound but also as a variety of cultural styles, not just as experience but also as awareness of that experience. With contributions from an interdisciplinary and international array of scholars, including both empirical and theoretical perspectives, the Companion explores an equally impressive array of topics, including: Dynamical music interaction theories and concepts Expressive gestural interaction Social music interaction Sociological and anthropological approaches Empowering health and well-being Modeling music interaction Music-based interaction technologies and applications This book is a vital resource for anyone seeking to understand human interaction with music from an embodied perspective.

This article presents the views of four sets of authors, each taking concepts of embodied cognition into problem spaces where the new paradigm can be applied. The first considers consequences of embodied cognition on the legal system. The second explores how embodied cognition can change how we interpret and interact with art and literature. The third examines how we move through architectural spaces from an embodied cognition perspective. And the fourth addresses how music cognition is influenced by the approach. Each contribution is brief. They are meant to suggest the potential reach of embodied cognition, increase the visibility of applications, and inspire potential avenues for research.

Tone semantics is a psychoacoustic-based theory of gestalt perception that deals with tone perception and the assignment of functional relationships between tones in the musical context. The theory provides an operational account of semantics in terms of complex dynamic systems theory and forms the basis for non-symbolic research in music imagination. This is illustrated by an application in the automatic recognition of tone centers from acoustical input. An analysis of the basic concepts and related epistemological and methodological principles reveals a promising paradigm for music research.