Michael Lyons

We present an investigation into the relation between design principles in Japanese gardens, and their associated perceptual effects. This leads to the realization that a set of design principles described in a Japanese gardening text by Shingen (1466), shows many parallels to the visual effects of perceptual grouping, studied by the Gestalt school of psychology. Guidelines for composition of rock clusters closely relate to perception of visual figure. Garden design elements are arranged into patterns that simplify figure-ground segmentation, while seemingly balancing the visual salience of subparts and the global arrangement. Visual ‘ground’ is analyzed via medial axis transformation (MAT), often associated with shape perception in humans. MAT analysis reveals implicit structure in the visual ground of a quintessential rock garden design. The MAT structure enables formal comparison of structure of figure and ground. They share some aesthetic qualities, with interesting differences. Both contain naturalistic asymmetric, self-similar, branching structures. While the branching pattern of the ground converges towards the viewer, that of the figure converges in the opposite direction.

We present a technique for the analysis of pattern formation by a class of models for the formation of ocular dominance stripes in the striate cortex of some mammals. The method, which employs the adiabatic approximation to derive a set of ordinary differential equations for patterning modes, has been successfully applied to reaction-diffusion models for striped patterns [1]. Models of ocular dominance stripes have been studied [2,3] by computation, or by linearization of the model equations. These techniques do not provide a rationale for the origin of the stripes. We show here that stripe formation is a non-linear property of the models. Our analysis indicates that stripe selection is closely linked to a property in the dynamics of the models which arises from a symmetry between ipsilateral and contralateral synapses to the visual cortex of a given hemisphere.

Twenty-five years ago, my colleagues Miyuki Kamachi and Jiro Gyoba and I designed and photographed JAFFE, a set of facial expression images intended for use in a study of face perception. In 2019, without seeking permission or informing us, Kate Crawford and Trevor Paglen exhibited JAFFE in two widely publicized art shows. In addition, they published a nonfactual account of the images in the essay “Excavating AI: The Politics of Images in Machine Learning Training Sets.” The present article recounts the creation of the JAFFE dataset and unravels each of Crawford and Paglen’s fallacious statements. I also discuss JAFFE more broadly in connection with research on facial expression, affective computing, and human-computer interaction.

We present three patterns for computer-mediated interaction which we discovered during the design and development of a platform for remote teaching and learning of kanji, the Chinese characters used in written Japanese. Our aim in developing this system was to provide a basis for embodiment in remote interaction, and in particular to support the experience of empathy by both teacher and student. From this study, the essential elements are abstracted and suggested as design patterns for other computer-mediated interaction systems.

Two art exhibitions, “Training Humans” and “Making Faces,” and the accompanying essay “Excavating AI: The politics of images in machine learning training sets” by Kate Crawford and Trevor Paglen, are making substantial impact on discourse taking place in the social and mass media networks, and some scholarly circles. Critical scrutiny reveals, however, a self-contradictory stance regarding informed consent for the use of facial images, as well as serious flaws in their critique of ML training sets. Our analysis underlines the non-negotiability of informed consent when using human data in artistic and other contexts, and clarifies issues relating to the description of ML training sets.

We present an investigation into the relation between design princi- ples in Japanese gardens, and their associated perceptual effects. This leads to the realization that a set of design principles described in a Japanese gardening text by Shingen (1466), shows many parallels to the visual effects of perceptual grouping, studied by the Gestalt school of psychology. Guidelines for composition of rock clusters closely relate to perception of visual figure. Garden design elements are arranged into patterns that simplify figure-ground segmentation, while seemingly balancing the visual salience of subparts and the global arrangement. Visual ‘ground’ is analyzed via medial axis transformation (MAT), often associated with shape perception in humans. MAT analysis reveals implicit structure in the visual ground of a quintessential rock garden design. The MAT structure enables formal com- parison of structure of figure and ground. They share some aesthetic qualities, with interesting differences. Both contain naturalistic asymmetric, self-similar, branching structures. While the branching pattern of the ground converges towards the viewer, that of the figure converges in the opposite direction.

A model of face representation, inspired by the biology of the visual system, is compared to experimental data on the perception of facial similarity. The face representation model uses aggregate primary visual cortex (V1) cell responses topographically linked to a grid covering the face, allowing comparison of shape and texture at corresponding points in two facial images. When a set of relatively similar faces was used as stimuli, this Linked Aggregate Code (LAC) predicted human performance in similarity judgment experiments. When faces of perceivable categories were used, dimensions such as apparent sex and race emerged from the LAC model without training. The dimensional structure of the LAC similarity measure for the mixed category task displayed some psychologically plausible features but also highlighted differences between the model and the human similarity judgements. The human judgements exhibited a racial perceptual bias that was not shared by the LAC model. The results suggest that the LAC based similarity measure may offer a fertile starting point for further modelling studies of face representation in higher visual areas, including studies of the development of biases in face perception.