Mark Coeckelbergh

Should we give moral standing to machines? In this paper, I explore the implications of a relational approach to moral standing for thinking about machines, in particular autonomous, intelligent robots. I show how my version of this approach, which focuses on moral relations and on the conditions of possibility of moral status ascription, provides a way to take critical distance from what I call the “standard” approach to thinking about moral status and moral standing, which is based on properties. It does not only overcome epistemological problems with the standard approach, but can also explain how we think about, experience, and act towards machines—including the gap that sometimes occurs between reasoning and experience. I also articulate the non-Cartesian orientation of my “relational” research program and specify the way it contributes to a different paradigm in thinking about moral standing and moral knowledge.

Discovering obligations that are ascribed to them by others is potentially an important element in the development of the moral imagination of engineers. Moral imagination cannot reasonably be developed by contemplating oneself and one’s task alone: there must be some element of discovering the expectations of people one could put at risk. In practice it may be impossible to meet ascribed obligations if they are completely general and allow no exceptions — for example if they demand an unlimited duty to avoid harm. But they can still serve to modify engineers’ prior ethics, for example by limiting a purely utilitarian approach to deciding who should bear risk and how much risk they should bear. Ascribed obligations can also give engineers insight into the public reaction to risks that arise from engineered systems, and the consequent expectations that the public have about how much protection is desirable and where the responsibility for this protection lies. This article analyses the case for taking ascribed obligations seriously, and reviews some of the obligations that have been ascribed in the aftermath of recent engineering failures. It also proposes ways in which ascribed obligations could be used in engineers’ moral development.

Can we build ‘moral robots’? If morality depends on emotions, the answer seems negative. Current robots do not meet standard necessary conditions for having emotions: they lack consciousness, mental states, and feelings. Moreover, it is not even clear how we might ever establish whether robots satisfy these conditions. Thus, at most, robots could be programmed to follow rules, but it would seem that such ‘psychopathic’ robots would be dangerous since they would lack full moral agency. However, I will argue that in the future we might nevertheless be able to build quasi-moral robots that can learn to create the appearance of emotions and the appearance of being fully moral. I will also argue that this way of drawing robots into our social-moral world is less problematic than it might first seem, since human morality also relies on such appearances.