Peter Danielson

N-Reasons is an experimental Internet survey platform designed to enhance public participation in applied ethics and policy. N-Reasons encourages individuals to generate reasons to support their judgments, and groups to converge on a common set of reasons pro and con various issues. In the Robot Ethics Survey some of the reasons contributed surprising judgments about autonomous machines. Presented with a version of the trolley problem with an autonomous train as the agent, participants gave unexpected answers, revealing high expectations for the autonomous machine and shifting blame from the automated device to the humans in the scenario. Further experiments with a standard pair of human-only trolley problems refine these results. While showing the high expectations even when no autonomous machine is involved, human bystanders are only blamed in the machine case. A third experiment explicitly aimed at responsibility for driverless cars confirms our findings about shifting blame in the case of autonomous machine agents. We conclude methodologically that both results point to the power of an experimental survey based approach to public participation to explore surprising assumptions and judgments in applied ethics. However, both results also support using caution when interpreting survey results in ethics, demonstrating the importance of qualitative data to provide further context for evaluating judgments revealed by surveys. On the ethics side, the result about shifting blame to humans interacting with autonomous machines suggests caution about the unintended consequences of intuitive principles requiring human responsibility.

Morality is serious yet it needs to be reconciled with the free play of alternatives that characterizes rational and ethical agency. Beginning with a sketch of the seriousness of morality modeled as a constraint, this paper introduces a technical conception of play as degrees of freedom. We consider two ways to apply game theory to ethics, rationalist and evolutionary game theory, contrasting the way they model moral constraint. Freedom in the rationalist account is problematic, subverting willful commitment. In the evolutionary account, freedom is also problematic, leading to an infinity of possible social norms with dubious normative force. While these two approaches complement each other, we argue that the evolutionary approach is superior on both theoretical and practical grounds.

A democratic ethics of biological technology must engage the public. This is not easy to do in a way that satisfies the demands of democratic ethics, or meets the pace of rapidly changing, complex technology. This paper describes a solution proposed by the University of British Columbia’s Norms Evolving in Response to Dilemmas interdisciplinary research group. The solution, the NERD web survey, has three distinct advantages over other methods: it is Deep—the survey provides deep data, particularly when compared to alternatives such as polls and focus groups; Cheap—our survey is cost effective, which is important for a truly democratic tool; and Improvable—the NERD survey is a work in progress, improvable by design.

We advocate and share the same theoretical framework for empirical research in ethics as exemplified in Christina Bicchieri’s The Grammar of Society. Our research differs from Bicchieri’s in our approach to experimentation: where she relies on lab experiments, we have constructed an experimental platform based on an internet survey instrument; where she relies on rational reconstructions, we do not. In this paper we focus on four contrasts in our methods: (1) we provide a space to explore ethical influence and norm transmission between participants, belief and choice revision, and reputation over time; (2) we provide ways for participants to expand the context of their and others’ decisions; (3) we focus on more realistic ethical decisions than is allowed by games; and (4) we explain why Bicchieri’s method of rational reconstructions presents challenges to her theory of social norms. Our methods are complementary to Bicchieri’s, and together we can work toward developing more comprehensive empirically informed ethics. †To contact the authors, please write to Peter Danielson, W. Maurice Young Centre for Applied Ethics, University of British Columbia, 227‐6356 Agricultural Road, Vancouver, V6T 1Z2, Canada; e‐mail: [email protected].

We can learn about human ethics from machines. We discuss the design of a working machine for making ethical decisions, the N-Reasons platform, applied to the ethics of robots. This N-Reasons platform builds on web based surveys and experiments, to enable participants to make better ethical decisions. Their decisions are better than our existing surveys in three ways. First, they are social decisions supported by reasons. Second, these results are based on weaker premises, as no exogenous expertise (aside from that provided by the participants) is needed to seed the survey. Third, N-Reasons is designed to support experiments so we can learn how to improve the platform. We sketch experimental results that show the platform is a success as well as pointing to ways it can be improved.

This book explores the role of artificial intelligence in the development of a claim that morality is person-made and rational. Professor Danielson builds moral robots that do better than amoral competitors in a tournament of games like the Prisoners Dilemma and Chicken. The book thus engages in current controversies over the adequacy of the received theory of rational choice. It sides with Gauthier and McClennan, who extend the devices of rational choice to include moral constraint. Artificial Morality goes further, by promoting communication, testing and copying of principles and by stressing empirical tests.