Leonard Dung

Which artificial intelligence (AI) systems are agents? To answer this question, I propose a multidimensional account of agency. According to this account, a system's agency profile is jointly determined by its level of goal-directedness and autonomy as well as is abilities for directly impacting the surrounding world, long-term planning and acting for reasons. Rooted in extant theories of agency, this account enables fine-grained, nuanced comparative characterizations of artificial agency. I show that this account has multiple important virtues and is more informative than alternatives. More speculatively, it may help to illuminate two important emerging questions in AI ethics: 1. Can agency contribute to the moral status of non-human beings, and how? 2. When and why might AI systems exhibit power-seeking behaviour and does this pose an existential risk to humanity?

According to an orthodox view, the capacity for conscious experience (sentience) is relevant to the distribution of moral status and value. However, physicalism about consciousness might threaten the normative relevance of sentience. According to the indeterminacy argument, sentience is metaphysically indeterminate while indeterminacy of sentience is incompatible with its normative relevance. According to the introspective argument (by François Kammerer), the unreliability of our conscious introspection undercuts the justification for belief in the normative relevance of consciousness. I defend the normative relevance of sentience against these objections. First, I demonstrate that physicalists only have to concede a limited amount of indeterminacy of sentience. This moderate indeterminacy is in harmony with the role of sentience in determining moral status. Second, I argue that physicalism gives us no reason to expect that introspection is unreliable with respect to the normative relevance of consciousness.

If a machine attains consciousness, how could we find out? In this paper, I make three related claims regarding positive tests of machine consciousness. All three claims center on the idea that an AI can be constructed “ad hoc”, that is, with the purpose of satisfying a particular test of consciousness while clearly not being conscious. First, a proposed test of machine consciousness can be legitimate, even if AI can be constructed ad hoc specifically to pass this test. This is underscored by the observation that many, if not all, putative tests of machine consciousness can be passed by non-conscious machines via ad hoc means. Second, we can identify ad hoc AI by taking inspiration from the notion of an ad hoc hypothesis in philosophy of science. Third, given the first and the second claim, the most reliable tests of animal consciousness turn out to be valid and useful positive tests of machine consciousness as well. If a non-ad hoc AI exhibits clusters of cognitive capacities facilitated by consciousness in humans which can be selectively switched off by masking and if it reproduces human behavior in suitably designed double dissociation tasks, we should treat the AI as conscious.

How can one build AI systems such that they pursue the goals their designers want them to pursue? This is the alignment problem. Numerous authors have raised concerns that, as research advances and systems become more powerful over time, misalignment might lead to catastrophic outcomes, perhaps even to the extinction or permanent disempowerment of humanity. In this paper, I analyze the severity of this risk based on current instances of misalignment. More specifically, I argue that contemporary large language models and game-playing agents are sometimes misaligned. These cases suggest that misalignment tends to have a variety of features: misalignment can be hard to detect, predict and remedy, it does not depend on a specific architecture or training paradigm, it tends to diminish a system’s usefulness and it is the default outcome of creating AI via machine learning. Subsequently, based on these features, I show that the risk of AI alignment magnifies with respect to more capable systems. Not only might more capable systems cause more harm when misaligned, aligning them should be expected to be more difficult than aligning current AI.

Many researchers and intellectuals warn about extreme risks from artificial intelligence. However, these warnings typically came without systematic arguments in support. This paper provides an argument that AI will lead to the permanent disempowerment of humanity, e.g. human extinction, by 2100. It rests on four substantive premises which it motivates and defends: first, the speed of advances in AI capability, as well as the capability level current systems have already reached, suggest that it is practically possible to build AI systems capable of disempowering humanity by 2100. Second, due to incentives and coordination problems, if it is possible to build such AI, it will be built. Third, since it appears to be a hard technical problem to build AI which is aligned with the goals of its designers, and many actors might build powerful AI, misaligned powerful AI will be built. Fourth, because disempowering humanity is useful for a large range of misaligned goals, such AI will try to disempower humanity. If AI is capable of disempowering humanity and tries to disempower humanity by 2100, then humanity will be disempowered by 2100. This conclusion has immense moral and prudential significance.

Whether animals fare well or not is of ethical significance. For this reason, their capacity for wellbeing, i.e., how good or bad the lives of animals can go, is of ethical significance as well. I assume that the wellbeing of most animals is mainly determined by their phenomenally conscious experiences. If consciousness differences between species determine wellbeing differences, then the kinds of conscious experience species are capable of may entail that some species systematically (can) have higher or lower wellbeing than others. Then, I argue that not all phenomenally conscious states contribute to wellbeing equally. I discuss which features of consciousness are constituents of wellbeing and which can, for ethical purposes, be ignored. In addition, I scrutinize how much different features of experience contribute to wellbeing and how their presence can be detected empirically. This way, this paper exemplifies a novel consciousness-centered approach for the empirical investigation of animal wellbeing. The strengths and weaknesses of this approach are analyzed. While subsequent research is needed to refine the framework, I already note some preliminary implications for animal ethics.

Segundo-Ortin & Calvo argue that plants have a surprisingly varied and complex behavioral repertoire. Which of these behavioral capacities are credible indicators of sentience? If we use the standards of evidence common in discussions of animal sentience, the behavioral capacities reviewed are insufficient evidence of sentience. Even if some putative indicators of animal sentience are present in plants, it is not clear whether what we should conclude is that plants are sentient or that those indicators are inadequate.

The science of animal consciousness investigates (i) which animal species are conscious (the distribution question) and (ii) how conscious experience differs in detail between species (the quality question). We propose a framework which clearly distinguishes both questions and tackles both of them. This two-tier account distinguishes consciousness along ten dimensions and suggests cognitive capacities which serve as distinct operationalizations for each dimension. The two-tier account achieves three valuable aims: First, it separates strong and weak indicators of the presence of consciousness. Second, these indicators include not only different specific contents but also differences in the way particular contents are processed (by processes of learning, reasoning or abstraction). Third, evidence of consciousness from each dimension can be combined to derive the distinctive multi-dimensional consciousness profile of various species. Thus, the two-tier account shows how the kind of conscious experience of different species can be systematically compared.

According to a common view, sentience is necessary and sufficient for moral status. In other words, whether a being has intrinsic moral relevance is determined by its capacity for conscious experience. The _epistemic objection_ derives from our profound uncertainty about sentience. According to this objection, we cannot use sentience as a _criterion_ to ascribe moral status in practice because we won’t know in the foreseeable future which animals and AI systems are sentient while ethical questions regarding the possession of moral status are urgent. Therefore, we need to formulate an alternative criterion. I argue that the epistemic objection is dissolved once one clearly distinguishes between the question what determines moral status and what criterion should be employed in practice to ascribe moral status. Epistemic concerns are irrelevant to the former question and—I will argue—criteria of moral status have inescapably to be based on sentience, if one concedes that sentience determines moral status. It follows that doubts about our epistemic access to sentience cannot be used to motivate an alternative criterion of moral status. If sentience turns out to be unknowable, then moral status is unknowable. However, I briefly advocate against such strong pessimism.

Which animals have conscious experiences? Many different, diverse and unrelated behaviors and cognitive capacities have been proposed as tests of the presence of consciousness in an animal. It is unclear which of these tests, if any, are valid. To remedy this problem, I develop a list consisting of eight desiderata which can be used to assess putative tests of animal consciousness. These desiderata are based either on detailed analogies between consciousness-linked human behavior and non-human behavior, on theories of consciousness or on methods from human consciousness science. If a test or set of tests satisfies more of these desiderata, passing it provides stronger evidence of consciousness. Moreover, one can design future tests of animal consciousness with the intention of satisfying these desiderata to ensure their evidential strength.

Sensorimotor enactivism is the view that the content and the sensory modality of perceptual experience are determined by implicit knowledge of lawful regularities between bodily movements and patterns of sensory stimulation. A proponent of the explanatory argument for sensorimotor enactivism holds that this view is able to provide an intelligible explanation for why certain material realizers give rise to certain perceptual experiences, while rival accounts cannot close this “explanatory gap”. However, I argue that the notion of the “material realizer” of perceptual experience is ambiguous. On a narrow construal, the explanatory gap cannot be bridged, not even by enactivism. On a wide construal, enactivism gets a grip on the explanatory gap, but to the same extent do established theories of consciousness. Thus, on both horns of the dilemma, the explanatory power of enactivism is not superior to more traditional theories of conscious experience.

Illusionism about consciousness entails that phenomenal consciousness doesn’t exist. The distribution question concerns the distribution of consciousness in the animal kingdom. Skepticism of animal consciousness is the view that few or no kinds of animals possess consciousness. Thus, illusionism seems to imply a skeptical view on the distribution question. However, I argue that illusionism and skepticism of animal consciousness are actually orthogonal to each other. If illusionism is true, then phenomenal consciousness does not ground intrinsic value so that the non-existence of phenomenal consciousness would not have ethical implications. In this case, the adequate reaction is to reformulate the distribution question in terms of the quasi-phenomenal functional features associated with the illusion of phenomenal consciousness which do ground intrinsic value. Hence, either illusionism is false or the distribution question does not concern phenomenal consciousness. In any case, illusionism does not directly tell us anything about the distribution question. However, since illusionism forces us to revise our traditional conception of consciousness, it indirectly affects research on animal consciousness by questioning that consciousness is a unified and an all-or-nothing property.