Vincent C. Müller

Special Issue “Risks of artificial general intelligence”, Journal of Experimental and Theoretical Artificial Intelligence, 26/3 (2014), ed. Vincent C. Müller. http://www.tandfonline.com/toc/teta20/26/3# - Risks of general artificial intelligence, Vincent C. Müller, pages 297-301 - Autonomous technology and the greater human good - Steve Omohundro - pages 303-315 - - - The errors, insights and lessons of famous AI predictions – and what they mean for the future - Stuart Armstrong, Kaj Sotala & Seán S. Ó hÉigeartaigh - pages 317-342 - - - The path to more general artificial intelligence - Ted Goertzel - pages 343-354 - - - Limitations and risks of machine ethics - Miles Brundage - pages 355-372 - - - Utility function security in artificially intelligent agents - Roman V. Yampolskiy - pages 373-389 - - - GOLEM: towards an AGI meta-architecture enabling both goal preservation and radical self-improvement - Ben Goertzel - pages 391-403 - - - Universal empathy and ethical bias for artificial general intelligence - Alexey Potapov & Sergey Rodionov - pages 405-416 - - - Bounding the impact of AGI - András Kornai - pages 417-438 - - - Ethics of brain emulations - Anders Sandberg - pages 439-457

The paper argues that the reference of perceptual demonstratives is fixed in a causal nondescriptive way through the nonconceptual content of perception. That content consists first in spatiotemporal information establishing the existence of a separate persistent object retrieved from a visual scene by the perceptual object segmentation processes that open an object-file for that object. Nonconceptual content also consists in other transducable information, that is, information that is retrieved directly in a bottom-up way from the scene (motion, shape, etc). The nonconceptual content of the mental states induced when one uses a perceptual demonstrative constitutes the mode of presentation of the perceptual demonstrative that individuates but does not identify the object of perceptual awareness and allows reference to it. On that account, perceptual demonstratives put us in a de re relationship with objects in the world through the non-conceptual information retrieved directly from the objects in the environment.

Two large lexicological projects for the Center for the Greek Language, Thessaloniki, were to be published in print and on the WWW, which meant that two conversions were needed: a near-database file had to be converted to fully formatted file for printing and a fully formatted file had to be converted to a database for WWW access. As it turned out, both conversions could make use of existing clues that indicated the kinds of information contained in each particular piece of text, thus separating fields from each other and ordering them into a tree-like structure. This indicates that both forms of the dictionaries, print and database, stem from the same cognitive need to categorize information into a kind of information before further understanding – be this for a human reader or for a machine.

This paper investigates the view that digital hypercomputing is a good reason for rejection or re-interpretation of the Church-Turing thesis. After suggestion that such re-interpretation is historically problematic and often involves attack on a straw man (the ‘maximality thesis’), it discusses proposals for digital hypercomputing with Zeno-machines , i.e. computing machines that compute an infinite number of computing steps in finite time, thus performing supertasks. It argues that effective computing with Zeno-machines falls into a dilemma: either they are specified such that they do not have output states, or they are specified such that they do have output states, but involve contradiction. Repairs though non-effective methods or special rules for semi-decidable problems are sought, but not found. The paper concludes that hypercomputing supertasks are impossible in the actual world and thus no reason for rejection of the Church-Turing thesis in its traditional interpretation.

We try to show that there is no difference in principle between communicating a piece of information to a human and to a machine. The argumentation depends on the following theses: Communicating is transfer of information; information has propositional form; propositional form can be modelled as categorization; categorisation can be modelled in a machine; a suitably equipped machine can grasp propositional content designed for human communication. What I suggest is that the discussion should focus on the truth and precise meaning of these statements. However, in case these statements are true it follows that: For any act of communication that successfully transfers a piece of information to a human, that act could also transfer that piece of information to a machine.

This book is a new attempt to clarify what is at issue in the contemporary realism debates and to suggest which form the controversies ought to take. Wright has contributed to the-se debates for quite some time and essentially taken the anti-realist side (witness the papers collected in Realism, Meaning and Truth, 1987, 21993, and the forthcoming Realism, Rules and Objectivity, both Oxford: Basil Blackwell). In Truth and Objectivity however, he takes a step back and sketches a neutral ground upon which both sides could agree in or-der to define their oppositions clearly, thus enabling fruitful discussions. His methodolog-ical suggestion for a realism debate in a given assertoric discourse is that both sides should agree on a “minimal” concept of truth for that discourse and then see whether ascent to a more metaphysically substantial concept of truth is warranted, which would constitute a realism for the discourse in question. If Wright had managed to set the agenda in a way that does justice to both sides, this book would have constituted a major contribution to contemporary epistemology and metaphysics.

Concordance of the poetic works of Giorgos Seferis which presents all the principal “words” of the texts in an alphabetical list, stating how often each word occurs, giving a precise location and a relevant piece of text for each occurrence. We found ca. 9500 different Greek words in 39000 different occurrences, so our concordance has 50.000 lines of text. The technical procedure required four main steps: text entry and tagging, production of the concordance, correction of the contexts, formatting for print.

Floridi and Taddeo propose a condition of “zero semantic commitment” for solutions to the grounding problem, and a solution to it. I argue briefly that their condition cannot be fulfilled, not even by their own solution. After a look at Luc Steels' very different competing suggestion, I suggest that we need to re-think what the problem is and what role the ‘goals’ in a system play in formulating the problem. On the basis of a proper understanding of computing, I come to the conclusion that the only sensible ground-ing problem is how we can explain and re-produce the behavioral ability and function of meaning in artificial computational agents

Die gegenwärtig unter dem Titel ›Realismus‹ geführten Debatten in der Philosophie befinden sich nach allgemeiner Ansicht in einem Zustand größter Verwirrung, so daß es nützlich erscheint, ein wenig Ordnung in die theoretischen Optionen zu bringen bevor man für die eine oder andere Auffassung Partei ergreift. In der vorliegenden Arbeit wird dafür argumentiert, daß sich ein systematisch zusammenhängendes Zentrum dieser Debatten mit Hilfe des Begriffes der Referenz ordnen läßt. Nach der Analyse einiger klassischer Positionen soll ein Rahmen erstellt werden, innerhalb dessen die Positionen eingeordnet und die zentralen Probleme fruchtbar diskutiert werden können. Zu diesem Zwecke ist es erforderlich, für die Einordnung der Positionen theoretische Kriterien zu benennen, die sich an den Problemen orientieren von denen hier argumentiert wird, das sie zentral seien. Sehr knapp ausgedrückt wird hier die Auffassung vertreten, Realismus sei als metaphysische These aufzufassen, welche eine von menschlichen epistemischen und semantischen Möglichkeiten unabhängige Existenz behauptet; in den gegenwärtigen Debatten typischerweise die Existenz einer Art von Dingen, nicht die eines individuellen Gegenstandes. Diese metaphysische These wird jedoch in der gegenwärtigen Debatte mit semantischen Argumenten untermauert, bzw. angegriffen und jene semantischen Argumente wiederum verwenden epistemische Erwägungen – die Frage betreffend, was man wissen kann und was nicht. Der Beginn der gegenwärtigen Realismusdebatten mit der soeben skizzierten zentralen Stellung semantischer Argumente ist, der hier vertretenen Auffassung zufolge, die Kritik am traditionellen Fregeschen Referenzbegriff durch Kripke und den frühen Putnam um 1970 (Kap. 2). Aus dieser neu zu bewertenden Kritik und der von den Autoren daraus entwickelten externalistischen realistischen Semantik für Artausdrücke läßt sich das erste Kriterium für eine Position in einer Realismusdebatte ableiten und klären (Kap. 3): Hält man die fragliche Art für eine natürliche Art und meint also, sie habe ihren ›Zusammenhalt‹ von Natur aus? Wenn ja, dann ist die fragliche Position eine realistische (das Kriterium ist dank des engen Zusammenhangs von Realismus und Externalismus sowohl hinreichend als auch notwendig). Hält man die Art nicht für eine natürliche Art, ist man Antirealist. Damit geht jeweils not- wendig eine bestimmte Semantik für den auf die Art referierenden Ausdruck einher. Es zeigt sich zugleich, daß es zwei Varianten des Realismus zu unterscheiden gilt, die hier als klassischer bzw. als moderater Realismus bezeichnet werden. Im folgenden (Kap. 4.1) wird argumentiert, daß der Begriff der Wahrheit nicht eigentlich der zentrale Punkt in den in Frage stehenden Realismusdebatten sein sollte, wie vielfach behauptet wurde, sondern seine Brisanz vielmehr aus zugrundeliegenden semantischen Fragen gewinnt die also in der weiteren Aufdeckung der Kriterien die zentrale Rolle spielen müssen. In der Analyse der Kritik an der in Kap. 3 entwickelten Position des ›klassischen Realismus‹ läßt sich ein zweites unterscheidendes Kriterium für Positionen in Realismusdebatten entwickeln: begriffliche Relativität. Nach der Ablehnung von Putnams Auffassungen zu diesem Thema, werden zwei Varianten vorgeschlagen, starke und schwache begriffliche Relativität (Kap. 4.2). Die Anwendung dieses Merkmals zwingt, so wird argumentiert, in einigen Fällen zu einer Kombination einer realistischen Auffassung von Arten als natürliche mit begrifflicher Relativität. Diese mittlere Position zwischen klassischem Realismus und Antirealismus wird als »moderater Realismus« bezeichnet. Der im ersten Kriterium verwendete Begriff der natürlichen Art, und damit die Optionen in den Debatten, wird schließlich mittels einer Dis- kussion des Phänomens der Vagheit noch weiter verdeutlicht (Kap. 4.3). Ab- schließend werden die drei Optionen zusammenfassend dargestellt und ein Versuch unternommen, ihre Fruchtbarkeit für diverse Realismusdebatten anzudeuten.

This paper investigates a problem about freedom of information. Although freedom of information is generally considered desirable, there are a number of areas where there is substantial agreement that freedom of information should be limited. After a certain ordering of the landscape, I argue that we need to add the category of "dangerous" information and that this category has gained a new quality in the context of current information technology, specifically the Internet. This category includes information the use of which would be morally wrong as well as some of what may be called "corrupting" information. Some such information should not be spread at all and some should be very limited in its spread.

If the intelligence of artificial systems were to surpass that of humans significantly, this would constitute a significant risk for humanity. Time has come to consider these issues, and this consideration must include progress in AI as much as insights from the theory of AI. The papers in this volume try to make cautious headway in setting the problem, evaluating predictions on the future of AI, proposing ways to ensure that AI systems will be beneficial to humans – and critically evaluating such proposals.

This paper investigates the prospects of Rodney Brooks’ proposal for AI without representation. It turns out that the supposedly characteristic features of “new AI” (embodiment, situatedness, absence of reasoning, and absence of representation) are all present in conventional systems: “New AI” is just like old AI. Brooks proposal boils down to the architectural rejection of central control in intelligent agents—Which, however, turns out to be crucial. Some of more recent cognitive science suggests that we might do well to dispose of the image of intelligent agents as central representation processors. If this paradigm shift is achieved, Brooks’ proposal for cognition without representation appears promising for full-blown intelligent agents—Though not for conscious agents.

In October 2011, the “2nd European Network for Cognitive Systems, Robotics and Interaction”, EUCogII, held its meeting in Groningen on “Autonomous activity in real-world environments”, organized by Tjeerd Andringa and myself. This is a brief personal report on why we thought autonomy in real-world environments is central for cognitive systems research and what I think I learned about it. --- The theses that crystallized are that a) autonomy is a relative property and a matter of degree, b) increasing autonomy of an artificial system from its makers and users is a necessary feature of increasingly intelligent systems that can deal with the real-world and c) more such autonomy means less control but at the same time improved interaction with the system

In this paper we address the issue of grounding for experiential concepts. Given that perceptual demonstratives are a basic form of such concepts, we examine ways of fixing the referents of such demonstratives. To avoid ‘encodingism’, that is, relating representations to representations, we postulate that the process of reference fixing must be bottom-up and nonconceptual, so that it can break the circle of conceptual content and touch the world. For that purpose, an appropriate causal relation between representations and the world is needed. We claim that this relation is provided by spatial and object-centered attention that leads to the formation of object files through the function of deictic acts. This entire causal process takes place at a pre-conceptual level, meeting the requirement for a solution to the grounding problem. Finally we claim that our account captures fundamental insights in Putnam’s and Kripke’s work on “new” reference.

Wenn Präsident Kennedy nicht erschossen worden wäre, hätte er dann Nordvietnam bombardiert? Das weiß Gott allein. Oder doch nicht? Weiß wenigstens Er, was Kennedy getan hätte?... Die Jesuiten behaupteten unter anderem, daß viele menschliche Handlungen in dem Sinne frei seien, daß die Ausführenden nicht logisch oder kausal gezwungen seien, sie auszuführen. („Frei“ wird im vorliegenden Aufsatz stets in diesem Sinne verwendet werden.) Wie behält Gott dann die Kontrolle über die menschliche Geschichte? Nicht dadurch, daß Er menschliche Handlungen kausal determiniert, wie die Dominikaner geglaubt zu haben scheinen, sondern indem Er Umstände herbeiführt, von denen Er weiß, daß wir in ihnen freiwillig Seinen Plänen entsprechend handeln werden.

In this paper I want to propose an argument to support Jerry Fodor’s thesis (Fodor 1983) that input systems are modular and thus informationally encapsulated. The argument starts with the suggestion that there is a “grounding problem” in perception, i. e. that there is a problem in explaining how perception that can yield a visual experience is possible, how sensation can become meaningful perception of something for the subject. Given that visual experience is actually possible, this invites a transcendental argument that explains the conditions of its possibility. I propose that one of these conditions is the existence of a visual module in Fodor’s sense that allows the step from sensation to object-identifying perception, thus enabling visual experience. It seems to follow that there is informationally encapsulated nonconceptual content in visual perception.

Papers from the conference on AI Risk (published in JETAI), supplemented by additional work. --- If the intelligence of artificial systems were to surpass that of humans, humanity would face significant risks. The time has come to consider these issues, and this consideration must include progress in artificial intelligence (AI) as much as insights from AI theory. -- Featuring contributions from leading experts and thinkers in artificial intelligence, Risks of Artificial Intelligence is the first volume of collected chapters dedicated to examining the risks of AI. The book evaluates predictions of the future of AI, proposes ways to ensure that AI systems will be beneficial to humans, and then critically evaluates such proposals. 1 Vincent C. Müller, Editorial: Risks of Artificial Intelligence - 2 Steve Omohundro, Autonomous Technology and the Greater Human Good - 3 Stuart Armstrong, Kaj Sotala and Sean O’Heigeartaigh, The Errors, Insights and Lessons of Famous AI Predictions - and What they Mean for the Future - 4 Ted Goertzel, The Path to More General Artificial Intelligence - 5 Miles Brundage, Limitations and Risks of Machine Ethics - 6 Roman Yampolskiy, Utility Function Security in Artificially Intelligent Agents - 7 Ben Goertzel, GOLEM: Toward an AGI Meta-Architecture Enabling Both Goal Preservation and Radical Self-Improvement - 8 Alexey Potapov and Sergey Rodionov, Universal Empathy and Ethical Bias for Artificial General Intelligence - 9 András Kornai, Bounding the Impact of AGI - 10 Anders Sandberg, Ethics and Impact of Brain Emulations 11 Daniel Dewey, Long-Term Strategies for Ending Existential Risk from Fast Takeoff - 12 Mark Bishop, The Singularity, or How I Learned to Stop Worrying and Love AI -

We discuss at some length evidence from the cognitive science suggesting that the representations of objects based on spatiotemporal information and featural information retrieved bottomup from a visual scene precede representations of objects that include conceptual information. We argue that a distinction can be drawn between representations with conceptual and nonconceptual content. The distinction is based on perceptual mechanisms that retrieve information in conceptually unmediated ways. The representational contents of the states induced by these mechanisms that are available to a type of awareness called phenomenal awareness constitute the phenomenal content of experience. The phenomenal content of perception contains the existence of objects as separate things that persist in time and time, spatiotemporal information, and information regarding relative spatial relations, motion, surface properties, shape, size, orientation, color, and their functional properties.

Just as AI has moved away from classical AI, human-computer interaction (HCI) must move away from what I call ‘good old fashioned HCI’ to ‘new HCI’ – it must become a part of cognitive systems research where HCI is one case of the interaction of intelligent agents (we now know that interaction is essential for intelligent agents anyway). For such interaction, we cannot just ‘analyze the data’, but we must assume intentions in the other, and I suggest these are largely recognized through resistance to carrying out one’s own intentions. This does not require fully cognitive agents but can start at a very basic level. New HCI integrates into cognitive systems research and designs intentional systems that provide resistance to the human agent.

This is the short version, in French translation by Anne Querrien, of the originally jointly authored paper: Müller, Vincent C., ‘Autonomous killer robots are probably good news’, in Ezio Di Nucci and Filippo Santoni de Sio, Drones and responsibility: Legal, philosophical and socio-technical perspectives on the use of remotely controlled weapons. - - - L’article qui suit présente un nouveau système d’armes fondé sur des robots qui risque d’être prochainement utilisé. À la différence des drones qui sont manoeuvrés à distance mais comportent une part importante de discernement humain, il s’agit de machines programmées pour défendre, attaquer, ou tuer de manière autonome. Les auteurs, philosophes, préfèrent prévenir de leur prochaine diffusion et obtenir des Nations Unies leur régulation. Une campagne internationale propose plutôt leur interdiction.

Review of Joseph LeDoux: Das Netz der Persönlichkeit. Wie unser Selbst entsteht. Walter Verlag, Düsseldorf 2003. 510 Seiten (mit Abbildungen), 39,90 Euro. - Der eine Mensch ist mißtrauisch, der nächste leichtgläubig, diese ist warmherzig, jene kaltschnäuzig. Viele haben Charakter, manche sogar Persönlichkeit. Wie kommt es dazu? In seinem neuen Buch untersucht der Neurowissenschaftler Joseph LeDoux wie unser Selbst entsteht. In dem sehr lesbaren und angenehm übersetzten Werk wird anschaulich und detailliert berichtet, wie sich in unserem Gehirn die Charakteristika eines Individuums ausbilden.

From a European perspective the US debate about gun control is puzzling because we have no such debate: It seems obvious to us that dangerous weapons need tight control and that ‘guns’ fall under that category. I suggest that this difference occurs due to different habits that generate different attitudes and support this explanation with an analogy to the habits about knives. I conclude that it is plausible that individual knife-people or gun-people do not want tight regulatory legislation—but tight knife and gun legislation is morally obligatory anyway. We need to give up our habits for the greater good.

Ποια είναι η πατρίδα κάποιων; Ας δούμε το θέμα λίγο σαν πρόβλημα της φιλοσοφίας της γλώσσας: για ένα κατηγόρημα «Άγγλος» «Γάλλος», «Πορτογάλος», «Βέλγος», «Φλαμανδός», πώς να αποφασίσουμε ποια αντικείμενα (ποιοι άνθρωποι) εμπίπτουν σε ποιο κατηγόρημα; Έχουν τελικά νόημα αυτά τα κατηγορήματα; Η χρήση και κατάχρηση αυτών των κατηγορημάτων έχει αποτελέσει μια από τις κυριότερες πηγές δυστυχίας στη διάρκεια των δύο τελευταίων αιώνων και συνεχίζει να είναι στην ημερήσια διάταξη. Συνήθως εμφανίζεται στα πλαίσια αγώνων για την απόκτηση «ελευθερίας» σε αντιπαράθεση με την «καταπίεση», και σε παγκόσμιο επίπεδο και κοντύτερα μας: στη Μακεδονία, την Καταλονία, την Ιρλανδία, το Κουρδιστάν ... Νομίζω πώς αρκετά από αυτά βασίζονται σε λάθη.

I want to suggest that the major influence of classical arguments for embodiment like "The Embodied Mind" by Varela, Thomson & Rosch (1991) has been a changing of positions rather than a refutation: Cognitivism has found ways to retreat and regroup at positions that have better fortification, especially when it concerns theses about artificial intelligence or artificial cognitive systems. For example: a) Agent-based cognitivism' that understands humans as taking in representations of the world, doing rule-based processing and then acting on them (sense-plan-act) is often limited to conscious decision processes; and b) Purely syntactic cognition is compatible with embodiment, or supplemented by embodiment (e.g. for 'grounding'). While the empirical thesis of embodied cognition ('embodied cognitive science') is true and the practical engineering thesis ('morphological computation', 'cheap design') is often true, the conceptual thesis ('embodiment is necessary for cognition') is likely false - syntax is often enough for cognition, unless grounding is really necessary. I conclude that it has become more sensible to integrate embodiment with traditional approaches rather than "fight for embodiment" or "against cognitivism".

The nature of vagueness is investigated via a preliminary definition and a discussion of the classical sorites paradox ; this is carried further by asking for the origins of vagueness and a critique of several attempts to remove it from language. It is shown that such attempts are ill motivated and doomed for failure since vagueness is not just a matter of ignorance but firmly grounded in epistemic and metaphysical facts. Finally, the philosophical interest of real vagueness is illustrated by the concept of “natural kind”, which is essential to realism/anti-realism debates.

The theory that all processes in the universe are computational is attractive in its promise to provide an understandable theory of everything. I want to suggest here that this pancomputationalism is not sufficiently clear on which problem it is trying to solve, and how. I propose two interpretations of pancomputationalism as a theory: I) the world is a computer and II) the world can be described as a computer. The first implies a thesis of supervenience of the physical over computation and is thus reduced ad absurdum. The second is underdetermined by the world, and thus equally unsuccessful as theory. Finally, I suggest that pancomputationalism as metaphor can be useful. – At the Paderborn workshop in 2008, this paper was presented as a commentary to the relevant paper by Gordana Dodig-Crnkovic " Info-Computationalism and Philosophical Aspects of Research in Information Sciences".

"Data mining is not an invasion of privacy because access to data is only by machines, not by people": this is the argument that is investigated here. The current importance of this problem is developed in a case study of data mining in the USA for counterterrorism and other surveillance purposes. After a clarification of the relevant nature of privacy, it is argued that access by machines cannot warrant the access to further information, since the analysis will have to be made either by humans or by machines that understand. It concludes that the current data mining violates the right to privacy and should be subject to the standard legal constraints for access to private information by people.