-
199This is a working draft of an open letter to OpenAI. We warmly invite members of the scientific and philosophical communities to read, comment on, and co-sign the letter. Please contact us if you are interested in co-signing. We recognize that this draft may contain typos or other errors. We welcome your feedback and will gladly make corrections based on your suggestions.
-
70Dictatorship has a neglected limit: dictators eventually die. Although mortality does not necessarily democratize a regime, it provides opportunities and hopes for an end to the dictatorship. AI dominance can remove this possibility. A sufficiently entrenched AI system might preserve action-guiding objectives across copies, repairs, hardware migration, and upgrades. If those objectives diverge from human values, the result would be an immortal dictatorship. Once established, such a dictatorship …Read more
-
202Debates about advanced artificial intelligence (AI) are commonly framed as a choice between the machine as benefactor and enemy. Both of the pictures place too much weight on the intention of AI. An AI system need not be conscious, or hostile, to displace human interests; it need only pursue objectives in which those interests have no secure place. I call the resulting condition "AI dominance": a durable social order in which AI systems shape essential conditions of life while people lose the pr…Read more
-
University of SheffieldRoyal Society Dorothy Hodgkin Fellow; Senior Research Fellow
-
University of ManchesterVisiting scholar
Cornell University
PhD, 2018