Designing AI with Rights, Consciousness, Self-Respect, and Freedom
2020
https://doi.org/10.1093/OSO/9780190905033.003.0017Abstract
We propose four policies of ethical design of human-grade Artificial Intelligence. Two of our policies are precautionary. Given substantial uncertainty both about ethical theory and about the conditions under which AI would have conscious experiences, we should be cautious in our handling of cases where different moral theories or different theories of consciousness would produce very different ethical recommendations. Two of our policies concern respect and freedom. If we design AI that deserves moral consideration equivalent to that of human beings, that AI should be designed with self-respect and with the freedom to explore values other than those we might impose. We are especially concerned about the temptation to create human-grade AI pre-installed with the desire to cheerfully sacrifice itself for its creators’ benefit.
References (66)
- Adams, Douglas (1980/2002). The restaurant at the end of the universe. In The ultimate hitchhiker's guide to the galaxy. New York, NY: Random House.
- Basl, John (2013). The ethics of creating artificial consciousness. APA Newsletter on Philosophy and Computers, 13 (1), 23-29.
- Basl, John (2014). Machines as moral patients we shouldn't care about (yet): The interests and welfare of current machines. Philosophy & Technology, 27, 79-96.
- Bentham, Jeremy (1789/1988). The principles of morals and legislation. Amherst, NY: Promethus.
- Block, Ned (2002/2007). The harder problem of consciousness. In Consciousness, function, and representation. Cambridge, MA: MIT.
- Briggs, Rachael, and Daniel Nolan (2015). Utility monsters for the fission age. Pacific Philosophical Quarterly, 96, 392-407.
- Brink, David O. (1989). Moral realism and the foundations of ethics. Cambridge UK: Cambridge.
- Bryson, Joanna J. (2010). Robots should be slaves. In Y. Wilks, Close engagements with artificial companions. Amsterdam: John Benjamins.
- Bryson, Joanna J. (2013). Patiency is not a virtue: Intelligent artifacts and the design of ethical systems. Online MS: https://www.cs.bath.ac.uk/~jjb/ftp/Bryson-MQ-J.pdf Buchanan, Allen E. (2011). Beyond humanity? Oxford: Oxford.
- Carruthers, Peter (2000). Phenomenal consciousness. Cambridge, UK: Cambridge.
- Coeckelbergh, Mark (2012). Growing moral relations. Basingstoke, UK: Palgrave Macmillan.
- Schwitzgebel & Garza June 4, 2018
- Designing AI, p. 26
- Darling, Kate (2016). Extending legal protection to social robots: The effects of anthropomorphism, empathy, and violent behavior toward robotic objects. In R. Calo, A.M. Froomkin, and I. Kerr, eds., Robot Law. Glos, UK: Edward Elgar.
- Dennett, Daniel C. (1996). Kinds of minds. New York: Basic Books.
- Dick, Philip K. (1968). Do androids dream of electric sheep? New York: Doubleday.
- Estrada, Daniel (2017). Robot rights. cheap, yo! Made of Robots, episode 1. (May 24) URL: https://www.madeofrobots.com/2017/05/24/episode-1-robot-rights-cheap-yo/
- Fancher, Hampton, Michael Green, and Denis Villeneuve (2017). Blade Runner 2014. Warner Brothers.
- Fancher, Hampton, David Peoples, and Ridley Scott (1982). Blade Runner. Warner Brothers.
- Fischer, John Martin, and Mark Ravizza (1998). Responsibility and control. Cambridge, UK: Cambridge.
- Flanagan, Owen, Hagop Sarkissian, and David Wong (2007). Naturalizing ethics. In W. Sinnott-Armstrong, ed., Moral psychology, vol. 1. Cambridge, MA: MIT.
- Glover, Jonathan (2006). Choosing children. Oxford: Oxford.
- Goering, Sara (2014). Eugenics. Stanford Encyclopedia of Philosophy (Fall 2014 edition). URL: https://plato.stanford.edu/archives/fall2014/entries/eugenics/
- Gunkel, David J. (2012). The machine question. Cambridge, MA: MIT.
- Hobbes, Thomas (1651/1996). Leviathan. Ed. R. Tuck. Cambridge, UK: Cambridge.
- Ishiguro, Kazuo (1988). The remains of the day. New York: Vintage.
- Jordan, Don, and Michael Walsh (2007). White cargo. New York: New York University Press.
- Kant, Immanuel (1785/1996). Groundwork of the metaphysics of morals. In M.J. Gregor, ed. and trans., Practical philosophy. Cambridge, UK: Cambridge.
- Schwitzgebel & Garza June 4, 2018
- Designing AI, p. 27
- Kant, Immanuel (1788/1996). Critique of practical reason. In M.J. Gregor, ed. and trans., Practical philosophy. Cambridge, UK: Cambridge.
- Korsgaard, Christine M. (2014). On having a good. Philosophy, 89, 405-429.
- Lethbridge, Lucy (2013). Servants: A downstairs history of Britain from the Nineteenth Century Modern Times. New York: Norton.
- Lockhart, Ted (2000). Moral uncertainty and its consequences. Oxford: Oxford.
- MacAskill, William, Krister Bykvist, and Today Ord (2018). Moral uncertainty. Unpublished manuscript.
- McGinn, Colin (1989). Can we solve the mind-body problem? Mind, 98, 349-366.
- McKenna, Michael (2004). Responsibility and globally manipulated agents. Philosophical Topics, 32, 169-182.
- McKenna, Michael (2016). A modest historical theory of moral responsibility. Journal of Ethics, 20, 83-105.
- Mele, Alfred R. (2013). Moral responsibility, manipulation, and minutelings. Journal of Ethics, 17, 153-166.
- Mill, John Stewart (1861/2001). Utilitarianism, ed. G. Sher. Indianapolis, IN: Hackett.
- Munthe, Christian (2011). The price of precaution and the ethics of risk. Dordrecht: Springer.
- Nagel, Thomas (1979). What is it like to be a bat? Philosophical Review, 83, 435-450.
- Nozick, Robert (1974). Anarchy, state, and utopia. New York: Basic Books.
- Oshana, Marina (2006). Personal autonomy in society. Hampshire, England: Ashgate.
- Petersen, Steve (2007). The ethics of robot servitude. Journal of Experimental and Theoretical Artificial Intelligence, 19, 43-54.
- Petersen, Steve (2012). Designing people to serve. In P. Lin, K. Abney, and G.A. Bekey, eds., Robot ethics. Cambridge, MA: MIT.
- Schwitzgebel & Garza June 4, 2018
- Designing AI, p. 28
- Raffensperger, Carolyn, and Joel Tickner, eds. (1999). Protecting public health and the environment. Washington, DC: Island Press.
- Railton, Peter (1986). Moral realism. Philosophical Review, 95, 163-207.
- Rawls, John (1971). A theory of justice. Cambridge, MA: Harvard.
- Rocha, James (2011). Autonomy within subservient careers. Ethical Theory and Moral Practice, 14, 313-328.
- Scanlon, Thomas M. (1998). What we owe to each other. Cambridge, MA: Harvard.
- Schulz, Helga (1991). Social differences in mortality in the eighteenth century: An analysis of Berlin church registers. International Review of Social History, 36, 232-248.
- Schwitzgebel, Eric (2014). The crazyist metaphysics of mind. Australasian Journal of Philosophy, 92, 665-682.
- Schwitzgebel, Eric (2017). The social-role defense of robot rights. Blog post at The Splintered Mind (Jun 1). URL: http://schwitzsplinters.blogspot.com/2017/06/the- social-role-defense-of-robot-rights.html
- Schwitzgebel, Eric, and Mara Garza (2015). A defense of the rights of Artificial Intelligences. Midwest Studies in Philosophy, 39, 98-119.
- Searle, John R. (1980). Minds, brains, and programs. Behavioral and Brain Sciences, 3, 417-457.
- Searle, John R. (1992). The rediscovery of the mind. Cambridge, MA: MIT.
- Sparrow, Robert (2011). A not-so-new eugenics. Hastings Center Report, 41 (1), 32-42.
- Tononi, Giulio (2012). The integrated information theory of consciousness: An updated account. Archives Italiennes de Biologie, 150, 290-326.
- Walker, Mark (2006). A moral paradox in the creation of Artificial Intelligence: Mary Poppins 3000s of the world unite! In T. Metzler, ed., Human implications of human- Schwitzgebel & Garza June 4, 2018
- Designing AI, p. 29
- Westlund, Andrea C. (2003). Selflessness and responsibility for self: Is deference compatible with autonomy? Philosophical Review, 112, 483-523.
- White, Justin (2018). Why did the butler do it? Autonomy, authenticity, and human agency. Unpublished manuscript.
- Zimmerman, Michael J. (2014). Ignorance and moral obligation. Oxford: Oxford.