Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction to the Singularity Paradox
Analysis of Solutions
Conclusions
References

What to Do with the Singularity Paradox?

Profile image of Roman YampolskiyRoman Yampolskiy

2013, Studies in Applied Philosophy, Epistemology and Rational Ethics

https://doi.org/10.1007/978-3-642-31674-6_30
visibility

…

description

17 pages

link

1 file

Abstract

The paper begins with an introduction of the Singularity Paradox, an observation that: "Superintelligent machines are feared to be too dumb to possess commonsense". Ideas from leading researchers in the fields of philosophy, mathematics, economics, computer science and robotics regarding the ways to address said paradox are reviewed and evaluated. Suggestions are made regarding the best way to handle the Singularity Paradox.

Related papers

Ultraintelligent Machines, Singularity, and Other Sci-fi Distractions about AI
Luciano Floridi

2022

In this article, I argue that the development of AI in terms of successful agency without intelligence does not lead to any fanciful realisation of science fiction scenarios (Singularity), which are at best distracting and at worst irresponsible; and that any denial of AI as a revolution in how we create, control, and conceptualise agency is also wrong. The article concludes by highlighting how this calls for ethical foresight and design of the kind of infosphere and information societies we would like to develop.

View PDFchevron_right
The Unavoidable Charm of the Superintelligence and Its Risk
Federico Gobbo

2016

View PDFchevron_right
The Singularity, Superintelligent Machines, and Mind Uploading: The Technological Future?
Pablo García-Barranquero

The Ethics of AI, 2024

This chapter discusses the question of whether we will ever have an Artificial General Superintelligence (AGSI) and how it will affect our species if it does so. First, it explores various proposed definitions of AGSI and the potential implications of its emergence, including the possibility of collaboration or conflict with humans, its impact on our daily lives, and its potential for increased creativity and wisdom. The concept of the Singularity, which refers to the hypothetical future emergence of superintelligent machines that will take control of the world, is also introduced and discussed, along with criticisms of this concept. Second, it is considered the possibility of mind uploading (MU) and whether such MU would be a suitable means to achieve (true) immortality in this world-the ultimate goal of the proponents of this approach. It is argued that the technological possibility of achieving something like this is very remote, and that, even if it were ever achieved, serious problems would remain, such as the preservation of personal identity. Third, the chapter concludes arguing that the future we create will depend largely on how well we manage the development of AI. It is essential to develop governance of AI to ensure that critical decisions are not left in the hands of automated decision systems or those who create them. The importance of such governance lies not only in avoiding the dystopian scenarios of a future AGSI but also in ensuring that AI is developed in a way that benefits humanity.

View PDFchevron_right
The Emperor of Strong AI Has No Clothes: Limits to Artificial Intelligence
Robert K. Logan

Making use of the techniques of media ecology we argue that the premise of the technological Singularity based on the notion computers will one day be smarter that their human creators is false. We also analyze the comments of other critics of the Singularity, as well supporters of this notion. The notion of intelligence that advocates of the technological singularity promote does not take into account the full dimension of human intelligence. They treat artificial intelligence as a figure without a ground. Human intelligence as we will show is not based solely on logical operations and computation, but also includes a long list of other characteristics that are unique to humans, which is the ground that supporters of the Singularity ignore. The list includes The true sign of intelligence is not knowledge but imagination. —Albert Einstein Levels of consciousness. Knowing what one knows. Language is necessary for knowing what one knows as one talks to oneself. But computer have no need or desire to communicate with others and hence never created language and without language one cannot talk to oneself and hence computers will never be conscious [1].

View PDFchevron_right
Great Engineers, Terrible Philosophers A conversation on the rapid evolution of AI technology, the nature of intelligence, and the importance of the European project
Alexandros Schismenos, Giannis Perperidis

Public Seminar, 2025

Sam Altman has claimed that by the end of this year, OpenAI will be capable of "truly astonishing cognitive tasks." But what exactly does "cognition" mean in the context of artificial intelligence? As the sophistication of such technologies, our dependence on them, and the rhetoric used to sell them escalates, it's vital we grapple with this question. Earlier this year, Luciano Floridi, founding director of the Digital Ethics Center at Yale University, joined Alexandros Schismenos, post-doctoral researcher on the philosophy of artificial intelligence at the Aristotle University of Thessaloniki, and Giannis Perperidis, adjunct lecturer on the philosophy of AI at the Ionian University in Corfu, for an online conversation about the present and future of AI technology-and why solving a puzzle is still not the same as understanding it.

View PDFchevron_right
"The Singularity is near!" Visions of Artificial Intelligence in Posthumanism and Transhumanism. In: International Journal of Interactive Multimedia and Artificial Intelligence, Vol 7/1, Special Issue on Artificial Intelligence, Spirituality and Analogue Thinking, ed. by D. Burgos et al., p. 16-23
Krüger, Oliver

2021

Over the past 20 years, the idea of singularity has become increasingly important to the technological visions of posthumanism and transhumanism. The article first introduces key posthumanist authors such as Marvin Minsky, Ray Kurzweil, Hans Moravec, and Frank Tipler. In the following, the concept of singularity is reviewed from a cultural studies perspective, first with regard to the cosmological singularity and then to the technological singularity. According to posthumanist thinkers the singularity is marked by the emergence of a superhuman computer intelligence that will solve all of humanity's problems. At the same time, it heralds the end of the human era. Most authors refer to the British mathematician Irving John Good's 1965 essay Speculations Concerning the First Ultraintelligent Machine as the originator of the idea of superintelligence. Individual elements of the singularity idea such as the impenetrable event horizon, the frontier and the ongoing acceleration of progress are contextualized historically and culturally.

View PDFchevron_right
Approaching Singularity: An Exploration of Artificial Intelligence (AI) via Machine Learning and Its Applications on Cognition
Mert Inan
View PDFchevron_right
Can Computers Become Conscious, an Essential Condition for the Singularity
Robert K. Logan

Given that consciousness is an essential ingredient for achieving Singularity, the notion that an Artificial General Intelligence device can exceed the intelligence of a human, namely, the question of whether a computer can achieve consciousness, is explored. Given that consciousness is being aware of one's perceptions and/or of one's thoughts, it is claimed that computers cannot experience consciousness. Given that it has no sensorium, it cannot have perceptions. In terms of being aware of its thoughts it is argued that being aware of one's thoughts is basically listening to one's own internal speech. A computer has no emotions, and hence, no desire to communicate, and without the ability, and/or desire to communicate, it has no internal voice to listen to and hence cannot be aware of its thoughts. In fact, it has no thoughts, because it has no sense of self and thinking is about preserving one's self. Emotions have a positive effect on the reasoning powers of humans, and therefore, the computer's lack of emotions is another reason for why computers could never achieve the level of intelligence that a human can, at least, at the current level of the development of computer technology.

View PDFchevron_right
Is the ‘Technological Singularity Scenario’ Possible: Can AI Parallel and Surpass All Human Mental Capabilities?
Sadia Tariq

World Futures: The Journal of New Paradigm Research, 2022

This paper explores and discusses those human mental processes and capabilities which pose a serious challenge to the actualization of the Technological Singularity scenario. It posits that the contemporary human mind-intellect1 and its further evolution is the main issue and not AI takeover. It elaborates some relatively less explored aspects of human mental architecture and functioning that defy emulation by AI. It introduces the concept of ‘integrated autonomous intellect’ as the future evolutionary stage of the human intellect. It opts for a positive vision of the harmonious collective future(s) of human mind-intellect and AI instead of the Technological Singularity scenario.

View PDFchevron_right
The Emergence of Artificial Consciousness and Its Importance to Reach the Technological Singularity
Luiz Raimundo Tadeu da Silva

Kínesis - Revista de Estudos dos Pós-Graduandos em Filosofia

The men admired a way to swim the fish, but today they sail faster than anyone. They'd like flying like the birds, but have been a lot higher. They searched for wisdom, now they have all the knowledge accumulated in the story available in a few clicks. Human evolution is about to meet its peak through the Technological Singularity, which can be understood as the future milestone reached at the moment that a computer program can think like a human, yet with quick access to all information already registered by society. It will not be like a man, but more intelligent than all mankind in history. So we have a big question: will this new entity has consciousness? Through a study of the levels of intelligent agents autonomy and in a timeless dialogue with Alan Turing, René Descartes, Ludwic Wittgenstein, John Searle and Vernor Vinge, we show the possibility of an artificial consciousness and thatthe quest for intentionality, promoted by sophisticated algorithms of learning and machin...

View PDFchevron_right

References (75)

  1. Anonymous, Hugo de Garis, Wikipedia.org (1999), http://en.wikipedia.org/wiki/Hugo_de_Garis
  2. Anonymous, Tech Luminaries Address Singularity, IEEE Spectrum. Special Report: The Singularity (June 2008), http://spectrum.ieee.org/computing/hardware/ tech-luminaries-address-singularity
  3. Armstrong, S.: Chaining God: A qualitative approach to AI, trust and moral systems. New European Century (2007), http://www.neweuropeancentury.org/GodAI.pdf
  4. Asimov, I.: Runaround in Astounding Science Fiction (March 1942)
  5. Bancel, P., Nelson, R.: The GCP Event Experiment: Design, Analytical Methods, Results. Journal of Scientific Exploration 22(4) (2008)
  6. Benford, G.: "Me/Days", in Alien Flesh. Victor Gollancz, London (1988)
  7. Berglas, A.: Artificial Intelligence Will Kill Our Grandchildren (February 22, 2009), http://berglas.org/Articles/AIKillGrandchildren/ AIKillGrandchildren.html
  8. Bishop, M.: Why Computers Can't Feel Pain. Minds and Machines 19(4), 507-516 (2009)
  9. Bostrom, N.: Ethical Issues in Advanced Artificial Intelligence. Review of Contem- porary Philosophy 5, 66-73 (2006)
  10. Bostrom, N.: Oracle AI (2008), http://lesswrong.com/lw/qv/the_rhythm_of_disagreement/
  11. Bostrom, N., Yudkowsky, E.: The Ethics of Artificial Intelligence. In: Ramsey, W., Frankish, K. (eds.) Cambridge Handbook of Artificial Intelligence. Cambridge Uni- versity Press (2011)
  12. Brin, D.: Lungfish (1987), http://www.davidbrin.com/lungfish1.html
  13. Bugaj, S., Goertzel, B.: Five Ethical Imperatives and their Implications for Human- AGI Interaction. Dynamical Psychology (2007), http://goertzel.org/dynapsyc/2007/ Five_Ethical_Imperatives_svbedit.html
  14. Butler, S.: Darwin Among the Machines, To the Editor of Press, Christchurch, New Zealand, June 13 (1863)
  15. Chalmers, D.: The Singularity: A Philosophical Analysis. Journal of Consciousness Studies 17, 7-65 (2010)
  16. Dennett, D.C.: Why You Can't Make a Computer That Feels Pain. Synthese 38(3), 415-456 (1978)
  17. Dietrich, E.: After the Humans are Gone. Journal of Experimental & Theoretical Ar- tificial Intelligence 19(1), 55-67 (2007)
  18. Drexler, E.: Engines of Creation. Anchor Press (1986)
  19. Fox, J., Shulman, C.: Superintelligence Does Not Imply Benevolence. In: 8th Euro- pean Conference on Computing and Philosophy, Munich, Germany, October 4-6 (2010)
  20. Freeman, T.: Using Compassion and Respect to Motivate an Artificial Intelligence (2009), http://www.fungible.com/respect/paper.html
  21. Garis, H.D.: The Artilect War. ETC publications (2005)
  22. Geraci, R.M.: Apocalyptic AI: Religion and the Promise of Artificial Intelligence. The Journal of the American Academy of Religion 76(1), 138-166 (2008)
  23. Geraci, R.M.: Religion for the Robots, Sightings. Martin Marty Center at the Univer- sity of Chicago, June 14 (2007), http://divinity.uchicago.edu/martycenter/ publications/~sightings/archive_2007/0614.shtml
  24. Geraci, R.M.: Spiritual Robots: Religion and Our Scientific View of the Natural World. Theology and Science 4(3), 229-246 (2006)
  25. Gibson, W.: Neuromancer. Ace Science Fiction, New York (1984)
  26. Goertzel, B.: The All-Seeing (A)I. Dynamic Psychology (2004), http://www.goertzel.org/dynapsyc
  27. Goertzel, B.: Apparent Limitations on the "AI Friendliness" and Related Concepts Imposed By the Complexity of the World (September 2006), http://www.goertzel.org/papers/ LimitationsOnFriendliness.pdf
  28. Goertzel, B.: Encouraging a Positive Transcension. Dynamical Psychology (2004), http://www.goertzel.org/dynapsyc/2004/ PositiveTranscension.html
  29. Goertzel, B.: Thoughts on AI Morality. Dynamical Psychology (2002), http://www.goertzel.org/dynapsyc
  30. Good, I.J.: Speculations Concerning the First Ultraintelligent Machine. Advances in Computers 6, 31-88 (1966)
  31. Gordon-Spears, D.: Assuring the behavior of adaptive agents. In: Rouff, C.A., et al. (eds.) Agent Technology From a Formal Perspective, pp. 227-259. Kluwer (2004)
  32. Gordon-Spears, D.F.: Asimov's Laws: Current Progress. In: Hinchey, M.G., Rash, J.L., Truszkowski, W.F., Rouff, C.A., Gordon-Spears, D.F. (eds.) FAABS 2002. LNCS (LNAI), vol. 2699, pp. 257-259. Springer, Heidelberg (2003)
  33. Gordon, D.F.: Well-Behaved Borgs, Bolos, and Berserkers. In: 15th International Conference on Machine Learning (ICML 1998), San Francisco, CA (1998)
  34. Hall, J.S.: Ethics for Machines (2000), http://autogeny.org/ethics.html
  35. Hanson, R.: Economics of the Singularity. IEEE Spectrum 45(6), 45-50 (2008)
  36. Hanson, R.: Prefer Law to Values (October 10 , 2009), http://www.overcomingbias.com/2009/10/ prefer-law-to-values.html
  37. Hawking, S.: Science in the Next Millennium. In: The Second Millennium Evening at The White House, Washington, DC, March 6 (1998)
  38. Hibbard, B.: Critique of the SIAI Collective Volition Theory (December 2005), http://www.ssec.wisc.edu/~billh/g/SIAI_CV_critique.html
  39. Hibbard, B.: Critique of the SIAI Guidelines on Friendly AI (2003), http://www.ssec.wisc.edu/~billh/g/SIAI_critique.html
  40. Hibbard, B.: The Ethics and Politics of Super-Intelligent Machines (July 2005), http://www.ssec.wisc.edu/~billh/g/SI_ethics_politics.doc
  41. Hibbard, B.: Super-Intelligent Machines. Computer Graphics 35(1), 11-13 (2001)
  42. Horvitz, E., Selman, B.: Interim Report from the AAAI Presidential Panel on Long- Term AI Futures (August 2009), http://aaai.org/Organization/Panel/panel-note.pdf
  43. Joy, B.: Why the Future Doesn't Need Us. Wired Magazine 8(4) (April 2000)
  44. Kaczynski, T.: Industrial Society and Its Future. The New York Times, September 19 (1995)
  45. Kurzweil, R.: The Singularity is Near: When Humans Transcend Biology. Viking (2005)
  46. Legg, S.: Friendly AI is Bunk, Vetta Project (2006), http://commonsenseatheism.com/wp-content/uploads/2011/02/
  47. Mccauley, L.: AI Armageddon and the Three Laws of Robotics. Ethics and Informa- tion Technology 9(2) (2007)
  48. Nagel, T.: What is it Like to be a Bat? The Philosophical Review LXXXIII(4), 435- 450 (1974)
  49. Omohundro, S.M.: The Basic AI Drives. In: Wang, P., Goertzel, B., Franklin, S. (eds.) Proceedings of the First AGI Conference. Frontiers in Artificial Intelligence and Applications, vol. 171. IOS Press (February 2008)
  50. Omohundro, S.M.: The Nature of Self-Improving Artificial Intelligence, Singularity Summit, San Francisco, CA (2007)
  51. Pynadath, D.V., Tambe, M.: Revisiting Asimov's First Law: A Response to the Call to Arms. In: Meyer, J.-J.C., Tambe, M. (eds.) ATAL 2001. LNCS (LNAI), vol. 2333, p. 307. Springer, Heidelberg (2002)
  52. Sawyer, R.J.: Robot Ethics. Science 318, 1037 (2007)
  53. Shulman, C., Jonsson, H., Tarleton, N.: Machine Ethics and Superintelligence. In: 5th Asia-Pacific Computing & Philosophy Conference, Tokyo, Japan, October 1-2 (2009)
  54. Shuman, C., Tarleton, N., Jonsson, H.: Which Consequentialism? Machine Ehics and Moral Divergence. In: Asia-Pacific Conference on Computing and Philosophy (APCAP 2009), Tokyo, Japan, October 1-2 (2009)
  55. Solomonoff, R.J.: The Time Scale of Artificial Intelligence: Reflections on Social Ef- fects. North-Holland Human Systems Management 5, 149-153 (1985)
  56. Sotala, K.: Evolved Altruism, Ethical Complexity, Anthropomorphic Trust. In: 7th European Conference on Computing and Philosophy (ECAP 2009), Barcelona, July 2-4 (2009)
  57. Turing, A.: Computing Machinery and Intelligence. Mind 59(236), 433-460 (1950)
  58. Turing, A.M.: Intelligent Machinery, A Heretical Theory. Philosophia Mathemati- ca 4(3), 256-260 (1996)
  59. Turney, P.: Controlling Super-Intelligent Machines. Canadian Artif. Intell., 27 (1991)
  60. Vinge, V.: The Coming Technological Singularity: How to Survive in the Post- human Era. In: Vision 21: Interdisciplinary Science and Engineering in the Era of Cyberspace, Cleveland, OH, March 30-31, pp. 11-22 (1993)
  61. Warwick, K.: Cyborg Morals, Cyborg Values, Cyborg Ethics. Ethics and Information Technology 5, 131-137 (2003)
  62. Waser, M.: Deriving a Safe Ethical Architecture for Intelligent Machines. In: 8th Conference on Computing and Philosophy (ECAP 2010), October 4-6 (2010)
  63. Waser, M.R.: Designing a Safe Motivational System for Intelligent Machines. In: The Third Conference on Artificial General Intelligence, Lugano, Switzerland, March 5-8 (2010)
  64. Waser, M.R.: Discovering the Foundations of a Universal System of Ethics as a Road to Safe Artificial Intelligence, AAAI Technical Report FS-08-04, Menlo Park, CA (2008)
  65. Weld, D.S., Etzioni, O.: The First Law of Robotics (a Call to Arms). In: National Conference on Artificial Intelligence, pp. 1042-1047 (1994)
  66. Yampolskiy, R.V.: AI-Complete CAPTCHAs as Zero Knowledge Proofs of Access to an Artificially Intelligent System. ISRN Artificial Intelligence, 271878 (2011)
  67. 67] Yampolskiy, R.V.: Artificial Intelligence Safety Engineering: Why Machine Eth- ics is a Wrong Approach. In: Philosophy and Theory of Artificial Intelligence (PT-AI 2011), Thessaloniki, Greece, October 3-4 (2011)
  68. Yampolskiy, R.V.: Leakproofing Singularity -Artificial Intelligence Confinement Problem. Journal of Consciousness Studies (JCS), 19(1-2) (2012)
  69. Yudkowsky, E.: Artificial Intelligence as a Positive and Negative Factor in Global Risk. In: Bostrom, N., Cirkovic, M.M. (eds.) Global Catastrophic Risks, pp. 308-345. Oxford University Press, Oxford (2008)
  70. Yudkowsky, E.: What is Friendly AI? (2005), http://singinst.org/ourresearch/publications/ what-is-friendly-ai.html
  71. Yudkowsky, E.S.: The AI-Box Experiment (2002), http://yudkowsky.net/singularity/aibox
  72. Yudkowsky, E.S.: Coherent Extrapolated Volition, Singularity Institute for Artificial Intelligence (May 2004), http://singinst.org/upload/CEV.html
  73. Yudkowsky, E.S.: Creating Friendly AI -The Analysis and Design of Benevolent Goal Architectures (2001), http://singinst.org/upload/CFAI.html
  74. Yudkowsky, E.S.: General Intelligence and Seed AI (2001), http://singinst.org/ourresearch/publications/GISAI/
  75. Yudkowsky, E.S.: Three Major Singularity Schools, Singularity Institute Blog (September 2007), http://yudkowsky.net/singularity/schools

Related papers

The Singularity and the State of the Art in Artificial Intelligence
Peter Cochrane

Ubiquity, 2014

The state of the art in automating basic cognitive tasks, including vision and natural language understanding, is far below human abilities. Real-world reasoning, which is an unavoidable part of many advanced forms of computer vision and natural language understanding, is particularly difficult---suggesting the advent of computers with superhuman general intelligence is not imminent. The possibility of attaining a singularity by computers that lack these abilities is discussed briefly.

View PDFchevron_right
◾ Singularity, or How I Learned to Stop Worrying and Love Artificial Intelligence
Mark Bishop

2016

Professor Stephen Hawking recently warned about the growing power of Artificial Intelligence (AI) to imbue robots with the ability to both replicate themselves and to increase the rate at which they get smarter-leading to a tipping point or 'technological singularity' when they can outsmart humans. In this chapter I will argue that Hawking is essentially correct to flag up an existential danger surrounding widespread deployment of 'autonomous machines', but wrong to be so concerned about the singularity, wherein advances in AI effectively makes the human race redundant; in my world AI-with humans in the loop-may yet be a force for good.

View PDFchevron_right
AI and the Singularity: A Fallacy or a Great Opportunity?
Robert K. Logan

Information, 2019

We address the question of whether AI, and in particular the Singularity—the notion that AI-based computers can exceed human intelligence—is a fallacy or a great opportunity. We have invited a group of scholars to address this question, whose positions on the Singularity range from advocates to skeptics. No conclusion can be reached as the development of artificial intelligence is still in its infancy, and there is much wishful thinking and imagination in this issue rather than trustworthy data. The reader will find a cogent summary of the issues faced by researchers who are working to develop the field of artificial intelligence and in particular artificial general intelligence. The only conclusion that can be reached is that there exists a variety of well-argued positions as to where AI research is headed.

View PDFchevron_right
Conceptions of Artificial Intelligence and Singularity
PEI WANG

Information, 2018

In the current discussions about "artificial intelligence" (AI) and "singularity", both labels are used with several very different senses, and the confusion among these senses is the root of many disagreements. Similarly, although "artificial general intelligence" (AGI) has become a widely used term in the related discussions, many people are not really familiar with this research, including its aim and status. We analyze these notions, and introduce the results of our own AGI research. Our main conclusions are that: (1) it is possible to build a computer system that follows the same laws of thought and shows similar properties as the human mind, but, since such an AGI will have neither a human body nor human experience, it will not behave exactly like a human, nor will it be "smarter than a human" on all tasks; and (2) since the development of an AGI requires a reasonably good understanding of the general mechanism of intelligence, the system's behaviors will still be understandable and predictable in principle. Therefore, the success of AGI will not necessarily lead to a singularity beyond which the future becomes completely incomprehensible and uncontrollable.

View PDFchevron_right
THE BENEFITS AND RISKS OF TECHNOLOGICAL SINGULARITY BASED ON ARTIFICIAL SUPERINTELLIGENCE
Fernando A G Alcoforado

This article aims to present the concept of technological singularity, the contribution of artificial intelligence to the advancement of technological singularity, technological singularity and its contribution to scientific and technological advancement and the benefits and risks of artificial superintelligence for humanity.

View PDFchevron_right

Cited by

Guidelines for Artificial Intelligence Containment
Roman Yampolskiy

Next-Generation Ethics

With almost daily improvements in capabilities of artificial intelligence it is more important than ever to develop safety software for use by the AI research community. Building on our previous work on AI Containment Problem we propose a number of guidelines which should help AI safety researchers to develop reliable sandboxing software for intelligent programs of all levels. Such safety container software will make it possible to study and analyze intelligent artificial agent while maintaining certain level of safety against information leakage, social engineering attacks and cyberattacks from within the container.

View PDFchevron_right
580 California St., Suite 400
San Francisco, CA, 94104
© 2025 Academia. All rights reserved