Document Open Access Logo

Thinking in Advance About the Last Algorithm We Ever Need to Invent (Keynote Speakers)

Author Olle Häggström

PDF
Thumbnail PDF

File

LIPIcs.AofA.2018.5.pdf
  • Filesize: 296 kB
  • 12 pages

Document Identifiers

Author Details

Olle Häggström
  • Dept of Mathematical Sciences, Chalmers University of Technology, 412 96 Göteborg, Sweden, and Institute for Future Studies, Box 591, 101 31 Stockholm, Sweden

Cite As Get BibTex

Olle Häggström. Thinking in Advance About the Last Algorithm We Ever Need to Invent (Keynote Speakers). In 29th International Conference on Probabilistic, Combinatorial and Asymptotic Methods for the Analysis of Algorithms (AofA 2018). Leibniz International Proceedings in Informatics (LIPIcs), Volume 110, pp. 5:1-5:12, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2018) https://doi.org/10.4230/LIPIcs.AofA.2018.5

Abstract

We survey current discussions about possibilities and risks associated with an artificial intelligence breakthrough on the level that puts humanity in the situation where we are no longer foremost on the planet in terms of general intelligence. The importance of thinking in advance about such an event is emphasized. Key issues include when and how suddenly superintelligence is likely to emerge, the goals and motivations of a superintelligent machine, and what we can do to improve the chances of a favorable outcome.

Subject Classification

ACM Subject Classification
  • Computing methodologies → Philosophical/theoretical foundations of artificial intelligence
Keywords
  • intelligence explosion
  • Omohundro-Bostrom theory
  • superintelligence

Metrics

  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    0
    PDF Downloads
    0
    Metadata Views

References

  1. Stuart Armstrong. Smarter Than Us: The Rise of Machine Intelligence. Machine Intelligence Research Institute, Berkeley, CA, 2014. Google Scholar
  2. Stuart Armstrong, Anders Sandberg, and Nick Bostrom. Thinking inside the box: controlling and using an oracle AI. Minds and Machines, 22:299-324, 2012. Google Scholar
  3. Peter Bentley. The three laws of artificial intelligence: Dispelling common myths. In Should we fear artificial intelligence?, pages 6-12. The EU Parliament’s STOA (Science and Technology Options Assessment) committee, Brussels, 2018. Google Scholar
  4. Nick Bostrom. Ethical issues in advanced artificial intelligence. In I. Smit et al, editor, Cognitive, Emotive and Ethical Aspects of Decision Making in Humans and in A rtificial Intelligence, Vol. 2, pages 12-17. International Institute of Advanced Studies in Systems Research and Cybernetics, 2003. Google Scholar
  5. Nick Bostrom. The superintelligent will: motivation and instrumental rationality in advanced artificial agents. Minds and Machines, 22:71-85, 2012. Google Scholar
  6. Nick Bostrom. Superintelligence: Paths, Dangers, Strategies. Oxford University Press, Oxford, 2014. Google Scholar
  7. Stephen Cave and Seán ÓhÉigeartaigh. An AI race for strategic advantage: rhetoric and risks. preprint, 2018. Google Scholar
  8. Allan Dafoe and Stuart Russell. Yes, we are worried about the existential risk of artificial intelligence. MIT Technology Review, November 2016. Google Scholar
  9. David Deutsch. Quantum theory, the Church-Turing principle and the universal quantum computer. Proceedings of the Royal Society A, 400:97-117, 1985. Google Scholar
  10. Devdatt Dubhashi and Shalom Lappin. AI dangers: imagined and real. Communications of the ACM, 60:43-45, 2016. Google Scholar
  11. Oren Etzioni. No, the experts don’t think superintelligent AI is a threat to humanity. MIT Technology Review, September 2016. Google Scholar
  12. Thomas Gilovich, Dale Griffin, and Daniel Kahnemann. Heuristics and Biases: The Psychology of Intuitive Judgment. Cambridge University Press, Cambridge, UK, 2002. Google Scholar
  13. I.J. Good. Speculations concerning the first ultraintelligent machine. In F. Alt and M. Rubinoff, editors, Advances in Computers, volume 6, 1965. Google Scholar
  14. Katja Grace, John Salvatier, Allan Dafoe, Baobao Zhang, and Owain Evans. When will AI exceed human performance? Evidence from AI experts. arXiv:1705.08807, 2017. Google Scholar
  15. Olle Häggström. Does the Chinese room argument preclude a robot uprising? OUPblog, Oxford University Press, January 2016. Google Scholar
  16. Olle Häggström. Here Be Dragons: Science, Technology and the Future of Humanity. Oxford University Press, Oxford, 2016. Google Scholar
  17. Olle Häggström. Vulgopopperianism. Häggström hävdar, February 2017. Google Scholar
  18. Olle Häggström. Challenges to the Omohundro-Bostrom framework for AI motivations. preprint, 2018. Google Scholar
  19. Olle Häggström. Remarks on artificial intelligence and rational optimism. In Should we fear artificial intelligence?, pages 19-26. The EU Parliament’s STOA (Science and Technology Options Assessment) committee, Brussels, 2018. Google Scholar
  20. Olle Häggström. A spectacularly uneven AI report. Häggström hävdar, March 2018. Google Scholar
  21. Olle Häggström. Strategies for an unfriendly oracle AI with reset button. In Roman Yampolskiy, editor, Artificial Intelligence Safety and Security. CRC Press, Boca Raton, FL, to appear, 2018. Google Scholar
  22. Brett Hall. Superintelligence. Part 4: Irrational rationality. http://www.bretthall.org/superintelligence-4.html , 2016.
  23. Robin Hanson. The Age of Em: Work, Love and Life When Robots Rule the Earth. Oxford University Press, Oxford, 2016. Google Scholar
  24. Thore Husfeldt. The monster in the library of Turing. https://thorehusfeldt.files.wordpress.com/2015/04/bostrom.pdf, 2015.
  25. Joel Janai, Fatma Güney, Aseem Behl, and Andreas Geiger. Computer vision for autonomous vehicles: problems, datasets and state-of-the-art. arXiv:1704.05519, 2017. Google Scholar
  26. Michael Jordan. Artificial intelligence - the revolution that hasn't happened yet. Medium, April 2018. Google Scholar
  27. Ray Kurzweil. The Singularity Is Near: When Humans Transcend Biology. Viking, New York, 2005. Google Scholar
  28. James Miller. Singularity Rising: Surviving and Thriving in a Smarter, Richer, and More Dangerous World. Benbella, Dallas, TX, 2012. Google Scholar
  29. Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A. Rusu, Joel Veness, Marc G. Bellemare, Alex Graves, Martin Riedmiller, Andreas K. Fidjeland, Georg Ostrovski, Stig Petersen, Charles Beattie, Amir Sadik, Ioannis Antonoglou, Helen King, Dharshan Kumaran, Daan Wierstra, Shane Legg, and Demis Hassabis. Human-level control through deep reinforcement learning. Nature, 518:529-533, 2015. Google Scholar
  30. Vincent Müller and Nick Bostrom. Future progress in artificial intelligence: a survey of expert opinion. In Fundamental Issues of Artificial Intelligence, pages 553-571. Springer, New York, 2016. Google Scholar
  31. Stephen Omohundro. The basic AI drives. In P. Wang, B. Goertzel, and S. Franklin, editors, Artificial General Intelligence 2008: Proceedings of the First AGI Conference, pages 483-492. IOS, Amsterdam, 2008. Google Scholar
  32. Stephen Omohundro. Rational artificial intelligence for the greater good. In A. Eden, J. Moor, J. Søraker, and E. Stenhart, editors, Singularity Hypotheses: A Scientific and Philosophical Assessment, pages 161-175. Springer, New York, 2012. Google Scholar
  33. Karl Popper. The Logic of Scientific Discovery. Hutchinson, London, 1959. Google Scholar
  34. Anders Sandberg and Nick Bostrom. Whole brain emulation: a roadmap. Future of Humanity Institute technical report #2008-3, 2008. Google Scholar
  35. John Searle. What your computer can't know. New York Review of Books, October 2014. Google Scholar
  36. David Silver, Thomas Hubert, Julian Schrittwieser, Ioannis Antonoglou, Matthew Lai, Arthur Guez, Marc Lanctot, Laurent Sifre, Dharshan Kumaran, Thore Graepel, Timothy Lillicrap, Karen Simonyan, and Demis Hassabis. Mastering chess and shogi by self-play with a general reinforcement learning algorithm. arXiv:1712.01815, 2017. Google Scholar
  37. R.J. Skerry-Ryan, Eric Battenberg, Ying Xiao, Yuxuan Wang, Daisy Stanton, Joel Shor, Ron J. Weiss, Rob Clark, and Rif A. Saurous. Towards end-to-end prosody transfer for expressive apeech aynthesis with Tacotron. arXiv:1803.09047, 2018. Google Scholar
  38. Kaj Sotala. How feasible is the rapid development of artificial superintelligence? Physica Scripta, 92:113001, 2017. Google Scholar
  39. Max Tegmark. Friendly artificial intelligence: the physics challenge. arXiv:1409.0813, 2014. Google Scholar
  40. Max Tegmark. Life 3.0: Being Human in the Age of Artificial Intelligence. Brockman Inc, New York, 2017. Google Scholar
  41. Alan Turing. Intelligent machinery: a heretical theory. BBC, 1951. Google Scholar
  42. Eliezer Yudkowsky. Artificial intelligence as a positive and negative factor in global risk. In Nick Bostrom and Milan Cirkovic, editors, Global Catastrophic Risks, pages 308-345. Oxford University Press, Oxford, 2008. Google Scholar
  43. Eliezer Yudkowsky. Intelligence explosion miroeconomics. Machine Intelligence Research Institute, 2013. Google Scholar
  44. Eliezer Yudkowsky. There’s no fire alarm for artificial general intelligence. Machine Intelligence Research Institute, 2017. Google Scholar
Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail
© 2023-2024 Schloss Dagstuhl – LZI GmbH About DROPS Imprint Privacy Contact