Document Open Access Logo

Automating Moral Reasoning (Invited Paper)

Author Marija Slavkovik

PDF
Thumbnail PDF

File

OASIcs.AIB.2022.6.pdf
  • Filesize: 0.5 MB
  • 13 pages

Document Identifiers

Author Details

Marija Slavkovik
  • University of Bergen, Norway

Cite AsGet BibTex

Marija Slavkovik. Automating Moral Reasoning (Invited Paper). In International Research School in Artificial Intelligence in Bergen (AIB 2022). Open Access Series in Informatics (OASIcs), Volume 99, pp. 6:1-6:13, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2022)
https://doi.org/10.4230/OASIcs.AIB.2022.6

Abstract

Artificial Intelligence ethics is concerned with ensuring a nonnegative ethical impact of researching, developing, deploying and using AI systems. One way to accomplish that is to enable those AI systems to make moral decisions in ethically sensitive situations, i.e., automate moral reasoning. Machine ethics is an interdisciplinary research area that is concerned with the problem of automating moral reasoning. This tutorial presents the problem of making moral decisions and gives a general overview of how a computational agent can be constructed to make moral decisions. The tutorial is aimed for students in artificial intelligence who are interested in acquiring a starting understanding of the basic concepts and a gateway to the literature in machine ethics.

Subject Classification

ACM Subject Classification
  • Computing methodologies → Philosophical/theoretical foundations of artificial intelligence
Keywords
  • Machine ethics
  • artificial morality
  • artificial moral agents

Metrics

  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    0
    PDF Downloads
    0
    Metadata Views

References

  1. David Abel, James MacGlashan, and Michael L Littman. Reinforcement learning as a framework for ethical decision making. In Workshops at the thirtieth AAAI conference on artificial intelligence, 2016. Google Scholar
  2. Larry Alexander and Michael Moore. Deontological Ethics. In Edward N. Zalta, editor, The Stanford Encyclopedia of Philosophy. Metaphysics Research Lab, Stanford University, Winter 2021 edition, 2021. Google Scholar
  3. Colin Allen, Gary Varner, and Jason Zinser. Prolegomena to any future artificial moral agent. Journal of Experimental & Theoretical Artificial Intelligence, 12(3):251-261, 2000. URL: https://doi.org/10.1080/09528130050111428.
  4. Michael Anderson and Susan Leigh Anderson. Machine ethics: Creating an ethical intelligent agent. AI magazine, 28(4), 2007. Google Scholar
  5. Michael Anderson and Susan Leigh Anderson. The status of machine ethics: A report from the aaai symposium. Minds Mach., 17(1):1-10, March 2007. URL: https://doi.org/10.1007/s11023-007-9053-7.
  6. Michael Anderson and Susan Leigh Anderson, editors. Machine Ethics. Cambridge University Press, 2011. Google Scholar
  7. Michael Anderson and Susan Leigh Anderson. Geneth: A general ethical dilemma analyzer. In Carla E. Brodley and Peter Stone, editors, Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence, July 27 -31, 2014, Québec City, Québec, Canada, pages 253-261. AAAI Press, 2014. URL: http://www.aaai.org/ocs/index.php/AAAI/AAAI14/paper/view/8308.
  8. Susan Leigh Anderson. Asimov’s "three laws of robotics" and machine metaethics. AI Soc., 22(4):477-493, 2008. URL: https://doi.org/10.1007/s00146-007-0094-5.
  9. Stuart Armstrong. Motivated value selection for artificial agents. In Workshops at the Twenty-Ninth AAAI Conference on Artificial Intelligence, 2015. Google Scholar
  10. Thomas Arnold and Matthias Scheutz. Against the moral turing test: Accountable design and the moral reasoning of autonomous systems. Ethics and Inf. Technol., 18(2):103-115, June 2016. URL: https://doi.org/10.1007/s10676-016-9389-x.
  11. Seth D. Baum. Social choice ethics in artificial intelligence. AI Soc., 35(1):165-176, 2020. URL: https://doi.org/10.1007/s00146-017-0760-1.
  12. Tom L. Beauchamp and James F. Childress. Principles of Biomedical Ethics. Oxford University Press, USA, 2001. Google Scholar
  13. Richard E. Bellman. An Introduction to Artificial Intelligence: Can Computers Think? Boyd & Fraser Publishing Company, 1978. Google Scholar
  14. Oliver Bendel, Kevin Schwegler, and Bradley Richards. Towards kant machines. In 2017 AAAI Spring Symposia, Stanford University, Palo Alto, California, USA, March 27-29, 2017. AAAI Press, 2017. URL: http://aaai.org/ocs/index.php/SSS/SSS17/paper/view/15278.
  15. Yoshua Bengio, Yann Lecun, and Geoffrey Hinton. Deep learning for AI. Communications of the ACM, 64(7):58-65, June 2021. URL: https://doi.org/10.1145/3448250.
  16. Bartosz Brożek and Bartosz Janik. Can artificial intelligences be moral agents? New Ideas in Psychology, 54:101-106, 2019. URL: https://doi.org/10.1016/j.newideapsych.2018.12.002.
  17. Alexandra Chouldechova and Aaron Roth. A snapshot of the frontiers of fairness in machine learning. Commun. ACM, 63(5):82-89, 2020. URL: https://doi.org/10.1145/3376898.
  18. Louise A. Dennis, Martin Mose Bentzen, Felix Lindner, and Michael Fisher. Verifiable machine ethics in changing contexts. In Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Conference on Innovative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Advances in Artificial Intelligence, EAAI 2021, Virtual Event, February 2-9, 2021, pages 11470-11478. AAAI Press, 2021. URL: https://ojs.aaai.org/index.php/AAAI/article/view/17366.
  19. Louise A. Dennis, Michael Fisher, Marija Slavkovik, and Matt Webster. Formal verification of ethical choices in autonomous systems. Robotics Auton. Syst., 77:1-14, 2016. URL: https://doi.org/10.1016/j.robot.2015.11.012.
  20. Nicholas Diakopoulos. Transparency. In Markus D. Dubber, Frank Pasquale, and Sunit Das, editors, The Oxford Handbook of Ethics of AI. Oxford University Press, July 2020. URL: https://doi.org/10.1093/oxfordhb/9780190067397.013.11.
  21. Franz Dietrich and Christian List. What matters and how it matters: a choice-theoretic representation of moral theories. Philosophical Review, 126(4):421-479, 2017. Google Scholar
  22. Virginia Dignum. Responsible Artificial Intelligence - How to Develop and Use AI in a Responsible Way. Artificial Intelligence: Foundations, Theory, and Algorithms. Springer, 2019. URL: https://doi.org/10.1007/978-3-030-30371-6.
  23. Sjur Dyrkolbotn, Truls Pedersen, and Marija Slavkovik. On the distinction between implicit and explicit ethical agency. In Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society, AIES '18, pages 74-80, New York, NY, USA, 2018. Association for Computing Machinery. URL: https://doi.org/10.1145/3278721.3278769.
  24. Amitai Etzioni and Oren Etzioni. Incorporating ethics into artificial intelligence. The Journal of Ethics, 21:403-418, 2017. Google Scholar
  25. James Fieser. Ethics. In Michael Boylan, editor, Internet Encyclopedia of Philosophy. ISSN 2161-0002, 2021. Google Scholar
  26. Dov Gabbay, John Horty, and Xavier Parent. Handbook of Deontic Logic and Normative System. College Publications, UK, 2013. Google Scholar
  27. James Gips. Toward the ethical robot. In Kenneth M. Ford, C. Glymour, and Patrick Hayes, editors, Android Epistemology, pages 243-252. MIT Press, USA, 1994. Google Scholar
  28. David Gunning and David Aha. Darpa’s explainable artificial intelligence (XAI) program. AI Magazine, 40(2):44-58, June 2019. URL: https://doi.org/10.1609/aimag.v40i2.2850.
  29. R. M. Hare. Community and Communication, pages 109-115. Macmillan Education UK, London, 1972. URL: https://doi.org/10.1007/978-1-349-00955-8_9.
  30. Liwei Jiang, Jena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, Maxwell Forbes, Jon Borchardt, Jenny Liang, Oren Etzioni, Maarten Sap, and Yejin Choi. Delphi: Towards machine ethics and norms. CoRR, abs/2110.07574, 2021. URL: http://arxiv.org/abs/2110.07574.
  31. Gregory E Kersten and Stan Szpakowicz. Decision making and decision aiding: defining the process, it representations, and support. Group Decision and Negotiation, 3(2):237-261, 1994. Google Scholar
  32. Hyeongjoo Kim and Sunyong Byun. Designing and Applying a Moral Turing Test. Advances in Science, Technology and Engineering Systems Journal, 6(2):93-98, 2021. URL: https://doi.org/10.25046/aj060212.
  33. Bertram F. Malle, Paul Bello, and Matthias Scheutz. Requirements for an artificial agent with norm competence. In Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society, AIES '19, pages 21-27, New York, NY, USA, 2019. Association for Computing Machinery. URL: https://doi.org/10.1145/3306618.3314252.
  34. Tim Miller. Explanation in artificial intelligence: Insights from the social sciences. Artificial Intelligence, 267:1-38, 2019. URL: https://doi.org/10.1016/j.artint.2018.07.007.
  35. James Moor. The dartmouth college artificial intelligence conference: The next fifty years. AI Magazine, 27(4):87, December 2006. URL: https://doi.org/10.1609/aimag.v27i4.1911.
  36. James H. Moor. The nature, importance, and difficulty of machine ethics. IEEE Intelligent Systems, 21(4):18-21, July 2006. URL: https://doi.org/10.1109/MIS.2006.80.
  37. Vivek Nallur. Landscape of machine implemented ethics. Sci. Eng. Ethics, 26(5):2381-2399, 2020. URL: https://doi.org/10.1007/s11948-020-00236-y.
  38. Ritesh Noothigattu, Djallel Bouneffouf, Nicholas Mattei, Rachita Chandra, Piyush Madan, Kush R. Varshney, Murray Campbell, Moninder Singh, and Francesca Rossi. Teaching ai agents ethical values using reinforcement learning and policy orchestration. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI-19, pages 6377-6381. International Joint Conferences on Artificial Intelligence Organization, July 2019. URL: https://doi.org/10.24963/ijcai.2019/891.
  39. Ritesh Noothigattu, Snehalkumar (Neil) S. Gaikwad, Edmond Awad, Sohan Dsouza, Iyad Rahwan, Pradeep Ravikumar, and Ariel D. Procaccia. A voting-based system for ethical decision making. In Sheila A. McIlraith and Kilian Q. Weinberger, editors, Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2-7, 2018, pages 1587-1594. AAAI Press, 2018. URL: https://www.aaai.org/ocs/index.php/AAAI/AAAI18/paper/view/17052.
  40. Raja Parasuraman, Tom .B. Sheridan, and Christopher D. Wickens. A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 30(3):286-297, 2000. URL: https://doi.org/10.1109/3468.844354.
  41. Martin Peterson. An Introduction to Decision Theory. Cambridge Introductions to Philosophy. Cambridge University Press, 2 edition, 2017. URL: https://doi.org/10.1017/9781316585061.
  42. Rosalind W. Picard. Affective Computing. MIT Press, 1997. Google Scholar
  43. Thomas M. Powers. Prospects for a kantian machine. In Michael Anderson and Susan LeighEditors Anderson, editors, Machine Ethics, pages 464-475. Cambridge University Press, 2011. URL: https://doi.org/10.1017/CBO9780511978036.031.
  44. Iyad Rahwan. Society-in-the-loop: programming the algorithmic social contract. Ethics and Information Technology, 20(1):5-14, March 2018. URL: https://doi.org/10.1007/s10676-017-9430-8.
  45. Steward Russell and Peter Norvig. Artificial Intelligence: A Modern Approach. Pearson Education, 4 edition, 2020. Google Scholar
  46. Amartya Sen. Choice, orderings and morality. In Stephan Körner, editor, Practical Reason, pages 54-67. Camalot Press, Oxford, 1974. Google Scholar
  47. Amartya K. Sen. Rational fools: A critique of the behavioral foundations of economic theory. Philosophy & Public Affairs, 6(4):317-344, 1977. URL: http://www.jstor.org/stable/2264946.
  48. Jakob Stenseke. Artificial virtuous agents: from theory to machine implementation. AI & SOCIETY, 2021. URL: https://doi.org/10.1007/s00146-021-01325-7.
  49. Suzanne Tolmeijer, Markus Kneer, Cristina Sarasua, Markus Christen, and Abraham Bernstein. Implementations in machine ethics: A survey. CoRR, abs/2001.07573, 2020. URL: http://arxiv.org/abs/2001.07573.
  50. Lewis Vaughn. Beginning Ethics: An Introduction to Moral Philosophy. W. W. Norton & Company, New York City, 2014. Google Scholar
  51. Wendell Wallach and Colin Allen. Moral Machines: Teaching Robots Right from Wrong. Oxford University Press, Inc., USA, 2008. Google Scholar
  52. Wendell Wallach, Colin Allen, and Iva Smit. Machine morality: bottom-up and top-down approaches for modelling human moral faculties. AI & SOCIETY, 22(4):565-582, 2008. URL: https://doi.org/10.1007/s00146-007-0099-0.
  53. Maranke Wieringa. What to account for when accounting for algorithms: A systematic literature review on algorithmic accountability. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, FAT* ’20, pages 1-18, New York, NY, USA, 2020. Association for Computing Machinery. URL: https://doi.org/10.1145/3351095.3372833.
  54. Alan F. T. Winfield, Serena Booth, Louise A. Dennis, Takashi Egawa, Helen Hastie, Naomi Jacobs, Roderick I. Muttram, Joanna I. Olszewska, Fahimeh Rajabiyazdi, Andreas Theodorou, Mark A. Underwood, Robert H. Wortham, and Eleanor Watson. Ieee p7001: A proposed standard on transparency. Frontiers in Robotics and AI, 8:225, 2021. URL: https://doi.org/10.3389/frobt.2021.665729.
Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail
© 2023-2024 Schloss Dagstuhl – LZI GmbH Imprint Privacy Contact