Towards Trusted AI: A Blueprint for Ethics Assessment in Practice (Academic Track)

Authors Christoph Tobias Wirth , Mihai Maftei , Rosa Esther Martín-Peña, Iris Merget



PDF
Thumbnail PDF

File

OASIcs.SAIA.2024.7.pdf
  • Filesize: 1.9 MB
  • 19 pages

Document Identifiers

Author Details

Christoph Tobias Wirth
  • Smart Data & Knowledge Services, German Research Center for Artificial Intelligence (DFKI GmbH), Kaiserslautern, Germany
Mihai Maftei
  • Ethics Team, German Research Center for Artificial Intelligence (DFKI GmbH), Saarbrücken, Germany
Rosa Esther Martín-Peña
  • Educational Technology Lab, German Research Center for Artificial Intelligence (DFKI GmbH), Berlin, Germany
Iris Merget
  • Agents and Simulated Reality, German Research Center for Artificial Intelligence (DFKI GmbH), Saarbrücken, Germany

Acknowledgements

We thank Samantha Morgaine Prange and Lisa-Marie Goltz from the DFKI Ethics Team for their valuable contribution throughout the entire paper writing process.

Cite As Get BibTex

Christoph Tobias Wirth, Mihai Maftei, Rosa Esther Martín-Peña, and Iris Merget. Towards Trusted AI: A Blueprint for Ethics Assessment in Practice (Academic Track). In Symposium on Scaling AI Assessments (SAIA 2024). Open Access Series in Informatics (OASIcs), Volume 126, pp. 7:1-7:19, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2025) https://doi.org/10.4230/OASIcs.SAIA.2024.7

Abstract

The development of AI technologies leaves place for unforeseen ethical challenges. Issues such as bias, lack of transparency and data privacy must be addressed during the design, development, and the deployment stages throughout the lifecycle of AI systems to mitigate their impact on users. Consequently, ensuring that such systems are responsibly built has become a priority for researchers and developers from both public and private sector. As a proposed solution, this paper presents a blueprint for AI ethics assessment. The blueprint provides for AI use cases an adaptable approach which is agnostic to ethics guidelines, regulatory environments, business models, and industry sectors. The blueprint offers an outcomes library of key performance indicators (KPIs) which are guided by a mapping of ethics framework measures to processes and phases defined by the blueprint. The main objectives of the blueprint are to provide an operationalizable process for the responsible development of ethical AI systems, and to enhance public trust needed for broad adoption of trusted AI solutions. In an initial pilot the blueprinted for AI ethics assessment is applied to a use case of generative AI in education.

Subject Classification

ACM Subject Classification
  • Computing methodologies → Artificial intelligence
  • Social and professional topics → Codes of ethics
  • Human-centered computing → Collaborative and social computing
  • Applied computing → Arts and humanities
Keywords
  • Trusted AI
  • Trustworthy AI
  • AI Ethics Assessment Framework
  • AI Quality
  • AI Ethics
  • AI Ethics Assessment
  • AI Lifecycle
  • Responsible AI
  • Ethics-By-Design
  • AI Risk Management
  • Ethics Impact Assessment
  • AI Ethics KPIs
  • Human-Centric AI
  • Applied Ethics

Metrics

  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    0
    PDF Downloads

References

  1. African Union. Continental Artificial Intelligence Strategy. Harnessing AI for Africa’s Development and Prosperity. African Union, July 2024. Google Scholar
  2. BCLP. US state-by-state AI Legislation snapshot. bclplaw.com, 2024. Google Scholar
  3. Anu Bradford. The Brussels Effect: How the European Union Rules the World. Oxford University PressNew York, 1 edition, February 2020. Google Scholar
  4. Anu Bradford. Digital Empires: The Global Battle to Regulate Technology. Oxford University Press, Oxford, New York, September 2023. Google Scholar
  5. Joy Buolamwini and Timnit Gebru. Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency, pages 77-91. PMLR, January 2018. URL: http://proceedings.mlr.press/v81/buolamwini18a.html.
  6. CIFAR. Pan-Canadian Artificial Intelligence Strategy. cifar.ca, 2017. Google Scholar
  7. Nicholas Kluge Corrêa, Camila Galvão, James William Santos, Carolina Del Pino, Edson Pontes Pinto, Camila Barbosa, Diogo Massmann, Rodrigo Mambrini, Luiza Galvão, Edmund Terem, and Nythamar De Oliveira. Worldwide AI ethics: A review of 200 guidelines and recommendations for AI governance. Patterns, 4(10):100857, October 2023. URL: https://doi.org/10.1016/j.patter.2023.100857.
  8. Embassy of the People’s Republic of China in Grenada. Global AI Governance Initiative. gd.china-embassy.gov.cn, October 2023. Google Scholar
  9. European Commission. Directorate-General for Communications Networks, Content and Technology. Ethics Guidelines for Trustworthy AI. Publications Office, LU, 2019. Google Scholar
  10. European Commission. Directorate-General for Communications Networks, Content and Technology. The Assessment List for Trustworthy Artificial Intelligence (ALTAI) for Self Assessment. Publications Office, LU, 2020. Google Scholar
  11. European Parliament and European Council. AI Act, Regulation 2024/1689. Official Journal of the European Union, June 2024. Google Scholar
  12. Luciano Floridi. Soft Ethics and the Governance of the Digital. Philosophy & Technology, 31(1):1-8, March 2018. URL: https://doi.org/10.1007/s13347-018-0303-9.
  13. Government of Canada. Bill C-27: An Act to enact the Consumer Privacy Protection Act, the Personal Information and Data Protection Tribunal Act and the Artificial Intelligence and Data Act and to make consequential and related amendments to other Acts. justice.gc.ca, November 2022. Google Scholar
  14. Government of Canada. The Artificial Intelligence and Data Act (AIDA). ised-isde.canada.ca, 2023. Google Scholar
  15. Government of Nigeria. National Artificial Intelligence Strategy. ncair.nitda.gov.ng, August 2024. Google Scholar
  16. Ministry of Law and Justice. The Digital Personal Data Protection Act. meity.gov.in, August 2023. Google Scholar
  17. Monetary Authority Singapore. Assessment Methodologies for Responsible Use of AI by Financial Institutions. mas.gov.sg, February 2022. Google Scholar
  18. NIST. Artificial Intelligence Risk Management Framework (AI RMF 1.0). Technical report, National Institute of Standards and Technology, Gaithersburg, MD, January 2023. URL: https://doi.org/10.6028/nist.ai.100-1.
  19. NITI Aayog. National Strategy for AI #AIForAll. niti.gov.in, 2018. Google Scholar
  20. Ricardo Ortega-Bolaños, Joshua Bernal-Salcedo, Mariana Germán Ortiz, Julian Galeano Sarmiento, Gonzalo A. Ruz, and Reinel Tabares-Soto. Applying the ethics of AI: A systematic review of tools for developing and assessing AI-based systems. Artificial Intelligence Review, 57(5):110, April 2024. URL: https://doi.org/10.1007/s10462-024-10740-3.
  21. Personal Data Protection Commission Singapore and Infocomm Media Development Authority. Model AI Governance Framework (2nd edition). pdpc.gov.sg, January 2020. Google Scholar
  22. PRC Cyberspace Administration. Interim Measures for the Management of Generative Artificial Intelligence Services (translated). cac.gov.cn, July 2023. Google Scholar
  23. PRC Ministry of Science and Technology. Ethical Norms for New Generation Artificial (translated). most.gov.cn, October 2021. Google Scholar
  24. Republic of South Africa. National Artificial Intelligence Policy Framework. dcdt.gov.za, August 2024. Google Scholar
  25. Reuters. Amazon Scraps Secret AI Recruiting Tool That Showed Bias against Women. reuters.com, October 2018. Google Scholar
  26. The Hollywood Reporter. Scarlett Johansson’s AI Legal Threat Sets Stage for Actors' Battle With Tech Giants. hollywoodreporter.com, May 2024. Google Scholar
  27. The Indian Express. His `jhakaas': HC issues order against misuse of Anil Kapoor’s persona. indianexpress.com, May 2024. Google Scholar
  28. The White House. Blueprint for an AI Bill of Rights. whitehouse.gov, October 2022. Google Scholar
  29. The White House. Biden-Harris Administration Secures Voluntary Commitments from Leading Artificial Intelligence Companies to Manage the Risks Posed by AI. whitehouse.gov, July 2023. Google Scholar
  30. The White House. Delivering on the Promise of AI to Improve Health Outcomes. whitehouse.gov, December 2023. Google Scholar
  31. The White House. Executive Order on the Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence. whitehouse.gov, October 2023. Google Scholar
  32. UNESCO. Recommendation on the Ethics of Artificial Intelligence. Technical report, UNESCO, 2022. URL: https://unesdoc.unesco.org/ark:/48223/pf0000381137.
  33. UNESCO. Ethical impact assessment. A tool of the Recommendation on the Ethics of Artificial Intelligence. Technical report, UNESCO, 2023. URL: https://doi.org/10.54678/YTSA7796.
  34. UNESCO. AI competency framework for students. Technical report, UNESCO, 2024. Google Scholar
  35. United Nations. Sustainable Development Goals. sdgs.un.org, 2024. Google Scholar
  36. United Nations. AI Advisory Body. Governing AI for Humanity. Technical report, United Nations, September 2024. Google Scholar
  37. Angela Huyue Zhang. The Promise and Perils of China’s Regulation of Artificial Intelligence. Columbia Journal of Transnational Law (forthcoming), January 2024. URL: https://doi.org/10.2139/ssrn.4708676.
Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail