DROPS

Document

Academic Track

DOI: 10.4230/OASIcs.SAIA.2024.1

On Assessing ML Model Robustness: A Methodological Framework (Academic Track)

Authors: Afef Awadid and Boris Robert

Published in: OASIcs, Volume 126, Symposium on Scaling AI Assessments (SAIA 2024)

Abstract

Due to their uncertainty and vulnerability to adversarial attacks, machine learning (ML) models can lead to severe consequences, including the loss of human life, when embedded in safety-critical systems such as autonomous vehicles. Therefore, it is crucial to assess the empirical robustness of such models before integrating them into these systems. ML model robustness refers to the ability of an ML model to be insensitive to input perturbations and maintain its performance. Against this background, the Confiance.ai research program proposes a methodological framework for assessing the empirical robustness of ML models. The framework encompasses methodological processes (guidelines) captured in Capella models, along with a set of supporting tools. This paper aims to provide an overview of this framework and its application in an industrial setting.

Cite as

Afef Awadid and Boris Robert. On Assessing ML Model Robustness: A Methodological Framework (Academic Track). In Symposium on Scaling AI Assessments (SAIA 2024). Open Access Series in Informatics (OASIcs), Volume 126, pp. 1:1-1:10, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2025)

Copy BibTex To Clipboard

@InProceedings{awadid_et_al:OASIcs.SAIA.2024.1,
  author =	{Awadid, Afef and Robert, Boris},
  title =	{{On Assessing ML Model Robustness: A Methodological Framework}},
  booktitle =	{Symposium on Scaling AI Assessments (SAIA 2024)},
  pages =	{1:1--1:10},
  series =	{Open Access Series in Informatics (OASIcs)},
  ISBN =	{978-3-95977-357-7},
  ISSN =	{2190-6807},
  year =	{2025},
  volume =	{126},
  editor =	{G\"{o}rge, Rebekka and Haedecke, Elena and Poretschkin, Maximilian and Schmitz, Anna},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops.dagstuhl.de/entities/document/10.4230/OASIcs.SAIA.2024.1},
  URN =		{urn:nbn:de:0030-drops-227410},
  doi =		{10.4230/OASIcs.SAIA.2024.1},
  annote =	{Keywords: ML model robustness, assessment, framework, methodological processes, tools}
}

Search Results

Documents authored by Awadid, Afef

On Assessing ML Model Robustness: A Methodological Framework (Academic Track)

Abstract

Cite as

Thanks for your feedback!

Could not send message