2026-10-07T10:08:08Z https://drops.dagstuhl.de/oai

oai:drops-oai.dagstuhl.de:24794 2026-02-09T06:47:24Z ddc:004 open_access

Assessing Diagnosis Algorithms: Of Sampling, Baselines, Metrics and Oracles Pill, Ingo de Kleer, Johan Model-based Diagnosis Diagnosis Algorithms Assessing and comparing diagnosis algorithms is a surprisingly complex challenge. We have to make decisions ranging from identifying the implications of the chosen baseline, via defining and ensuring a representative sampling strategy, to the choice of metric best suited to capture the computational, probing, or repair costs as well as the deviations from the baseline. We discuss several aspects of the overall challenge, identify related issues, and evaluate a special economic metric. Schloss Dagstuhl – Leibniz-Zentrum für Informatik Ingo Pill and Johan de Kleer 2025 Is Part Of OASIcs, Volume 136, 36th International Conference on Principles of Diagnosis and Resilient Systems (DX 2025) InProceedings Text doc-type:ResearchArticle publishedVersion application/pdf doi:10.4230/OASIcs.DX.2025.5 urn:nbn:de:0030-drops-247941 https://drops.dagstuhl.de/entities/document/10.4230/OASIcs.DX.2025.5 eng https://creativecommons.org/licenses/by/4.0/legalcode