2026-07-20T05:41:51Z https://drops.dagstuhl.de/oai

oai:drops-oai.dagstuhl.de:586 2024-03-06T11:05:46Z ddc:004 open_access

Evaluating ECAs - What,how and why? Ruttkay, Zsofia Dormann, Claire Noot, Han Embodied conversational agents design evaluation framework methodology One would like to rely on design guidelines for embodied conversational agents (ECAs), grounded on evaluation studies. How to define the physical and mental characteristics of an ECA, optimal for an envisioned application? What will be the added value of using an ECA? Although there have been studies addressing such issues, we are still far from getting a complete picture. This is not only due to the still relatively little experience with applications of ECAs, but also to the diversity in terms and experimental settings used. The lack of a common, established framework makes it difficult to compare ECAs, interpret evaluation results and judge their scope and relevance. In this paper we propose a common taxonomy of the relevant design and evaluation aspects of ECAs. We refer to recent works to elicit evaluation concepts and discuss measurement issues. Schloss Dagstuhl – Leibniz-Zentrum für Informatik Zsofia Ruttkay and Claire Dormann and Han Noot 2006 Is Part Of Dagstuhl Seminar Proceedings, Volume 4121, Evaluating Embodied Conversational Agents (2006) InProceedings Text doc-type:ResearchArticle publishedVersion application/pdf doi:10.4230/DagSemProc.04121.4 urn:nbn:de:0030-drops-5867 https://drops.dagstuhl.de/entities/document/10.4230/DagSemProc.04121.4 eng https://creativecommons.org/licenses/by/4.0/legalcode