Schloss Dagstuhl - Leibniz-Zentrum für Informatik GmbH Schloss Dagstuhl - Leibniz-Zentrum für Informatik GmbH scholarly article en Ruttkay, Zsofia; Dormann, Claire; Noot, Han License: Creative Commons Attribution 4.0 license (CC BY 4.0)
when quoting this document, please refer to the following
URN: urn:nbn:de:0030-drops-5867

; ;

Evaluating ECAs - What,how and why?



One would like to rely on design guidelines for embodied conversational
agents (ECAs), grounded on evaluation studies. How to define the physical and
mental characteristics of an ECA, optimal for an envisioned application? What will be the added value of using an ECA? Although there have been studies addressing such issues, we are still far from getting a complete picture. This is not only due to the still relatively little experience with applications of ECAs, but also to the diversity in terms and experimental settings used. The lack of a common, established framework makes it difficult to compare ECAs, interpret evaluation results and judge their scope and relevance. In this paper we propose a common taxonomy of the relevant design and evaluation aspects of ECAs. We refer to recent works to elicit evaluation concepts
and discuss measurement issues.

BibTeX - Entry

  author =	{Ruttkay, Zsofia and Dormann, Claire and Noot, Han},
  title =	{{Evaluating ECAs - What,how and why?}},
  booktitle =	{Evaluating Embodied Conversational Agents},
  pages =	{1--8},
  series =	{Dagstuhl Seminar Proceedings (DagSemProc)},
  ISSN =	{1862-4405},
  year =	{2006},
  volume =	{4121},
  editor =	{Zsofia Ruttkay and Elisabeth Andr\'{e} and W. Lewis Johnson and Catherine Pelachaud},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{},
  URN =		{urn:nbn:de:0030-drops-5867},
  doi =		{10.4230/DagSemProc.04121.4},
  annote =	{Keywords: Embodied conversational agents, design, evaluation framework, methodology}

Keywords: Embodied conversational agents, design, evaluation framework, methodology
Seminar: 04121 - Evaluating Embodied Conversational Agents
Issue date: 2006
Date of publication: 27.06.2006

DROPS-Home | Fulltext Search | Imprint | Privacy Published by LZI