License
When quoting this document, please refer to the following
URN: urn:nbn:de:0030-drops-5867
URL: http://drops.dagstuhl.de/opus/volltexte/2006/586/
Go to the corresponding Portal


Ruttkay, Zsofia ; Dormann, Claire ; Noot, Han

Evaluating ECAs - What,how and why?

pdf-format:
Document 1.pdf (64 KB)


Abstract

One would like to rely on design guidelines for embodied conversational agents (ECAs), grounded on evaluation studies. How to define the physical and mental characteristics of an ECA, optimal for an envisioned application? What will be the added value of using an ECA? Although there have been studies addressing such issues, we are still far from getting a complete picture. This is not only due to the still relatively little experience with applications of ECAs, but also to the diversity in terms and experimental settings used. The lack of a common, established framework makes it difficult to compare ECAs, interpret evaluation results and judge their scope and relevance. In this paper we propose a common taxonomy of the relevant design and evaluation aspects of ECAs. We refer to recent works to elicit evaluation concepts and discuss measurement issues.

BibTeX - Entry

@InProceedings{ruttkay_et_al:DSP:2006:586,
  author =	{Zsofia Ruttkay and Claire Dormann and Han Noot},
  title =	{Evaluating ECAs - What,how and why?},
  booktitle =	{Evaluating Embodied Conversational Agents},
  year =	{2006},
  editor =	{Zsofia Ruttkay and Elisabeth Andr{\'e} and W. Lewis Johnson and Catherine Pelachaud},
  number =	{04121},
  series =	{Dagstuhl Seminar Proceedings},
  ISSN =	{1862-4405},
  publisher =	{Internationales Begegnungs- und Forschungszentrum f{\"u}r Informatik (IBFI), Schloss Dagstuhl, Germany},
  address =	{Dagstuhl, Germany},
  URL =		{http://drops.dagstuhl.de/opus/volltexte/2006/586},
  annote =	{Keywords: Embodied conversational agents, design, evaluation framework, methodology}
}

Keywords: Embodied conversational agents, design, evaluation framework, methodology
Seminar: 04121 - Evaluating Embodied Conversational Agents
Issue Date: 2006
Date of publication: 27.06.2006


DROPS-Home | Fulltext Search | Imprint Published by LZI