License
when quoting this document, please refer to the following
URN: urn:nbn:de:0030-drops-13846
URL: http://drops.dagstuhl.de/opus/volltexte/2008/1384/

Deshpande, Ashwin ; Milch, Brian ; Zettlemoyer, Luke S. ; Kaelbling, Leslie Pack

Learning Probabilistic Relational Dynamics for Multiple Tasks

pdf-format:
Dokument 1.pdf (212 KB)


Abstract

The ways in which an agent's actions affect the world can often be modeled compactly using a set of relational probabilistic planning rules. This extended abstract addresses the problem of learning such rule sets for multiple related tasks. We take a hierarchical Bayesian approach, in which the system learns a prior distribution over rule sets. We present a class of prior distributions parameterized by a rule set prototype that is stochastically modified to produce a task-specific rule set. We also describe a coordinate ascent algorithm that iteratively optimizes the task-specific rule sets and the prior distribution. Experiments using this algorithm show that transferring information from related tasks significantly reduces the amount of training data required to predict action effects in blocks-world domains.

BibTeX - Entry

@InProceedings{deshpande_et_al:DSP:2008:1384,
  author =	{Ashwin Deshpande and Brian Milch and Luke S. Zettlemoyer and Leslie Pack Kaelbling},
  title =	{Learning Probabilistic Relational Dynamics for Multiple Tasks},
  booktitle =	{Probabilistic, Logical and Relational Learning - A Further Synthesis},
  year =	{2008},
  editor =	{Luc de Raedt and Thomas Dietterich and Lise Getoor and Kristian Kersting and Stephen H. Muggleton},
  number =	{07161},
  series =	{Dagstuhl Seminar Proceedings},
  ISSN =	{1862-4405},
  publisher =	{Internationales Begegnungs- und Forschungszentrum f{\"u}r Informatik (IBFI), Schloss Dagstuhl, Germany},
  address =	{Dagstuhl, Germany},
  URL =		{http://drops.dagstuhl.de/opus/volltexte/2008/1384},
  annote =	{Keywords: Hierarchical Bayesian models, transfer learning, multi-task learning, probabilistic planning rules}
}

Keywords: Hierarchical Bayesian models, transfer learning, multi-task learning, probabilistic planning rules
Seminar: 07161 - Probabilistic, Logical and Relational Learning - A Further Synthesis
Issue date: 2008
Date of publication: 06.03.2008


DROPS-Home | Fulltext Search | Imprint Published by LZI