License
when quoting this document, please refer to the following
URN: urn:nbn:de:0030-drops-28135
URL: http://drops.dagstuhl.de/opus/volltexte/2010/2813/

Mueller, Christian Lorenz

Exploring the common concepts of adaptive MCMC and Covariance Matrix Adaptation schemes

pdf-format:
Dokument 1.pdf (3,340 KB)


Abstract

In the field of scientific modeling, one is often confronted with the task of drawing samples from a probability distribution that is only known up to a normalizing constant and for which no direct analytical method for sample generation is available. Since the past decade, adaptive Markov Chain Monte Carlo (MCMC) methods gained considerable attention in the statistics community in order to tackle this black-box (or indirect) sampling scenario. Common application domains are Bayesian statistics and statistical physics. Adaptive MCMC methods try to learn an optimal proposal distribution from previously accepted samples in order to efficiently explore the target distribution. Variable metric ap- proaches in black-box optimization, such as the Evolution Strategy with covariance matrix adaptation (CMA-ES) and Gaussian Adaption (GaA), use almost identical ideas to locate putative global optima. This extended abstract summarizes the common concepts in adaptive MCMC and co- variance matrix adaptation schemes. We also present how both types of methods can be unified within the Gaussian Adaptation framework and propose a unification of both fields as “grand challenge” for future research.

BibTeX - Entry

@InProceedings{mueller:DSP:2010:2813,
  author =	{Christian Lorenz Mueller},
  title =	{Exploring the common concepts of adaptive MCMC and Covariance Matrix Adaptation schemes},
  booktitle =	{Theory of Evolutionary Algorithms},
  year =	{2010},
  editor =	{Anne Auger and Jonathan L. Shapiro and L. Darrell Whitley and Carsten Witt},
  number =	{10361},
  series =	{Dagstuhl Seminar Proceedings},
  ISSN =	{1862-4405},
  publisher =	{Schloss Dagstuhl - Leibniz-Zentrum fuer Informatik, Germany},
  address =	{Dagstuhl, Germany},
  URL =		{http://drops.dagstuhl.de/opus/volltexte/2010/2813},
  annote =	{Keywords: Adaptive MCMC, Gaussian Adaptation, CMA-ES, covari- ance matrix adaptation}
}

Keywords: Adaptive MCMC, Gaussian Adaptation, CMA-ES, covari- ance matrix adaptation
Seminar: 10361 - Theory of Evolutionary Algorithms
Issue date: 2010
Date of publication: 24.11.2010


DROPS-Home | Fulltext Search | Imprint Published by LZI