13. Approximate dynamic programming for rail operations

Authors Warren Powell, Belgacem Bouzaiene-Ayari

Thumbnail PDF


  • Filesize: 200 kB
  • 18 pages

Document Identifiers

Author Details

Warren Powell
Belgacem Bouzaiene-Ayari

Cite AsGet BibTex

Warren Powell and Belgacem Bouzaiene-Ayari. 13. Approximate dynamic programming for rail operations. In 7th Workshop on Algorithmic Approaches for Transportation Modeling, Optimization, and Systems (ATMOS'07). Open Access Series in Informatics (OASIcs), Volume 7, pp. 191-208, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2007)


Approximate dynamic programming offers a new modeling and algorithmic strategy for complex problems such as rail operations. Problems in rail operations are often modeled using classical math programming models defined over space-time networks. Even simplified models can be hard to solve, requiring the use of various heuristics. We show how to combine math programming and simulation in an ADP-framework, producing a strategy that looks like simulation using iterative learning. Instead of solving a single, large optimization problem, we solve sequences of smaller ones that can be solved optimally using commercial solvers. We step forward in time using the same flexible logic used in simulation models. We show that we can still obtain near optimal solutions, while modeling operations at a very high level of detail. We describe how to adapt the strategy to the modeling of freight cars and locomotives.


  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    PDF Downloads