Document Open Access Logo

TACLeBench: A Benchmark Collection to Support Worst-Case Execution Time Research

Authors Heiko Falk, Sebastian Altmeyer, Peter Hellinckx, Björn Lisper, Wolfgang Puffitsch, Christine Rochange, Martin Schoeberl, Rasmus Bo Sørensen, Peter Wägemann, Simon Wegener

PDF

File

Thumbnail PDF
PDF
OASIcs.WCET.2016.2.pdf
  • Filesize: 443 kB
  • 10 pages

Document Identifiers

Subject Classification

Keywords
  • Benchmark
  • WCET analysis
  • real-time systems

Metrics

  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    0
    PDF Downloads
    0
    Metadata Views

Abstract

Engineering related research, such as research on worst-case execution time, uses experimentation to evaluate ideas. For these experiments we need example programs. Furthermore, to make the research experimentation repeatable those programs shall be made publicly available.

We collected open-source programs, adapted them to a common coding style, and provide the collection in open-source. The benchmark collection is called TACLeBench and is available from GitHub in version 1.9 at the publication date of this paper. One of the main features of TACLeBench is that all programs are self-contained without any dependencies on standard libraries or an operating system.

Cite As Get BibTex

Heiko Falk, Sebastian Altmeyer, Peter Hellinckx, Björn Lisper, Wolfgang Puffitsch, Christine Rochange, Martin Schoeberl, Rasmus Bo Sørensen, Peter Wägemann, and Simon Wegener. TACLeBench: A Benchmark Collection to Support Worst-Case Execution Time Research. In 16th International Workshop on Worst-Case Execution Time Analysis (WCET 2016). Open Access Series in Informatics (OASIcs), Volume 55, pp. 2:1-2:10, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2016) https://doi.org/10.4230/OASIcs.WCET.2016.2

Author Details

Heiko Falk
Sebastian Altmeyer
Peter Hellinckx
Björn Lisper
Wolfgang Puffitsch
Christine Rochange
Martin Schoeberl
Rasmus Bo Sørensen
Peter Wägemann
Simon Wegener

References

  1. Boris Dreyer, Christian Hochberger, Alexander Lange, Simon Wegener, and Alexander Weiss. Continuous Non-Intrusive Hybrid WCET Estimation Using Waypoint Graphs. In 16th Int'l Workshop on Worst-Case Execution Time Analysis (WCET 2016), volume 55 of OpenAccess Series in Informatics (OASIcs), pages 4:1-4:11, Dagstuhl, Germany, 2016. Schloss Dagstuhl-Leibniz-Zentrum für Informatik. URL: http://dx.doi.org/10.4230/OASIcs.WCET.2016.4.
  2. EDN Embedded Microprocessor Benchmark Consortium. http://www.eembc.org.
  3. Heiko Falk, Timon Kelter, Robert Pyka, and Daniel Schulte. TACLeBench Flow Facts Documentation. White paper, September 2013. Google Scholar
  4. Heiko Falk, Paul Lokuciejewski, and Henrik Theiling. Design of a WCET-Aware C Compiler. In 6th Int'l Workshop on Worst-Case Execution Time Analysis (WCET'06), volume 4 of OpenAccess Series in Informatics (OASIcs), Dagstuhl, Germany, 2006. Schloss Dagstuhl-Leibniz-Zentrum für Informatik. URL: http://dx.doi.org/10.4230/OASIcs.WCET.2006.673.
  5. Jan Gustafsson. The worst case execution time tool challenge 2006. In Proc. 2nd International Symposium on Leveraging Applications of Formal Methods (ISOLA'06), pages 233-240, Paphos, Cyprus, November 2006. IEEE. URL: http://dx.doi.org/10.1109/ISoLA.2006.72.
  6. Jan Gustafsson, Adam Betts, Andreas Ermedahl, and Björn Lisper. The mälardalen WCET benchmarks: Past, present and future. In 10th Int'l Workshop on Worst-Case Execution Time Analysis, WCET 2010, July 6, 2010, Brussels, Belgium, pages 136-146, 2010. URL: http://dx.doi.org/10.4230/OASIcs.WCET.2010.136.
  7. Matthew R. Guthaus, Jeffrey S. Ringenberg, Dan Ernst, Todd M. Austin, Trevor Mudge, and Richard B. Brown. MiBench: A free, commercially representative embedded benchmark suite. In Proceedings of the IEEE 4th Annual Workshop on Workload Characterization, 2001. Google Scholar
  8. Trevor Harmon, Martin Schoeberl, Raimund Kirner, and Raymond Klefstad. A modular worst-case execution time analysis tool for Java processors. In Proceedings of the 14th IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS 2008), pages 47-57, St. Louis, MO, United States, April 2008. IEEE Computer Society. URL: http://www.jopdesign.com/doc/volta_rtas2008.pdf, URL: http://dx.doi.org/10.1109/RTAS.2008.34.
  9. Niklas Holsti, Thomas Langbacka, and Sami Saarinen. Using a worst-case execution time tool for real-time verification of the DEBIE software. European Space Agency - Publications, 457:307-312, 2000. Google Scholar
  10. Fadia Nemer, Hugues Cassé, Pascal Sainrat, Jean Paul Bahsoun, and Marianne De Michiel. Papabench: a free real-time benchmark. In 6th Int'l Workshop on Worst-Case Execution Time (WCET) Analysis, July 4, 2006, Dresden, Germany, 2006. URL: https://doi.org/10.4230/OASIcs.WCET.2006.678.
  11. Martin Schoeberl, Sahar Abbaspour, Benny Akesson, Neil Audsley, Raffaele Capasso, Jamie Garside, Kees Goossens, Sven Goossens, Scott Hansen, Reinhold Heckmann, Stefan Hepp, Benedikt Huber, Alexander Jordan, Evangelia Kasapaki, Jens Knoop, Yonghui Li, Daniel Prokesch, Wolfgang Puffitsch, Peter Puschner, André Rocha, Cláudio Silva, Jens Sparsø, and Alessandro Tocchi. T-CREST: Time-predictable multi-core architecture for embedded systems. Journal of Systems Architecture, 61(9):449-471, 2015. URL: http://www.jopdesign.com/doc/t-crest-jnl.pdf, URL: http://dx.doi.org/10.1016/j.sysarc.2015.04.002.
  12. Martin Schoeberl and Carsten Nielsen. A stack cache for real-time systems. In Proceedings of the 18th IEEE Symposium on Real-time Distributed Computing (ISORC 2016), York, United Kingdom, May 2016. IEEE. URL: http://www.jopdesign.com/doc/abc.pdf.
  13. Martin Schoeberl, Thomas B. Preusser, and Sascha Uhrig. The embedded Java benchmark suite JemBench. In Proceedings of the 8th International Workshop on Java Technologies for Real-Time and Embedded Systems (JTRES 2010), pages 120-127, New York, NY, USA, August 2010. ACM. URL: http://www.jopdesign.com/doc/jembench.pdf, URL: http://dx.doi.org/10.1145/1850771.1850789.
Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail
© 2023-2025 Schloss Dagstuhl – LZI GmbH About DROPS Imprint Privacy Contact