On the Representativity of Execution Time Measurements: Studying Dependence and Multi-Mode Tasks

Authors Fabrice Guet, Luca Santinelli, Jerome Morio

Thumbnail PDF


  • Filesize: 0.72 MB
  • 13 pages

Document Identifiers

Author Details

Fabrice Guet
Luca Santinelli
Jerome Morio

Cite AsGet BibTex

Fabrice Guet, Luca Santinelli, and Jerome Morio. On the Representativity of Execution Time Measurements: Studying Dependence and Multi-Mode Tasks. In 17th International Workshop on Worst-Case Execution Time Analysis (WCET 2017). Open Access Series in Informatics (OASIcs), Volume 57, pp. 3:1-3:13, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2017)


The Measurement-Based Probabilistic Timing Analysis (MBPTA) infers probabilistic Worst-Case Execution Time (pWCET) estimates from measurements of tasks execution times; the Extreme Value Theory (EVT) is the statistical tool that MBPTA applies for inferring worst-cases from observations/measurements of the actual task behavior. MBPTA and EVT capability of estimating safe/pessimistic pWCET rely on the quality of the measurements; in particular, execution time measurements have to be representative of the actual system execution conditions and have to cover multiple possible execution conditions. In this work, we investigate statistical dependences between execution time measurements and tasks with multiple runtime operational modes. In the first case, we outline the effects of dependences on the EVT applicability as well as on the quality of the pWCET estimates. In the second case, we propose the best approaches to account for the different task execution modes and guaranteeing safe pWCET estimates that cover them all. The solutions proposed are validated with test cases.
  • Measurement-Based Probabilistic Timing Analysis
  • probabilistic Worst-Case Execution Time
  • Extreme Value Theory
  • Execution Time Measurements Representa


  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    PDF Downloads


  1. J. Abella, J. del Castillo, M. Padilla, and F. J. Cazorla. Extreme value theory in computer sciences: The case of embedded safety-critical systems. In 6th International Conference on Risk Analysis (ICRA), 2015. Google Scholar
  2. Jaume Abella, Eduardo Quiñones, Franck Wartel, Tullio Vardanega, and Francisco J. Cazorla. Heart of gold: Making the improbable happen to increase confidence in MBPTA. In 26th Euromicro Conference on Real-Time Systems, (ECRTS), 2014. Google Scholar
  3. W. A. Brock, J. A. Scheinkman, W. D. Dechert, and B. LeBaron. A Test for Independence based on the Correlation Dimension. Econometric Reviews, 15(3):197-235, 1996. Google Scholar
  4. Alan Burns and Stewart Edgar. Predicting computation time for advanced processor architectures. In 12th Euromicro Conference on Real-Time Systems (ECRTS), 2000. Google Scholar
  5. Francisco J. Cazorla, Tullio Vardanega, Eduardo Quinones, and Jaume Abella. Upper-bounding program execution time with extreme value theory. In WCET, 2013. Google Scholar
  6. L. Cucu-Grosjean, L. Santinelli, M. Houston, C. Lo, T. Vardanega, L. Kosmidis, J. Abella, E. Mezzeti, E. Quinones, and F. J. Cazorla. Measurement-Based Probabilistic Timing Analysis for Multi-path Programs. In 23nd IEEE Euromicro Conference on Real-Time Systems (ECRTS), 2012. Google Scholar
  7. Corentin Damman, Gregory Edison, Fabrice Guet, Eric Noulard, Luca Santinelli, and Jerome Hugues. Architectural performance analysis of FPGA synthesized LEON processors. In Proceedings of the IEEE International Symposium on Rapid System Prototyping, 2016. Google Scholar
  8. J. L. Díaz, D. F. Garcia, K. Kim, C. G. Lee, L. L. Bello, J. M. López, and O. Mirabella. Stochastic analysis of periodic real-time systems. In 23rd of the IEEE Real-Time Systems Symposium (RTSS), 2002. Google Scholar
  9. P. Embrechts, C. Klüppelberg, and T. Mikosch. Modelling extremal events for insurance and finance. Applications of mathematics. Springer, Berlin, Heidelberg, New York, 1997. Google Scholar
  10. C. A. T. Ferro and J. Segers. Automatic Declustering of Extreme Values Via an Estimator for the Extremal Index. Technical Report, 2002. Google Scholar
  11. M. K. Gardner. Probabilistic analysis and scheduling of critical soft real-time systems. PhD thesis, University of Illinois at Urbana-Champaign, Champaign, IL, USA, 1999. AAI9953022. Google Scholar
  12. F. Guet, L. Santinelli, and J. Morio. On the reliability of the probabilistic worst-case execution time estimates. In 8th European Congress on Embedded Real Time Software and Systems (ERTS), 2016. Google Scholar
  13. D. Kwiatkowski, P. C. B. Phillips, P. Schmidt, and Y. Shin. Testing the null hypothesis of stationarity against the alternative of a unit root : How sure are we that economic time series have a unit root? Journal of Econometrics, 54(1-3):159-178, 00 1992. Google Scholar
  14. F. Laio. Cramer-von Mises and Anderson-Darling goodness of fit tests for extreme value distributions with unknown parameters. Water Resources Research, 40, 2004. Google Scholar
  15. Stephen Law and Iain Bate. Achieving appropriate test coverage for reliable measurement-based timing analysis. In 28th Euromicro Conference on Real-Time Systems, 2016. Google Scholar
  16. M. R. Leadbetter. Extremes and local dependence in stationary sequences. Stochastic Processes and their Applications, 35, 1983. Google Scholar
  17. M. R. Leadbetter. On a basis for peaks over threshold modeling. Statistics &Probability Letters, 12(4):357-362, 1991. Google Scholar
  18. George Lima, Dario Dias, and Edna Barros. Extreme value theory for estimating task execution time bounds: A careful look. In 28th Euromicro Conference on Real-Time Systems, (ECRTS), 2016. Google Scholar
  19. C. L. Liu and J. W. Layland. Scheduling algorithms for multiprogramming in a hard-real-time environment. Journal of the ACM, 1973. Google Scholar
  20. Cristian Maxim, Adriana Gogonel, Irina Asavoae, Mihail Asavoae, Liliana Cucu-Grosjean, and Walid Talaboulma. Reproducibility and representativity - mandatory properties for the compositionality of measurement-based WCET estimation approaches. In The 9th International Workshop on Compositional Theory and Technology for Real-Time Embedded System (CRTS), 2016. Google Scholar
  21. Vincent Nélis, Patrick Meumeu Yomsi, and Luís Miguel Pinho. The variability of application execution times on a multi-core platform. In 16th International Workshop on Worst-Case Execution Time Analysis, 2016, pages 6:1-6:11, 2016. Google Scholar
  22. R. Pellizzoni and M. Caccamo. Toward the predictable integration of real-time COTS based systems. In Real-Time Systems Symposium. (RTSS). 28th IEEE International, 2007. Google Scholar
  23. L. Santinelli, J. Morio, G. Dufour, and D. Jacquemart. On the Sustainability of the Extreme Value Theory for WCET Estimation. In 14th International Workshop on Worst-Case Execution Time Analysis (WCET), pages 21-30, 2014. Google Scholar
  24. Luca Santinelli, Fabrice Guet, and Jerome Morio. Revising measurement-based probabilistic timing analysis. In 2017 IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS). IEEE, 2017. Google Scholar
Questions / Remarks / Feedback

Feedback for Dagstuhl Publishing

Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail