Document Open Access Logo

Achieving Isolation in Mixed-Criticality Industrial Edge Systems with Real-Time Containers

Authors Marco Barletta , Marcello Cinque , Luigi De Simone , Raffaele Della Corte

PDF
Thumbnail PDF

File

LIPIcs.ECRTS.2022.15.pdf
  • Filesize: 1.27 MB
  • 23 pages

Document Identifiers

Author Details

Marco Barletta
  • Università degli Studi di Napoli Federico II, Italy
Marcello Cinque
  • Università degli Studi di Napoli Federico II, Italy
Luigi De Simone
  • Università degli Studi di Napoli Federico II, Italy
Raffaele Della Corte
  • Università degli Studi di Napoli Federico II, Italy

Funding

This work has been partially supported by the project COSMIC of UNINA DIETI and by the R&D project "REINForce: REsearch to INspire the Future” (CDS000609), funded by the Italian Ministry for Economic Development (MISE).

Cite AsGet BibTex

Marco Barletta, Marcello Cinque, Luigi De Simone, and Raffaele Della Corte. Achieving Isolation in Mixed-Criticality Industrial Edge Systems with Real-Time Containers. In 34th Euromicro Conference on Real-Time Systems (ECRTS 2022). Leibniz International Proceedings in Informatics (LIPIcs), Volume 231, pp. 15:1-15:23, Schloss Dagstuhl - Leibniz-Zentrum für Informatik (2022)
https://doi.org/10.4230/LIPIcs.ECRTS.2022.15

Abstract

Real-time containers are a promising solution to reduce latencies in time-sensitive cloud systems. Recent efforts are emerging to extend their usage in industrial edge systems with mixed-criticality constraints. In these contexts, isolation becomes a major concern: a disturbance (such as timing faults or unexpected overloads) affecting a container must not impact the behavior of other containers deployed on the same hardware. In this paper, we propose a novel architectural solution to achieve isolation in real-time containers, based on real-time co-kernels, hierarchical scheduling, and time-division networking. The architecture has been implemented on Linux patched with the Xenomai co-kernel, extended with a new hierarchical scheduling policy, named SCHED_DS, and integrating the RTNet stack. Experimental results are promising in terms of overhead and latency compared to other Linux-based solutions. More importantly, the isolation of containers is guaranteed even in presence of severe co-located disturbances, such as faulty tasks (elapsing more time than declared) or high CPU, network, or I/O stress on the same machine.

Subject Classification

ACM Subject Classification
  • Software and its engineering → Real-time systems software
Keywords
  • Real-time
  • Mixed-criticality
  • Containers
  • Edge computing

Metrics

  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    0
    PDF Downloads
    0
    Metadata Views

Supplementary Materials

References

  1. L. Abeni, A. Balsini, and T. Cucinotta. Container-based real-time scheduling in the linux kernel. SIGBED Rev., 16(3):33-38, November 2019. Google Scholar
  2. Amazon Inc. Getting started with cloud-native automotive software development. URL: https://catalog.us-east-1.prod.workshops.aws/v2/workshops/12f31c93-5926-4477-996c-d47f4524905d/en-US. Accessed 9th June 2022.
  3. Marco Barletta, Marcello Cinque, Luigi De Simone, and Raffaele Della Corte. Xeno-containers, GitLab repo. URL: https://dessert.unina.it:8088/marcobarlo/xeno-containers.
  4. Sebastian Böhm and Guido Wirtz. Profiling lightweight container platforms: Microk8s and k3s in comparison to kubernetes. In Proc. ZEUS, pages 65-73, 2021. Google Scholar
  5. A. Burns and R. I. Davis. Mixed Criticality Systems - a review. Tech Rep of the University of York, 2018. URL: https://www-users.cs.york.ac.uk/burns/review.pdf.
  6. Felipe Cerqueira and Björn Brandenburg. A comparison of scheduling latency in linux, preempt-rt, and litmus rt. In 9th Annual workshop on operating systems platforms for embedded real-time applications, pages 19-29. SYSGO AG, 2013. Google Scholar
  7. Marcello Cinque, Domenico Cotroneo, Luigi De Simone, and Stefano Rosiello. Virtualizing mixed-criticality systems: A survey on industrial trends and issues. Elsevier Future Generation Computer Systems, 2021. Google Scholar
  8. Marcello Cinque, Raffaele Della Corte, Antonio Eliso, and Antonio Pecchia. Rt-cases: Container-based virtualization for temporally separated mixed-criticality task sets. In 31st Euromicro Conference on Real-Time Systems (ECRTS 2019). Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, 2019. Google Scholar
  9. Marcello Cinque, Raffaele Della Corte, and Roberto Ruggiero. Preventing timing failures in mixed-criticality clouds with dynamic real-time containers. In 2021 17th European Dependable Computing Conference (EDCC), pages 17-24. IEEE, 2021. Google Scholar
  10. Multiple contributors. Scheduler tools /rt-app. https://github.com/scheduler-tools/rt-app. Accessed 9th June 2022.
  11. Breno Costa, Joao Bachiega Jr, Leonardo Rebouças de Carvalho, and Aleteia PF Araujo. Orchestration in fog computing: A comprehensive survey. ACM Computing Surveys (CSUR), 55(2):1-34, 2022. Google Scholar
  12. Tommaso Cucinotta, Luca Abeni, Mauro Marinoni, Riccardo Mancini, and Carlo Vitucci. Strong temporal isolation among containers in openstack for nfv services. IEEE Transactions on Cloud Computing, pages 1-1, 2021. Google Scholar
  13. N. T. Dantam et al. The ach library: A new framework for real-time communication. IEEE Robotics Automation Magazine, 22(1):76-85, 2015. Google Scholar
  14. Neil T Dantam, Daniel M Lofaro, Ayonga Hereid, Paul Y Oh, Aaron D Ames, and Mike Stilman. The ach library: A new framework for real-time communication. IEEE Robotics & Automation Magazine, 22(1):76-85, 2015. Google Scholar
  15. R.I. Davis and A. Burns. Hierarchical fixed priority pre-emptive scheduling. In 26th IEEE International Real-Time Systems Symposium (RTSS'05), pages 10 pp.-398, 2005. URL: https://doi.org/10.1109/RTSS.2005.25.
  16. Rob Davis and Alan Burns. An investigation into server parameter selection for hierarchical fixed priority pre-emptive systems. In 16th International Conference on Real-Time and Network Systems (RTNS 2008), 2008. Google Scholar
  17. Daniel Bristot de Oliveira, Daniel Casini, Rômulo Silva de Oliveira, and Tommaso Cucinotta. Demystifying the real-time linux scheduling latency. In 32nd Euromicro Conference on Real-Time Systems (ECRTS 2020). Schloss Dagstuhl-Leibniz-Zentrum für Informatik, 2020. Google Scholar
  18. Raimarius Delgado, Bum-Jae You, and Byoung Wook Choi. Real-time control architecture based on xenomai using ros packages for a service robot. Journal of Systems and Software, 151:8-19, 2019. Google Scholar
  19. Zhong Deng and JW-S Liu. Scheduling real-time applications in an open environment. In Proceedings Real-Time Systems Symposium, pages 308-319. IEEE, 1997. Google Scholar
  20. Dipartimento di Ingegneria Aerospaziale del Politecnico di Milano (DIAPM). RTAI - the RealTime Application Interface for Linux. https://www.rtai.org/. Accessed 9th June 2022.
  21. P. Emberson, R. Stafford, and R.I. Davis. Techniques for the synthesis of multiprocessor tasksets. WATERS'10, January 2010. Google Scholar
  22. Colin Ian King et al. Stress-ng GitHub repository. https://github.com/ColinIanKing/stress-ng. Accessed 9th June 2022.
  23. Cucinotta et al. Taskset generator. https://gitlab.retis.santannapisa.it/t.cucinotta/rtsim/-/blob/master/src/taskset_generator/taskgen.py. Accessed 9th June 2022.
  24. Stefano Fiori, Luca Abeni, and Tommaso Cucinotta. Rt-kubernetes—containerized real-time cloud computing. In 37th ACM/SIGAPP Symposium on Applied Computing (SAC ’22), 2022. Google Scholar
  25. The Linux Foundation. Know Limitations of PREEMPT_RT patch. https://wiki.linuxfoundation.org/realtime/documentation/known_limitations. Accessed 9th June 2022.
  26. C. Garre, D. Mundo, M. Gubitosa, and A. Toso. Real-time and real-fast performance of general-purpose and real-time operating systems in multithreaded physical simulation of complex mechanical systems. Mathematical Problems in Engineering, 2014, 2014. Google Scholar
  27. Carlos Garre, Domenico Mundo, Marco Gubitosa, and Alessandro Toso. Performance comparison of real-time and general-purpose operating systems in parallel physical simulation with high computational cost. Technical report, SAE Technical Paper, 2014. Google Scholar
  28. Tom Goethals, Filip De Turck, and Bruno Volckaert. Fledge: Kubernetes compatible container orchestration on low-resource edge devices. In International Conference on Internet of Vehicles, pages 174-189. Springer, 2019. Google Scholar
  29. T. Goldschmidt, S. Hauck-Stattelmann, S. Malakuti, and S. Grüner. Container-based architecture for flexible industrial control applications. Journal of Systems Architecture, 84:28-36, 2018. Google Scholar
  30. Thakor Bhishmapalsinh Jitendrasinh and Shripad Deshpande. Implementation of can bus protocol on xenomai rtos on arm platform for industrial automation. In 2016 International Conference on Computation of Power, Energy Information and Commuincation (ICCPEIC), pages 165-169. IEEE, 2016. Google Scholar
  31. Kuljeet Kaur, Sahil Garg, Gagangeet Singh Aujla, Neeraj Kumar, Joel JPC Rodrigues, and Mohsen Guizani. Edge computing in the industrial internet of things environment: Software-defined-networks-based edge-cloud interplay. IEEE communications magazine, 56(2):44-51, 2018. Google Scholar
  32. Jan Kiszka. Xenomai Homepage. URL: https://source.denx.de/Xenomai/xenomai/-/wikis/home. Accessed 9th June 2022.
  33. Jan Kiszka and Bernardo Wagner. Rtnet-a flexible hard real-time networking framework. In 2005 IEEE Conference on Emerging Technologies and Factory Automation, volume 1, pages 8-pp. IEEE, 2005. Google Scholar
  34. John Lehoczky, Lui Sha, and Yuqin Ding. The rate monotonic scheduling algorithm: Exact characterization and average case behavior. In RTSS, volume 89, pages 166-171, 1989. Google Scholar
  35. Jane W. S. Liu. Real-Time Systems. Prentice Hall, Upper Saddle River, NJ, 2000. Google Scholar
  36. C.-N. Mao et al. Minimizing latency of real-time container cloud for software radio access networks. In IEEE 7th International Conference on Cloud Computing Technology and Science, pages 611-616, 2015. Google Scholar
  37. José Martins, Adriano Tavares, Marco Solieri, Marko Bertogna, and Sandro Pinto. Bao: A lightweight static partitioning hypervisor for modern multi-core embedded systems. In Workshop on Next Generation Real-Time Embedded Systems (NG-RES 2020). Schloss Dagstuhl-Leibniz-Zentrum für Informatik, 2020. Google Scholar
  38. Philip Masek, Magnus Thulin, Hugo Sica de Andrade, Christian Berger, and Ola Benderius. Systematic evaluation of sandboxed software deployment for real-time software on the example of a self-driving heavy vehicle. CoRR, abs/1608.06759, 2016. URL: http://arxiv.org/abs/1608.06759.
  39. Miguel Masmano, Ismael Ripoll, Alfons Crespo, and J Metge. Xtratum: a hypervisor for safety critical embedded systems. In 11th Real-Time Linux Workshop, pages 263-272. Citeseer, 2009. Google Scholar
  40. Paul Menage. Cgroups. https://www.kernel.org/doc/Documentation/cgroup-v1/cgroups.txt. Accessed 9th June 2022.
  41. Hassan Ghasemzadeh Mohammadi, Rahil Arshad, Sneha Rautmare, Suraj Manjunatha, Maurice Kuschel, Felix Paul Jentzsch, Marco Platzner, Alexander Boschmann, and Dirk Schollbach. DeepWind: An Accurate Wind Turbine Condition Monitoring Framework via Deep Learning on Embedded Platforms. In Proc. ETFA, volume 1, pages 1431-1434, 2020. Google Scholar
  42. M. S. Mollison, J. P. Erickson, J. H. Anderson, S. K. Baruah, and J. A. Scoredos. Mixed-Criticality Real-Time Scheduling for Multicore Systems. 10th IEEE International Conference on Computer and Information Technology, Bradford, pp. 1864-1871, 2010. Google Scholar
  43. Harald Mueller, Spyridon V. Gogouvitis, Andreas Seitz, and Bernd Bruegge. Seamless computing for industrial systems spanning cloud and edge. In 2017 International Conference on High Performance Computing Simulation (HPCS), pages 209-216, 2017. Google Scholar
  44. Thorsten Piper, Stefan Winter, Oliver Schwahn, Suman Bidarahalli, and Neeraj Suri. Mitigating timing error propagation in mixed-criticality automotive systems. In 2015 IEEE 18th International Symposium on Real-Time Distributed Computing, pages 102-109. IEEE, 2015. Google Scholar
  45. Federico Reghenzani, Giuseppe Massari, and William Fornaciari. The real-time linux kernel: A survey on preempt_rt. ACM Computing Surveys (CSUR), 52(1):1-36, 2019. Google Scholar
  46. Siemens AG. Jailhouse hypervisor source code. URL: https://github.com/siemens/jailhouse.
  47. José Simó, Patricia Balbastre, Juan Francisco Blanes, José-Luis Poza-Luján, and Ana Guasque. The role of mixed criticality technology in industry 4.0. Electronics, 10(3):226, 2021. Google Scholar
  48. V. Struhár et al. Real-Time Containers: A Survey. In 2nd Workshop on Fog Computing and the IoT, volume 80 of OpenAccess Series in Informatics, pages 7:1-7:9, Dagstuhl, Germany, 2020. Google Scholar
  49. Václav Struhár, Silviu S. Craciunas, Mohammad Ashjaei, Moris Behnam, and Alessandro V. Papadopoulos. React: Enabling real-time container orchestration. In 26th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA ), pages 1-8, 2021. Google Scholar
  50. T. Tasci, J. Melcher, and A. Verl. A container-based architecture for real-time control applications. In 2018 IEEE International Conference on Engineering, Technology and Innovation (ICE/ITMC), pages 1-9, 2018. Google Scholar
  51. Lane Thames and Dirk Schaefer. Software-defined cloud manufacturing for industry 4.0. Procedia cirp, 52:12-17, 2016. Google Scholar
  52. The Linux Foundation. Homepage of LF Edge Foundation. URL: https://elisa.tech/.
  53. The Linux Foundation. Kubernetes Home Page. URL: https://kubernetes.io/.
  54. The Linux Foundation. Real-time group scheduling. https://www.kernel.org/doc/Documentation/scheduler/sched-rt-group.txt. Accessed 9th June 2022.
  55. Wind River Systems, Inc. WindRiver VxWorks Virtualization Profile. http://www.windriver.com/products/vxworks/technology-profiles/#virtualization. Accessed 9th June 2022.
  56. Sisu Xi, Meng Xu, Chenyang Lu, Linh TX Phan, Christopher Gill, Oleg Sokolsky, and Insup Lee. Real-time multi-core virtual machine scheduling in xen. In 2014 International Conference on Embedded Software (EMSOFT), pages 1-10. IEEE, 2014. Google Scholar
  57. Xilinx. RunX GitHub repository. URL: https://github.com/Xilinx/runx.
  58. Chengjing Yu, Xudong Ma, Fang Fang, Kun Qian, Shun Yao, and Yanping Zou. Design of controller system for industrial robot based on rtos xenomai. In 2017 12th IEEE Conference on Industrial Electronics and Applications (ICIEA), pages 221-226. IEEE, 2017. Google Scholar
  59. Wuyang Zhang, Sugang Li, Luyang Liu, Zhenhua Jia, Yanyong Zhang, and Dipankar Raychaudhuri. Hetero-edge: Orchestration of real-time vision applications on heterogeneous edge clouds. In IEEE INFOCOM 2019-IEEE Conference on Computer Communications, pages 1270-1278. IEEE, 2019. Google Scholar
Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail
© 2023 Schloss Dagstuhl - LZI GmbH Imprint Privacy Contact