Document Open Access Logo

Reusing Highly Optimized IR in Dynamic Compilation

Authors Andrej Pečimúth , David Leopoldseder , Petr Tůma

PDF

File

Thumbnail PDF
PDF
LIPIcs.ECOOP.2025.25.pdf
  • Filesize: 0.77 MB
  • 25 pages

Document Identifiers

Subject Classification

ACM Subject Classification
  • Software and its engineering → Dynamic compilers
  • Software and its engineering → Just-in-time compilers
  • Software and its engineering → Runtime environments
Keywords
  • code reuse
  • compilation time
  • warmup
  • remote compilation
  • dynamic compilation
  • virtual machines

Metrics

  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    0
    PDF Downloads
    0
    Metadata Views

Abstract

Virtual machines (VMs) with dynamic compilers typically specialize compiled code to the state of the running VM instance and thus cannot reuse the code between multiple runs of the same application. The JIT compiler must recompile the same methods for each run of the application separately, which can prolong the application’s warmup time. We propose a technique to reduce compilation time by reusing a highly optimized intermediate representation (IR). We achieve this by tracing compiler-interface calls during compilation. The validity of the specializations in the IR is verified during a replay stage, and the replay also facilitates the relocation of runtime object references. The IR is stored on a compilation server, which can compile it to machine code and provide the code to local or remote VM instances. We implemented a compilation server with IR caching for GraalVM, a high-performance production-grade Java Virtual Machine (JVM). We present an evaluation based on four industry-standard benchmark suites. In each suite, our approach reduces compilation time by 23.6% to 36.8% and warmup time by 13.1% to 21.2% on average while preserving peak application performance.

Cite As Get BibTex

Andrej Pečimúth, David Leopoldseder, and Petr Tůma. Reusing Highly Optimized IR in Dynamic Compilation. In 39th European Conference on Object-Oriented Programming (ECOOP 2025). Leibniz International Proceedings in Informatics (LIPIcs), Volume 333, pp. 25:1-25:25, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2025) https://doi.org/10.4230/LIPIcs.ECOOP.2025.25

Author Details

Andrej Pečimúth
  • Charles University, Prague, Czech Republic
  • Oracle Labs, Prague, Czech Republic
David Leopoldseder
  • Oracle Labs, Vienna, Austria
Petr Tůma
  • Charles University, Prague, Czech Republic

Funding

This research was supported in part by projects GAUK 74824 and SVV 260821.

References

  1. Azul. Cloud Native Compiler, 2024. Retrieved August 14, 2024. URL: https://docs.azul.com/optimizer-hub/about/cloud-native-compiler.
  2. Edd Barrett, Carl Friedrich Bolz-Tereick, Rebecca Killick, Sarah Mount, and Laurence Tratt. Virtual Machine Warmup Blows Hot and Cold. Proceedings of the ACM on Programming Languages, 1(OOPSLA), October 2017. URL: https://doi.org/10.1145/3133876.
  3. Stephen M. Blackburn, Robin Garner, Chris Hoffmann, Asjad M. Khang, Kathryn S. McKinley, Rotem Bentzur, Amer Diwan, Daniel Feinberg, Daniel Frampton, Samuel Z. Guyer, Martin Hirzel, Antony Hosking, Maria Jump, Han Lee, J. Eliot B. Moss, Aashish Phansalkar, Darko Stefanović, Thomas VanDrunen, Daniel von Dincklage, and Ben Wiedermann. The DaCapo benchmarks: Java benchmarking development and analysis. SIGPLAN Not., 41(10):169-190, October 2006. URL: https://doi.org/10.1145/1167515.1167488.
  4. Josh Bloch and Doug Lea. ThreadLocal.java in OpenJDK, 2023. Retrieved September 2, 2024. URL: https://github.com/openjdk/jdk/blob/fe9f05023e5a916b21e2db72fa5b1e8368a2c07d/src/java.base/share/classes/java/lang/ThreadLocal.java.
  5. Joao Carreira, Sumer Kohli, Rodrigo Bruno, and Pedro Fonseca. From warm to hot starts: leveraging runtimes for the serverless era. In Proceedings of the Workshop on Hot Topics in Operating Systems, HotOS '21, pages 58-64, New York, NY, USA, 2021. Association for Computing Machinery. URL: https://doi.org/10.1145/3458336.3465305.
  6. Mandy Chung. JEP 371: Hidden Classes, 2020. Retrieved February 20, 2025. URL: https://openjdk.org/jeps/371.
  7. Grzegorz Czajkowski, Laurent Daynès, and Nathaniel Nystrom. Code sharing among virtual machines. In Boris Magnusson, editor, ECOOP 2002 - Object-Oriented Programming, pages 155-177, Berlin, Heidelberg, 2002. Springer Berlin Heidelberg. URL: https://doi.org/10.1007/3-540-47993-7_7.
  8. Irwin D'Souza. Ahead Of Time Compilation: Relocation, 2018. Retrieved August 22, 2024. URL: https://blog.openj9.org/2018/10/26/ahead-of-time-compilation-relocation/.
  9. Irwin D'Souza. Ahead Of Time Compilation: Validation, 2018. Retrieved August 22, 2024. URL: https://blog.openj9.org/2018/11/08/ahead-of-time-compilation-validation/.
  10. Gilles Duboscq, Lukas Stadler, Thomas Wuerthinger, Doug Simon, Christian Wimmer, and Hanspeter Mössenböck. Graal IR: An Extensible Declarative Intermediate Representation. In Proceedings of the Asia-Pacific Programming Languages and Compilers Workshop, February 2013. URL: http://ssw.jku.at/General/Staff/GD/APPLC-2013-paper_12.pdf.
  11. Gilles Duboscq, Thomas Würthinger, Lukas Stadler, Christian Wimmer, Doug Simon, and Hanspeter Mössenböck. An Intermediate Representation for Speculative Optimizations in a Dynamic Compiler. In Proceedings of the 7th ACM Workshop on Virtual Machines and Intermediate Languages, VMIL '13, pages 1-10, New York, NY, USA, 2013. Association for Computing Machinery. URL: https://doi.org/10.1145/2542142.2542143.
  12. Stephen J. Fink and Feng Qian. Design, implementation and evaluation of adaptive recompilation with on-stack replacement. In Proceedings of the International Symposium on Code Generation and Optimization: Feedback-Directed and Runtime Optimization, CGO '03, pages 241-252, USA, 2003. IEEE Computer Society. URL: https://doi.org/10.1109/CGO.2003.1191549.
  13. Apache Software Foundation. CodeGenerator.scala in Apache Spark, 2025. Retrieved February 20, 2025. URL: https://github.com/apache/spark/blob/bbb9c2c1878e200d9012d2322d979ae794b1d41d/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala#L1516.
  14. Andy Georges, Dries Buytaert, and Lieven Eeckhout. Statistically rigorous Java performance evaluation. In Proceedings of the 22nd Annual ACM SIGPLAN Conference on Object-Oriented Programming Systems, Languages and Applications, OOPSLA '07, pages 57-76, New York, NY, USA, 2007. Association for Computing Machinery. URL: https://doi.org/10.1145/1297027.1297033.
  15. Dan Heidinga. Choose your own performance; a Project Leyden update, 2024. Retrieved August 23, 2024. URL: https://openjdk.org/projects/leyden/slides/leyden-heidinga-devnexus-2024-03.pdf.
  16. Urs Hölzle, Craig Chambers, and David Ungar. Debugging optimized code with dynamic deoptimization. In Proceedings of the ACM SIGPLAN 1992 Conference on Programming Language Design and Implementation, PLDI '92, pages 32-43, New York, NY, USA, 1992. Association for Computing Machinery. URL: https://doi.org/10.1145/143095.143114.
  17. IBM. Introduction to class data sharing, 2024. Retrieved August 14, 2024. URL: https://eclipse.dev/openj9/docs/shrc/.
  18. Alexey Khrabrov. Disaggregated Just-in-Time Compilation for the Java Virtual Machine. PhD thesis, University of Toronto, June 2024. URL: http://hdl.handle.net/1807/140205.
  19. Alexey Khrabrov, Marius Pirvu, Vijay Sundaresan, and Eyal de Lara. JITServer: Disaggregated Caching JIT Compiler for the JVM in the Cloud. In 2022 USENIX Annual Technical Conference (USENIX ATC 22), pages 869-884, Carlsbad, CA, July 2022. USENIX Association. URL: https://www.usenix.org/conference/atc22/presentation/khrabrov.
  20. Thomas Kotzmann, Christian Wimmer, Hanspeter Mössenböck, Thomas Rodriguez, Kenneth Russell, and David Cox. Design of the Java HotSpot™ client compiler for Java 6. ACM Transactions on Architecture and Code Optimization, 5(1), May 2008. URL: https://doi.org/10.1145/1369396.1370017.
  21. Vladimir Kozlov. JEP 295: Ahead-of-Time Compilation, 2018. Retrieved September 2, 2024. URL: https://openjdk.org/jeps/295.
  22. Vladimir Kozlov. JEP 410: Remove the Experimental AOT and JIT Compiler, 2021. Retrieved September 2, 2024. URL: https://openjdk.org/jeps/410.
  23. Ioi Lam, Dan Heidinga, and John Rose. JEP 483: Ahead-of-Time Class Loading & Linking, 2024. Retrieved August 27, 2024. URL: https://openjdk.org/jeps/483.
  24. Han B. Lee, Amer Diwan, and J. Eliot B. Moss. Design, implementation, and evaluation of a compilation server. ACM Transactions on Programming Languages and Systems, 29(4):18-es, August 2007. URL: https://doi.org/10.1145/1255450.1255451.
  25. Tim Lindholm, Frank Yellin, Gilad Bracha, Alex Buckley, and Daniel Smith. The Java® Virtual Machine Specification: Initialization, chapter 5.5. Oracle, Java SE 22 edition, 2024. URL: https://docs.oracle.com/javase/specs/jvms/se22/html/jvms-5.html#jvms-5.5.
  26. Meetesh Kalpesh Mehta, Sebastián Krynski, Hugo Musso Gualandi, Manas Thakur, and Jan Vitek. Reusing just-in-time compiled code. Proceedings of the ACM on Programming Languages, 7(OOPSLA2), October 2023. URL: https://doi.org/10.1145/3622839.
  27. Oracle. LambdaMetafactory.java in OpenJDK, 2021. Retrieved March 2, 2025. URL: https://github.com/openjdk/jdk/blob/fe9f05023e5a916b21e2db72fa5b1e8368a2c07d/src/java.base/share/classes/java/lang/invoke/LambdaMetafactory.java.
  28. Oracle. GraalVM Overview, 2024. Retrieved August 14, 2024. URL: https://www.graalvm.org/latest/docs/introduction/.
  29. Oracle. HotSpot Internals, 2024. Retrieved August 14, 2024. URL: https://wiki.openjdk.org/display/HotSpot.
  30. Oracle. Project CRaC, 2024. Retrieved August 14, 2024. URL: https://openjdk.org/projects/crac.
  31. Oracle. Auxiliary Engine Caching, 2025. Retrieved February 26, 2025. URL: https://www.graalvm.org/latest/graalvm-as-a-platform/language-implementation-framework/AuxiliaryEngineCachingEnterprise/.
  32. Oracle. Native Image, 2025. Retrieved February 26, 2025. URL: https://www.graalvm.org/latest/reference-manual/native-image/.
  33. Oracle. Truffle AOT Overview , 2025. Retrieved February 26, 2025. URL: https://www.graalvm.org/latest/graalvm-as-a-platform/language-implementation-framework/AOTOverview/.
  34. Guilherme Ottoni and Bin Liu. HHVM jump-start: boosting both warmup and steady-state performance at scale. In Proceedings of the 2021 IEEE/ACM International Symposium on Code Generation and Optimization, CGO '21, pages 340-350. IEEE Press, 2021. URL: https://doi.org/10.1109/CGO51591.2021.9370314.
  35. Michael Paleczny, Christopher Vick, and Cliff Click. The Java HotSpot™ server compiler. In Proceedings of the 2001 Symposium on JavaTM Virtual Machine Research and Technology Symposium - Volume 1, JVM'01, page 1, USA, 2001. USENIX Association. Google Scholar
  36. Andrej Pečimúth, David Leopoldseder, and Petr Tůma. Diagnosing Compiler Performance by Comparing Optimization Decisions. In Proceedings of the 20th ACM SIGPLAN International Conference on Managed Programming Languages and Runtimes, MPLR 2023, pages 47-61, New York, NY, USA, 2023. Association for Computing Machinery. URL: https://doi.org/10.1145/3617651.3622994.
  37. Andrej Pečimúth, David Leopoldseder, and Petr Tůma. An Analysis of Compiled Code Reusability in Dynamic Compilation. In Proceedings of the 16th ACM SIGPLAN International Workshop on Virtual Machines and Intermediate Languages, VMIL '24, pages 43-53, New York, NY, USA, 2024. Association for Computing Machinery. URL: https://doi.org/10.1145/3689490.3690406.
  38. Aleksandar Prokopec, Gilles Duboscq, David Leopoldseder, and Thomas Würthinger. An optimization-driven incremental inline substitution algorithm for just-in-time compilers. In Proceedings of the 2019 IEEE/ACM International Symposium on Code Generation and Optimization, CGO 2019, pages 164-179. IEEE Press, 2019. URL: https://doi.org/10.1109/CGO.2019.8661171.
  39. Aleksandar Prokopec, Andrea Rosà, David Leopoldseder, Gilles Duboscq, Petr Tůma, Martin Studener, Lubomír Bulej, Yudi Zheng, Alex Villazón, Doug Simon, Thomas Würthinger, and Walter Binder. Renaissance: Benchmarking Suite for Parallel Applications on the JVM. In Proc. 40th ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI), page 17, 2019. URL: https://doi.org/10.1145/3314221.3314637.
  40. John Rose. JEP 243: Java-Level JVM Compiler Interface, 2019. Retrieved February 27, 2025. URL: https://openjdk.org/jeps/243.
  41. John Rose. ClassValue.java in OpenJDK, 2024. Retrieved September 2, 2024. URL: https://github.com/openjdk/jdk/blob/b1163bcc88a5b88b9a56d5584310f1d679690ab2/src/java.base/share/classes/java/lang/ClassValue.java.
  42. John Rose. JEP draft: Ahead-of-Time Code Compilation, 2025. Retrieved February 25, 2025. URL: https://openjdk.org/jeps/8335368.
  43. Manuel Serrano. JavaScript AOT compilation. In Proceedings of the 14th ACM SIGPLAN International Symposium on Dynamic Languages, DLS 2018, pages 50-63, New York, NY, USA, 2018. Association for Computing Machinery. URL: https://doi.org/10.1145/3276945.3276950.
  44. Andreas Sewe, Mira Mezini, Aibek Sarimbekov, and Walter Binder. Da Capo con Scala: Design and Analysis of a Scala Benchmark Suite for the Java Virtual Machine. In Proceedings of the 26th Conference on Object-Oriented Programming, Systems, Languages and Applications, OOPSLA '11, pages 657-676, New York, NY, USA, 2011. ACM. URL: https://doi.org/10.1145/2076021.2048118.
  45. Thomas Würthinger, Christian Wimmer, Andreas Wöß, Lukas Stadler, Gilles Duboscq, Christian Humer, Gregor Richards, Doug Simon, and Mario Wolczko. One VM to rule them all. In Proceedings of the 2013 ACM International Symposium on New Ideas, New Paradigms, and Reflections on Programming & Software, Onward! 2013, pages 187-204, New York, NY, USA, 2013. Association for Computing Machinery. URL: https://doi.org/10.1145/2509578.2509581.
  46. Xiaoran Xu, Keith Cooper, Jacob Brock, Yan Zhang, and Handong Ye. ShareJIT: JIT Code Cache Sharing across Processes and Its Practical Implementation. Proceedings of the ACM on Programming Languages, 2(OOPSLA), October 2018. URL: https://doi.org/10.1145/3276494.
  47. Jiangli Zhou. Java Class Pre-resolution and Pre-initialization, 2020. Retrieved February 27, 2025. URL: https://cr.openjdk.org/~jiangli/Leyden/Java%20Class%20Pre-resolution%20and%20Pre-initialization%20(OpenJDK).pdf.
  48. Jiangli Zhou and Thomas Schatzl. Caching Java Heap Objects, 2019. Retrieved February 20, 2025. URL: https://wiki.openjdk.org/display/HotSpot/Caching+Java+Heap+Objects.
Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail
© 2023-2025 Schloss Dagstuhl – LZI GmbH About DROPS Imprint Privacy Contact