2026-08-16T19:56:32Z https://drops.dagstuhl.de/oai

oai:drops-oai.dagstuhl.de:24304 2025-12-12T15:04:34Z ddc:004 open_access

On the Effectiveness of Interpreter-Guided Compiler Testing Lochbaum, Federico Polito, Guillermo Virtual Machines Concolic Testing JIT compilers interpreters Differential Testing Constraint Mutations Compiler Coverage Guaranteeing that a compiler behaves correctly is a complex task often approached through test generation and fuzzing. Compiler test generation must not only ensure that a compiler generates code that does not break, but also that it implements the programming language semantics. Recently, interpreter-guided test generation has been proposed to test JIT compilers: Concolic-execution on the interpreter yields test cases for the language semantics which are then validated between differential testing of the interpreter and compiler. In previous work, this solution has been shown to find interpreter/compiler differences. However, little has been said about the effectiveness and the solution limits. In this paper we study the behavior of this technique, to shed light on future improvements and research. We experiment with this technique on the JIT compiler for the Pharo programming language, on two different backends: ARMv7 and x86. We explore how effective the solution is in terms of compiler coverage and its limitations, and we discuss how future research can overcome them. Moreover, we investigate how this technique combined with random constraint mutations increases backend compiler coverage. Schloss Dagstuhl – Leibniz-Zentrum für Informatik Federico Lochbaum and Guillermo Polito 2025 Is Part Of OASIcs, Volume 134, Companion Proceedings of the 9th International Conference on the Art, Science, and Engineering of Programming (Programming 2025) InProceedings Text doc-type:ResearchArticle publishedVersion application/pdf doi:10.4230/OASIcs.Programming.2025.20 urn:nbn:de:0030-drops-243040 https://drops.dagstuhl.de/entities/document/10.4230/OASIcs.Programming.2025.20 eng https://creativecommons.org/licenses/by/4.0/legalcode