TrueJIT - Learning and Prediction of Compilation Sequences in a Centralized JIT Compiler
This program is tentative and subject to change.
In recent years, we have witnessed the development of centralized just-in-time (JIT) compilers serving many compiler-less language virtual machine (LVM) clients at once. While centralized JIT compilation reduces CPU and memory overhead due to global code caching and code reuse, it introduces additional latency between LVM clients and the central JIT compilation server. In this paper, we investigate opportunities for hiding this latency. We explore how sequences of JIT compilation requests can be learned and predicted by the centralized JIT compiler. We train a Long Short-Term Memory (LSTM) network with JIT compilation requests and, during deployment, we use this to speculatively compile and deliver native code to the LVM clients in a true just-in-time fashion, i.e. with minimal latency for the LVM clients. We have implemented our novel scheme in a distributed WebAssembly runtime environment, and evaluated it against several benchmark suites including real-world applications from various application domains. We show that learning of JIT compilation sequences is feasible, and prediction is effective in hiding JIT compilation latency. We demonstrate that centralized JIT compilation assisted by code caching, predictive compilation and code delivery reduces JIT compilation latency by, on average, 1-2 orders of magnitude across six benchmark suites and additional complex, real-world applications.
This program is tentative and subject to change.
Tue 30 JunDisplayed time zone: Brussels, Copenhagen, Madrid, Paris change
11:00 - 12:30 | |||
11:00 30mTalk | Generating Interpreter-Specific Tracers for Meta-Tracing JIT Compilers MPLR Yusuke Izawa Tokyo Metropolitan University, CF Bolz-Tereick Heinrich-Heine-Universität Düsseldorf, Nico Rittinghaus Heinrich-Heine-Universität Düsseldorf, Hidehiko Masuhara Institute of Science Tokyo | ||
11:30 30mTalk | TrueJIT - Learning and Prediction of Compilation Sequences in a Centralized JIT Compiler MPLR Björn Franke University of Edinburgh, Tom Spink University of St Andrews, Amir Khordadi University of Edinburgh, Kim Stonehouse University of Edinburgh, United Kingdom | ||
12:00 30mTalk | Leveraging Copy-and-Patch JIT for Low-Overhead Dynamic Program Analysis MPLR Matěj Kocourek Charles University, Filip Křikava Czech Technical University in Prague, Pierre Donat-Bouillud Czech Technical University in Prague, Jan Vitek Northeastern University | ||