Sun 14 Apr 2019 14:20 - 14:45 at Garden Room - Session2

Many Virtual Execution Environments (VEEs) rely on Just-in-time (JIT) compilation technology for code generation at runtime, e.g. in Dynamic Binary Translation (DBT) systems or language Virtual Machines (VMs). While JIT compilation improves native execution performance as opposed to e.g. interpretive execution, the JIT compilation process itself introduces latency. In fact, for highly optimizing JIT compilers or compilers not specifically designed for JIT compilation, e.g. LLVM, this latency can cause a substantial overhead. While existing work has introduced asynchronously decoupled JIT compilation task farms to hide this JIT compilation latency, we show that this on its own is not sufficient to mitigate the impact of JIT compilation latency on overall performance. In this paper, we introduce a novel JIT compilation scheduling policy, which performs continuous low-cost profiling of code regions already dispatched for JIT compilation, right up to the point where compilation commences. We have integrated our novel JIT compilation scheduling approach into a commercial LLVM-based DBT system and demonstrate speedups of 1.32x on average, and up to 2.31x, over its state-of-the-art concurrent task-farm based JIT compilation scheme across the SPEC CPU2006 and BioPerf benchmark suites.

Sun 14 Apr

13:30 - 15:35: Research Papers - Session2 at Garden Room
vee-2019-papers13:30 - 13:55
Emilio G. CotaColumbia University, USA, Luca P. CarloniColumbia University, USA
vee-2019-papers13:55 - 14:20
Ruoyu ZhouUniversity of Cambridge, UK, George WortUniversity of Cambridge, UK, Marton ErdosUniversity of Cambridge, UK, Timothy M. JonesUniversity of Cambridge, UK
vee-2019-papers14:20 - 14:45
Martin KristienUniversity of Edinburgh, UK, Tom SpinkUniversity of Edinburgh, Harry WagstaffUniversity of Edinburgh, UK, Björn FrankeUniversity of Edinburgh, UK, Igor BöhmSynopsys, Austria, Nigel TophamUniversity of Edinburgh, UK
vee-2019-papers14:45 - 15:10
Haoyu LiShanghai Jiao Tong University, China, Mingyu WuShanghai Jiao Tong University, China, Binyu ZangShanghai Jiao Tong University, China, Haibo ChenShanghai Jiao Tong University, China
vee-2019-papers15:10 - 15:35
Liran FunaroTechnion, Israel, Orna Agmon Ben-YehudaTechnion, Israel, Assaf SchusterTechnion, Israel