“It Looks Like You’re Writing a Parallel Loop” - A Machine Learning Based Parallelization Assistant
Despite decades of research into parallelizing compiler technology, software parallelization remains a largely manual task where the key resource is expert time. In this paper we focus on the time-consuming task of identifying those loops in a program, which are both worthwhile and feasible to parallelize. We present a methodology and tool which make better use of expert time by guiding their effort directly towards those loops, where the largest performance gains can be expected while keeping analysis and transformation effort at a minimum. We have developed a novel parallelization assistant that provides programmers with a ranking of all loops in a program based on their overall merit. For each loop this metric combines its potential contribution to speedup and an estimated probability for its successful parallelization. This probability is predicted using a machine learning model, which has been trained, validated, and tested on 1415 labelled loops, achieving a prediction accuracy greater than 90%. We have evaluated our parallelization assistant against sequential C applications from the SNU NAS benchmark suite. We show that our novel methodology achieves parallel performance levels comparable to those from expert programmers while requiring less expert time. On average, our assistant reduces the number of lines of code that have to be inspected manually before reaching expert-level parallel speedup by 20%.
Tue 22 OctDisplayed time zone: Beirut change
09:00 - 10:30 | |||
09:00 25mTalk | “It Looks Like You’re Writing a Parallel Loop” - A Machine Learning Based Parallelization Assistant AI-SEPS Aleksandr Maramzin University of Edinburgh, Christos Vasiladiotis University of Edinburgh, Roberto Castañeda Lozano University of Edinburgh, Murray Cole University of Edinburgh, Björn Franke University of Edinburgh, UK DOI | ||
09:25 15mTalk | Automatic Identification of Standard Template Algorithms in Raw Loops AI-SEPS Yannic Fischler TU Darmstadt, Jan-Patrick Lehr Graduate School of Computational Engineering, TU Darmstadt, Christian Bischof Scientific Computing, TU Darmstadt, Matthäus Magnus Kiehn TU Darmstadt DOI |