CGO 2024 (series) / Main Conference /
Seer: Predictive Runtime Kernel Selection for Irregular Problems
Modern GPUs are designed for regular problems and suffer from load imbalance when processing irregular data. Prior to our work, a domain expert selects the best kernel to map fine-grained irregular parallelism to a GPU. We instead propose Seer, an abstraction for producing a simple, reproduceable, and understandable decision tree selector model which performs runtime kernel selection for irregular workloads. To showcase our framework, we conduct a case study in Sparse Matrix Vector Multiplication (SpMV), in which Seer predicts the best strategy for a given dataset with an improvement of 2$\times$ over the best single iteration kernel across the entire SuiteSparse Matrix Collection dataset.
Mon 4 MarDisplayed time zone: London change
Mon 4 Mar
Displayed time zone: London change
14:20 - 15:40 | Compilers for GPUsMain Conference at Tinto Chair(s): Roland Leißa University of Mannheim, School of Business Informatics and Mathematics | ||
14:20 20mTalk | A Framework for Fine-Grained Synchronization of Dependent GPU Kernels Main Conference Abhinav Jangda Microsoft Research, Saeed Maleki Microsoft Research, Maryam Mehri Dehnavi University of Toronto, Madan Musuvathi Microsoft Research, Olli Saarikivi Microsoft Research Pre-print | ||
14:40 20mTalk | Enhancing Performance through Control-Flow Unmerging and Loop Unrolling on GPUs Main Conference Alnis Murtovi TU Dortmund, Giorgis Georgakoudis Lawrence Livermore National Laboratory, Konstantinos Parasyris Lawrence Livermore National Laboratory, Chunhua Liao Lawrence Livermore National Laboratory, Ignacio Laguna Lawrence Livermore National Laboratory, Bernhard Steffen TU Dortmund | ||
15:00 20mTalk | Retargeting and Respecializing GPU Workloads for Performance Portability Main Conference Ivan Radanov Ivanov Tokyo Institute of Technology; RIKEN R-CCS, Oleksandr Zinenko Google DeepMind, Jens Domke RIKEN R-CCS, Toshio Endo Tokyo Institute of Technology, William S. Moses University of Illinois at Urbana-Champaign; Google DeepMind | ||
15:20 20mTalk | Seer: Predictive Runtime Kernel Selection for Irregular Problems Main Conference Pre-print |