Reflections on the Compatibility, Performance, and Scalability of Parallel PythonExperience Paper
Today’s hardware is increasingly parallel, and to increase performance, applications must be able to use this parallelism. Hence, programming languages must provide the means for parallel execution. The language Python offers a multithreading, shared-memory model for concurrency. However, simultaneous execution of threads, i.e., parallel execution, is not a standard feature of current virtual machines (VM) for Python. Instead, the predominant Python VMs depend on a global interpreter lock, which serializes the execution.
In a parallel VM, replicating Python’s concurrency semantics is challenging. Today, there are three parallel VMs, which use one of two approaches to address the challenges: Jython, IronPython, and PyPy-STM. These VMs use two fundamentally different approaches to synchronize parallel execution under Python’s concurrency semantics: Jython and IronPython use fine-grained locking, and PyPy-STM uses software transactional memory (STM).
The two approaches result in different performance characteristics and levels of Python compatibility for these VMs. In this paper, we report on our experience with the three parallel VMs by comparing their compatibility, performance, and scalability. The comparison shows that fine-grained locking can yield better scalability than the STM approach. However, regarding the faithful reproduction of Python’s concurrency semantics and the absolute performance, the STM approach currently has the advantage.
Sun 20 OctDisplayed time zone: Beirut change
14:00 - 15:30 | |||
14:00 30mTalk | Reflections on the Compatibility, Performance, and Scalability of Parallel PythonExperience Paper DLS 2019 | ||
14:30 30mTalk | R Melts Brains -- An IR for First-Class Environments and Lazy Effectful ArgumentsResearch Paper DLS 2019 Olivier Flückiger Northeastern University, Guido Chari Czech Technical University, Jan Ječmen Czech Technical University, Ming-Ho Yee Northeastern University, Jakob Hain Northeastern University, Jan Vitek Northeastern University Link to publication DOI Pre-print Media Attached | ||
15:00 30mTalk | Python Programmers have GPUs too: Automatic Python Loop Parallelization with Staged Dependence AnalysisResearch Paper DLS 2019 Dejice Jacob University of Glasgow, Phil Trinder University of Glasgow, Jeremy Singer University of Glasgow Link to publication DOI Authorizer link |