NUMAlloc: A Faster NUMA Memory Allocator
The NUMA architecture accommodates the hardware trend of an increasing number of CPU cores. It requires the cooperation of memory allocators to achieve good performance for multithreaded applications. Unfortunately, existing allocators do not support NUMA architecture well.
This paper presents a novel memory allocator – \texttt{NUMAlloc}, that is designed for the NUMA architecture. \NM{} is centered on a binding-based memory management. On top of it, \NM{} proposes an origin-aware memory management'' to ensure the locality of memory allocations and deallocations, as well as a method called
incremental sharing'' to balance the performance benefits and memory overhead of using transparent huge pages.
According to our extensive evaluation, \texttt{NUMAlloc} has the best performance among all evaluated allocators, running 15.7% faster than the second-best allocator (mimalloc), and 20.9% faster than the default Linux allocator with reasonable memory overhead.
\texttt{NUMAlloc} is also scalable to 128 threads and is ready for deployment.
Sun 18 JunDisplayed time zone: Eastern Time (US & Canada) change
14:00 - 15:20 | ISMM: Session 4 - Allocations and Garbage CollectionISMM 2023 at Magnolia 22 Chair(s): Tony Hosking Australian National University | ||
14:00 20mTalk | Concurrent GCs and Modern Java Workloads: A Cache PerspectiveBest Paper Award ISMM 2023 Maria Carpen-Amarie Huawei Zurich Research Center, Switzerland, Georgios Vavouliotis Huawei Zurich Research Center, Switzerland, Konstantinos Tovletoglou Huawei Zurich Research Center, Switzerland, Boris Grot University of Edinburgh, UK, Rene Mueller Huawei Zurich Research Center, Switzerland DOI | ||
14:20 20mTalk | Wait-Free Weak Reference Counting ISMM 2023 DOI | ||
14:40 20mTalk | NUMAlloc: A Faster NUMA Memory Allocator ISMM 2023 Hanmei Yang University of Massachusetts Amherst, Xin Zhao University of Massachusetts Amherst, Jin Zhou University of Massachusetts Amherst, Wei Wang University of Texas at San Antonio, USA, Sandip Kundu University of Massachusetts Amherst, Bo Wu Colorado School of Mines, Hui Guan University of Massachusetts, Amherst, Tongping Liu University of Massachusetts at Amherst DOI | ||
15:00 20mTalk | Picking a CHERI Allocator: Security and Performance Considerations ISMM 2023 Jacob Bramley Arm, Dejice Jacob University of Glasgow, UK, Andrei Lascu King's College London, Jeremy Singer University of Glasgow, Laurence Tratt King's College London, Andrei Lascu King's College London DOI Pre-print |