MemSweeper: Virtualizing Cluster Memory Management for High Memory Utilization and Isolationvirtual
Wed 15 Jun 2022 02:00 - 02:30 at Rousseau East - Session B
Memory caches are critical components of modern web services that improve response times and reduce the load on backend databases. In multi-tenant clouds, several instances of caches compete for memory. The current state-of-the-art is to statically allocate memory for cache instances (e.g., based on cost-tier) but such allocation tends to be sub-optimal as memory demands of instances often vary with time and not known apriori. We propose MemSweeper, which dynamically manages memory between cache instances. MemSweeper uses a novel, score-based metric and an associated algorithm to identify cache instances whose working sets fit well within their allocated memory and thus can relinquish a portion of the memory without suffering appreciable loss in their hit rates. Using a combination of synthetic and production traces on a real implementation, we show that MemSweeper achieves 74% improvement (on average) in the miss rate of critical tenants without degrading the performance of other tenants.
Tue 14 JunDisplayed time zone: Pacific Time (US & Canada) change
14:00 - 16:00 | |||
14:00 30mTalk | MemSweeper: Virtualizing Cluster Memory Management for High Memory Utilization and Isolationvirtual ISMM 2022 AmirHossein Seyri University of Illinois at Chicago, Abhisek Pan Microsoft, Balajee Vamanan University of Illinois at Chicago | ||
14:30 30mTalk | Replication-based Object Persistence by Reachabilityvirtual ISMM 2022 Kotaro Matsumoto Kochi University of Technology, Tomoharu Ugawa University of Tokyo, Hideya Iwasaki University of Electro-Communications, Japan | ||
15:00 30mTalk | Concurrent and Parallel Garbage Collection for Lightweight Threads on Multicore Processorsvirtual ISMM 2022 | ||
15:30 30mBreak | Social breaksocial ISMM 2022 |
Wed 15 JunDisplayed time zone: Pacific Time (US & Canada) change
02:00 - 04:00 | |||
02:00 30mTalk | MemSweeper: Virtualizing Cluster Memory Management for High Memory Utilization and Isolationvirtual ISMM 2022 AmirHossein Seyri University of Illinois at Chicago, Abhisek Pan Microsoft, Balajee Vamanan University of Illinois at Chicago | ||
02:30 30mTalk | Replication-based Object Persistence by Reachabilityvirtual ISMM 2022 Kotaro Matsumoto Kochi University of Technology, Tomoharu Ugawa University of Tokyo, Hideya Iwasaki University of Electro-Communications, Japan | ||
03:00 30mTalk | Concurrent and Parallel Garbage Collection for Lightweight Threads on Multicore Processorsvirtual ISMM 2022 | ||
03:30 30mBreak | Social breaksocial ISMM 2022 |