ZipKV: In-Memory Key-Value Store with Built-In Data Compression
This paper studies how to mitigate the speed performance loss caused by integrating block data compression into in-memory key-value~(KV) stores. Despite extensive prior research on in-memory KV stores, little focus has been given to memory usage reduction via block data compression (e.g., LZ4, ZSTD) due to potential performance degradation. This paper introduces design techniques to mitigate compression-induced performance degradation by utilizing decompression streaming, latency differences between compression and decompression, and data access locality in real-world workloads. These techniques can be incorporated into conventional hash or B$^+$-tree indexing structures, enabling integration with most in-memory KV stores without altering their core indexing data structures. For demonstration, we implemented {\it ZipKV} that incorporates the developed design techniques. Compared with RocksDB~(in-memory mode) that employs the log-structured merge tree indexing data structure with natural support of block data compression, ZipKV realizes similar memory usage reduction via block data compression, reduces the point query latency by 68%~(LZ4) and 58%~(ZSTD), and achieves up to 3.8$\times$~(LZ4) and 2.7$\times$~(ZSTD) point query throughput.
Sun 18 JunDisplayed time zone: Eastern Time (US & Canada) change
16:00 - 17:20 | |||
16:00 20mTalk | Blast from the Past: Least Expected Use (LEU) Cache Replacement with Statistical History ISMM 2023 Sayak Chakraborti University of Rochester, Zhizhou (Chris) Zhang Uber Technologies, Noah Bertram Cornell University, Sandhya Dwarkadas University of Rochester, Chen Ding University of Rochester DOI | ||
16:20 20mTalk | OMRGx: Programmable and Transparent Out-of-Core Graph Partitioning and Processing ISMM 2023 DOI | ||
16:40 20mTalk | ZipKV: In-Memory Key-Value Store with Built-In Data Compression ISMM 2023 Linsen Ma Rensselaer Polytechnic Institute, Rui Xie Rensselaer Polytechnic Institute, Tong Zhang Rensselaer Polytechnic Institute DOI | ||
17:00 20mTalk | Flexible and Effective Object Tiering for Heterogeneous Memory Systems ISMM 2023 Brandon Kammerdiener University of Tennessee, Jeffrey Zachariah McMichael University of Tennessee, Michael Jantz University of Tennessee, Kshitij Doshi Intel Corporation, Terry Jones Oak Ridge National Laboratory DOI |