CXL memory devices increase the memory capacity and bandwidth available to a server, at the cost of higher access latency to the CXL, or remote memory. Prior research focused on how to make use of the expanded memory capacity provided by CXL, while minimizing the impact of its higher access latency. However, most current memory management techniques to achieve this, such as memory tiering, do not make effective use of the expanded bandwidth provided by CXL memory. These techniques place frequently accessed data in local memory, so bandwidth intensive applications will saturate the local bandwidth and leave the remote bandwidth unutilized.

We instead focus on making use of the expanded bandwidth provided by CXL memory. We design a system Adaptive Interleaving of Memory (AIM) that monitors the bandwidth utilization of the machine and chooses when and how to dynamically interleave data between local and remote memory to maximize bandwidth utilization under changing application demands for bandwidth.

With AIM, bandwidth intensive applications perform up to 26% faster than the state-of-the-art bandwidth-aware tiering system. AIM also performs similarly to state-of-the-art tiering systems when running latency sensitive applications.