Write a Blog >>
VEE 2017
Sat 8 - Sun 9 April 2017 Xi'an, China
Sun 9 Apr 2017 14:30 - 15:00 at Zhu Que Room - Memory Chair(s): Tim Harris

Hypervisor-based virtualization solutions reveal good security and isolation, while container-based solutions make applications and workloads more portable and distributed in an effective, standardized and repeatable way. There- fore, nested virtualization based computing environments (e.g., container over virtual machine), which inherit the capabilities from both solutions, are becoming more and more attractive in clouds (e.g., running Docker on Amazon EC2 VMs). Recent studies have shown that running applications in either VMs or containers still has significant overhead, especially for I/O intensive workloads. This motivates us to investigate whether the nested virtualization based solution can be adopted to build high-performance computing (HPC) clouds for running MPI applications efficiently and where the bottlenecks lie. To eliminate performance bottlenecks, we propose a high-performance two-layer locality and NUMA aware MPI library, which is able to dynamically detect co-resident containers inside one VM as well as detect co-resident VM inside one host at MPI run- time. Thus the MPI processes across different containers and VMs can communicate to each other by shared memory or Cross Memory Attach (CMA) channels instead of network channel if they are co-resident. We further propose an enhanced NUMA aware hybrid design to utilize InfiniBand loopback based channel to optimize large message transfer across containers when they are running on differ- ent sockets. Performance evaluations show that compared with the performance of the state-of-art design, our pro- posed enhance-hybrid design can bring up to 184%, 81% and 12% benefit on point-to-point, collective operations, and end applications. Compared to the default performance, our enhanced-hybrid design delivers up to 184%, 85% and 16% performance improvement.

Sun 9 Apr

vee-2017-Session-5
14:00 - 15:30: Session 5 - Memory at Zhu Que Room
Chair(s): Tim HarrisOracle Labs
vee-2017-Session-514:00 - 14:30
Talk
Ahmed HusseinPurdue University / Huawei, USA, Mathias PayerPurdue University, Tony HoskingAustralian National University, Data61, and Purdue University, Christopher A. VickQualcomm
vee-2017-Session-514:30 - 15:00
Talk
Jie Zhang, Xiaoyi LuOhio State University, Dhabaleswar K. PandaOhio State University
vee-2017-Session-515:00 - 15:30
Talk
Kai LuCollege of Computer, National University of Defense Technology, Changsha, PR China, Wenzhe ZhangCollege of Computer, National University of Defense Technology, Changsha, PR China, Xiaoping WangCollege of Computer, National University of Defense Technology, Changsha, PR China, Mikel Lujan, Andy NisbetThe University of Manchester
File Attached