Sun 14 Apr 2019 16:25 - 16:50 at Garden Room - Session3

Cloud-based Web services are shifting to the event-driven, scripting language-based programming model to achieve productivity, flexibility, and scalability. Implementations of this model, however, generally suffer from long tail latencies, which we measure using Node.js as a case study. Unlike in traditional thread-based systems, reducing long tails is difficult in event-driven systems due to their inherent asynchronous programming model. We propose a framework to identify and optimize tail latency sources in scripted event-driven Web services. We introduce profiling that allows us to gain deep insights into not only how asynchronous event-driven execution impacts application tail latency but also how the managed runtime system overhead exacerbates the tail latency issue further. Using the profiling framework, we propose an event-driven execution runtime design that orchestrates the hardware’s boosting capabilities to reduce tail latency. We achieve higher tail latency reductions with lower energy overhead than prior techniques that are unaware of the underlying event-driven program execution model. The lessons we derive from Node.js apply to other event-driven services based on scripting language frameworks.

Sun 14 Apr

Displayed time zone: Eastern Time (US & Canada) change

16:00 - 18:05
16:00
25m
Talk
QuickCheck: Using Speculation to Reduce the Overhead of Checks in NVM Frameworks
Research Papers
Thomas Shull University of Illinois at Urbana-Champaign, Jian Huang University of Illinois at Urbana-Champaign, Josep Torrellas University of Illinois at Urbana-Champaign
16:25
25m
Talk
Tail Latency in Node.js: Energy Efficient Turbo Boosting for Long Tail Requests in JavaScript
Research Papers
Wenzhi Cui Google, Daniel Richins The University of Texas at Austin, Yuhao Zhu University of Rochester, Vijay Janapa Janapa Reddi Harvard University
16:50
25m
Talk
Dynamic Application Reconfiguration on Heterogeneous Hardware
Research Papers
Juan Fumero University of Manchester, UK, Michail Papadimitriou University of Manchester, UK, Foivos S. Zakkak University of Manchester, UK, Maria Xekalaki University of Manchester, UK, James Clarkson University of Manchester, UK, Christos Kotselidis University of Manchester, UK
DOI Authorizer link
17:15
25m
Talk
vSocket: Virtual Socket Interface for RDMA in Public Clouds
Research Papers
Dongyang Wang University of Science and Technology of China, China, Binzhang Fu Huawei Technologies, n.n., Gang Lu Huawei Technologies, n.n., Kun Tan Huawei Technologies, n.n., Bei Hua Huawei Technologies, n.n. / University of Science and Technology of China, China
17:40
25m
Talk
vCPU as a Container: Towards Accurate CPU Allocation for VMs
Research Papers
Li Liu George Mason University, USA, Haoliang Wang Adobe Research, USA, An Wang Case Western Reserve University, USA, Mengbai Xiao Ohio State University, USA, Yue Cheng George Mason University, USA, Songqing Chen George Mason University, USA