Tail Latency in Node.js: Energy Efficient Turbo Boosting for Long Tail Requests in JavaScript
Cloud-based Web services are shifting to the event-driven, scripting language-based programming model to achieve productivity, flexibility, and scalability. Implementations of this model, however, generally suffer from long tail latencies, which we measure using Node.js as a case study. Unlike in traditional thread-based systems, reducing long tails is difficult in event-driven systems due to their inherent asynchronous programming model. We propose a framework to identify and optimize tail latency sources in scripted event-driven Web services. We introduce profiling that allows us to gain deep insights into not only how asynchronous event-driven execution impacts application tail latency but also how the managed runtime system overhead exacerbates the tail latency issue further. Using the profiling framework, we propose an event-driven execution runtime design that orchestrates the hardware’s boosting capabilities to reduce tail latency. We achieve higher tail latency reductions with lower energy overhead than prior techniques that are unaware of the underlying event-driven program execution model. The lessons we derive from Node.js apply to other event-driven services based on scripting language frameworks.
Sun 14 AprDisplayed time zone: Eastern Time (US & Canada) change
16:00 - 18:05 | |||
16:00 25mTalk | QuickCheck: Using Speculation to Reduce the Overhead of Checks in NVM Frameworks Research Papers Thomas Shull University of Illinois at Urbana-Champaign, Jian Huang University of Illinois at Urbana-Champaign, Josep Torrellas University of Illinois at Urbana-Champaign | ||
16:25 25mTalk | Tail Latency in Node.js: Energy Efficient Turbo Boosting for Long Tail Requests in JavaScript Research Papers Wenzhi Cui Google, Daniel Richins The University of Texas at Austin, Yuhao Zhu University of Rochester, Vijay Janapa Janapa Reddi Harvard University | ||
16:50 25mTalk | Dynamic Application Reconfiguration on Heterogeneous Hardware Research Papers Juan Fumero University of Manchester, UK, Michail Papadimitriou University of Manchester, UK, Foivos S. Zakkak University of Manchester, UK, Maria Xekalaki University of Manchester, UK, James Clarkson University of Manchester, UK, Christos Kotselidis University of Manchester, UK DOI Authorizer link | ||
17:15 25mTalk | vSocket: Virtual Socket Interface for RDMA in Public Clouds Research Papers Dongyang Wang University of Science and Technology of China, China, Binzhang Fu Huawei Technologies, n.n., Gang Lu Huawei Technologies, n.n., Kun Tan Huawei Technologies, n.n., Bei Hua Huawei Technologies, n.n. / University of Science and Technology of China, China | ||
17:40 25mTalk | vCPU as a Container: Towards Accurate CPU Allocation for VMs Research Papers Li Liu George Mason University, USA, Haoliang Wang Adobe Research, USA, An Wang Case Western Reserve University, USA, Mengbai Xiao Ohio State University, USA, Yue Cheng George Mason University, USA, Songqing Chen George Mason University, USA |