Write a Blog >>

The promise of many distributed system frameworks (such as Spark, Flink, Heron to name a few) is that the programmer may write her software in such a way that treats a collection of physically discrete compute resources as a single giant computer. This abstraction is exactly the way that most developers want to interact with a collection of resources: the programmer will provide the computational logic and the framework will handle the messy business of work distribution, job scheduling, retries and computational result collation/reassembly. This attractive abstraction of a single giant computer has a number of lurking sharp edges and leaks - the gap between the promise and the reality of an implementation. This talk explores the gap between the pristine theoretical model of these computational frameworks, the messy real world implementations of those frameworks, and how we could find better ways to communicate the sharp edges of a leaky abstraction.

Tue 20 Jun

10:25 - 12:45: Curry On Talks - Tuesday - 10:25 - 12:45 - Auditorium at Auditorium, Vertex Building
curryon-2017-papers10:25 - 11:05
Daniel KingBroad Institute
curryon-2017-papers11:15 - 11:55
Jean YangCarnegie Mellon University
curryon-2017-papers12:05 - 12:45
Mark AllenAlert Logic