The Sharp Edges of Leaky Abstraction
The promise of many distributed system frameworks (such as Spark, Flink, Heron to name a few) is that the programmer may write her software in such a way that treats a collection of physically discrete compute resources as a single giant computer. This abstraction is exactly the way that most developers want to interact with a collection of resources: the programmer will provide the computational logic and the framework will handle the messy business of work distribution, job scheduling, retries and computational result collation/reassembly. This attractive abstraction of a single giant computer has a number of lurking sharp edges and leaks - the gap between the promise and the reality of an implementation. This talk explores the gap between the pristine theoretical model of these computational frameworks, the messy real world implementations of those frameworks, and how we could find better ways to communicate the sharp edges of a leaky abstraction.
Tue 20 JunDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
10:25 - 12:45 | |||
10:25 40mTalk | Building Tools and Languages for Terabyte Scale Biology: A Call to Action Curry On Talks Daniel King Broad Institute | ||
11:15 40mTalk | Preventing Information Leaks by Construction Curry On Talks Jean Yang Carnegie Mellon University | ||
12:05 40mTalk | The Sharp Edges of Leaky Abstraction Curry On Talks Mark Allen Alert Logic |