We will open the day with a discussion about the problem of the evaluation of programming systems. What are programming systems and why are they harder to evaluate and study than programming languages?

We will present our work on developing the “technical dimensions” framework, which aims to provide useful strucutre for evaluation of programming systems. After an introduction to the framework, we’ll work together to see how it applies to interesting current programming systems (ideally developed by tutorial participants!)

What does the future of research on programming systems look like? Is there more to be added to the technical dimensions framework? Are there alternative approaches to the problem that motivated this tutorial? What would be the best next steps for the “programming systems” research community and our research?