How Do Microservice API Patterns Impact Understandability? A Controlled ExperimentResearch Paper
Microservices expose their functionality via remote Application Programming Interfaces (APIs), e.g., based on HTTP or asynchronous messaging technology. To solve recurring problems in this design space, Microservice API Patterns (MAPs) have emerged to capture the collective experience of the API design community. At present, there is a lack of empirical evidence for the effectiveness of these patterns, e.g., how they impact understandability and API usability. We therefore conducted a controlled experiment with 6 microservice patterns to evaluate their impact on understandability with 65 diverse participants. Additionally, we wanted to study how demographics like years of professional experience or experience with MAPs influence the effects of the patterns. Per pattern, we constructed two API examples, each in a pattern version “P” and a functionally equivalent non-pattern version “N” (24 in total). Based on a crossover design, participants had to answer comprehension questions, while we measured the time. For five of the six patterns, we identified a significant positive impact on understandability, i.e., participants answered faster and / or more correctly for “P”. However, effect sizes were mostly small, with one pattern showing a medium effect. The correlations between performance and demographics seem to suggest that certain patterns may introduce additional complexity; people experienced with MAPs will profit more from their effects. This has important implications for training and education around MAPs and other patterns.
Fri 7 JunDisplayed time zone: Chennai, Kolkata, Mumbai, New Delhi change
16:00 - 17:35 | Session 7B: Conformance Checking & Empirical Analysis 2Research Papers / Journal First Session Chair: Sridhar Chimalakonda, IIT Tirupathi, India | ||
16:00 25mResearch paper | How Do Microservice API Patterns Impact Understandability? A Controlled ExperimentResearch Paper Research Papers A: Justus Bogner Vrije Universiteit Amsterdam, A: Olaf Zimmermann University of Applied Sciences of Eastern Switzerland (OST), A: Pawel Wójcik University of Science and Technology in Cracow Pre-print | ||
16:25 25mResearch paper | Experimental Evaluation of Energy Efficiency Tactics in Industry: Results and Lessons LearnedResearch Paper Research Papers A: Markus Funke Vrije Universiteit Amsterdam, A: Patricia Lago Vrije Universiteit Amsterdam, A: Esther Adenekan Vrije Universiteit Amsterdam, A: Ivano Malavolta Vrije Universiteit Amsterdam, A: Ilja Heitlager Schuberg Philis Pre-print | ||
16:50 25mResearch paper | Characterizing Software Architectural Metrics for Continuous Compliance in the Automotive DomainResearch Paper Research Papers A: Tiziano Santilli Gran Sasso Science Institute (GSSI), A: Marco De Luca Federico II University of Naples, A: Patrizio Pelliccione Gran Sasso Science Institute, L'Aquila, Italy, A: Domenico Amalfitano University of Naples Federico II, A: Anna Rita Fasolino Federico II University of Naples | ||
17:15 20mPaper | Do RESTful API design rules have an impact on the understandability of Web APIs?Journal First Journal First A: Justus Bogner Vrije Universiteit Amsterdam, A: Sebastian Kotstein Reutlingen University, A: Timo Pfaff Link to publication DOI |