ICSE 2023 (series) / ICPC 2023 (series) / Early Research Achievements (ERA) /
Evaluating a Language Workbench: from Working Memory Capacity to Comprehension to Acceptance
Mon 15 May 2023 13:54 - 13:59 at Meeting Room 106 - Human Aspects, Testing and Logs Chair(s): Michael J. Decker
Language workbenches are tools that enable the definition, reuse and composition of programming languages and their ecosystem. This breed of frameworks aims to make the development of new languages easier and more affordable. Consequently, the understandability and learnability of the language used in a language workbench (i.e., the meta-language) should be an important aspect to consider and evaluate. To the best of our knowledge, although the quantitative aspects of language workbenches are often discussed in the literature, the evaluation of understandability and learnability are typically neglected. Neverlang is a language workbench that enables the definition of languages with a modular approach. This paper presents a preliminary study that intends to assess the comprehensibility of Neverlang programs, evaluated in terms of users’ effectiveness and efficiency in a code comprehension task. The study also investigates the relationship between Neverlang comprehensibility and the users’ working memory capacity. Furthermore, we intend to capture the relationship between Neverlang comprehensibility and users’ acceptance, in terms of perceived ease of use, perceived usefulness, and intention to use. Our preliminary results on 10 subjects suggest that the users’ working memory capacity may be related to the ability to comprehend Neverlang programs. On the other hand, effectiveness and efficiency do not appear to be associated with an increase in users’ acceptance variables.
Mon 15 MayDisplayed time zone: Hobart change
Mon 15 May
Displayed time zone: Hobart change
13:45 - 15:15 | Human Aspects, Testing and LogsTool Demonstration / Discussion / Journal First / Early Research Achievements (ERA) / Research at Meeting Room 106 Chair(s): Michael J. Decker Bowling Green State University | ||
13:45 9mFull-paper | Understanding initial API comprehension Research | ||
13:54 5mShort-paper | Evaluating a Language Workbench: from Working Memory Capacity to Comprehension to Acceptance Early Research Achievements (ERA) Giovanna Broccia ISTI-CNR, FMT Lab, Alessio Ferrari CNR-ISTI, Maurice ter Beek ISTI-CNR, Pisa, Italy, Walter Cazzola Università degli Studi di Milano, Luca Favali University of Milan, Francesco Bertolotti | ||
13:59 5mShort-paper | Conversation Disentanglement As-a-Service Tool Demonstration Edoardo Riggio Software Institute - USI, Lugano, Marco Raglianti Software Institute - USI, Lugano, Michele Lanza Software Institute - USI, Lugano | ||
14:04 5mShort-paper | Slicito: Using Computational Notebooks for Program Comprehension Tool Demonstration | ||
14:09 9mTalk | Selection of human evaluators for design smell detection using dragonfly optimization algorithm: An empirical study Journal First Sultan M. Al Khatib Department of Software Engineering, Prince Abdullah bin Ghazi Faculty of Information and Communication Technology, Al-Balqa Applied University (BAU), Al-Salt, 19117, Jordan, Khalid Alkharabsheh Department of Software Engineering, Prince Abdullah bin Ghazi Faculty of Information and Communication Technology, Al-Balqa Applied University (BAU), Al-Salt, 19117, Jordan, Sadi Alawadi Center for Applied Intelligent Systems Research, School of Information Technology, Halmstad University, 30118, Halmstad, Sweden | ||
14:18 5mShort-paper | SYN: Ultra-Scale Software Evolution Comprehension Tool Demonstration Gianlorenzo Occhipinti Software Institute, USI - Lugano, Switzerland, Csaba Nagy Software Institute - USI, Lugano, Roberto Minelli Software Institute - USI, Lugano, Michele Lanza Software Institute - USI, Lugano | ||
14:23 5mShort-paper | Microusity: A testing tool for Backends for Frontends (BFF) Microservice Systems Tool Demonstration Pattarakrit Rattanukul Mahidol University, Chansida Makaranond Mahidol University, Pumipat Watanakulcharus Mahidol University, Chaiyong Ragkhitwetsagul Mahidol University, Thailand, Tanapol Nearunchorn Lineman Wongnai, Vasaka Visoottiviseth Mahidol University, Morakot Choetkiertikul Mahidol University, Thailand, Thanwadee Sunetnanta Mahidol University | ||
14:28 5mShort-paper | WebEV: A Dataset on the Behavior of Testers for Web Application End to End Testing Early Research Achievements (ERA) Fuad Mridha University of Dhaka, Kazi Sakib Institute of Information Technology, University of Dhaka | ||
14:33 5mShort-paper | Towards a Classification of Log Parsing Errors Early Research Achievements (ERA) Issam Sedki Concordia University, Wahab Hamou-Lhadj Concordia University, Montreal, Canada, Otmane Ait-Mohamed Concordia University, Naser Ezzati Jivan | ||
14:38 37mPanel | Discussion 3 Discussion |