ICSME 2024
Sun 6 - Fri 11 October 2024

Unit testing is an important practice that helps ensure the quality of a software system by validating its behavior through a series of test cases. Core to these test cases are assertion statements, which enable software practitioners to validate the correctness of the system’s behavior. To aid with understanding and troubleshooting test case failures, practitioners can include a message (i.e., assertion message) within the assertion statement. While prior studies have examined the frequency and structure of assertion messages by mining software repositories, they do not determine their types or purposes or how practitioners perceive the need for or the usage of various types of assertion messages. In this paper, we survey 138 professional software practitioners to gather insights into their experience and views regarding assertion messages. Our findings reveal that a majority of survey respondents find assertion messages valuable for troubleshooting failures, improving test understandability, and serving as documentation. However, not all respondents consistently include messages in their assertion methods. We also identified common considerations for constructing effective assertion messages, challenges in crafting them, maintenance techniques, and their integration into debugging processes. Our results contribute to the understanding of current practices and provide guidelines for authoring high-quality assertion messages, serving as a foundation for best practices and coding standards. Furthermore, the insights can guide the improvement of automated unit testing tools by incorporating checks for the presence and quality of assertion messages and providing real-time feedback to practitioners.

Fri 11 Oct

Displayed time zone: Arizona change

10:30 - 12:00
Session 13: Software Development Practices and ToolsResearch Track / Journal First Track at Fremont
Chair(s): Ronnie de Souza Santos University of Calgary
10:30
15m
Towards Unmasking LGTM Smells in Code Reviews: A Comparative Study of Comment-Free and Commented ReviewsResearch Track Paper
Research Track
Mahmut Furkan Gön Bilkent University, Burak Yetistiren UCLA, Eray Tüzün Bilkent University
10:45
15m
Towards Identifying Python Proficiency to Foster Software Maintenance and EvolutionResearch Track Paper
Research Track
Ruksit Rojpaisarnkit Nara Institute of Science and Technology, Gregorio Robles Universidad Rey Juan Carlos, Raula Gaikovina Kula Osaka University, Dong Wang Tianjin University, Chaiyong Ragkhitwetsagul Mahidol University, Jesus M. Gonzalez-Barahona Universidad Rey Juan Carlos, Kenichi Matsumoto Nara Institute of Science and Technology
Pre-print
11:00
15m
Supporting Software Maintenance with Dynamically Generated Document HierarchiesResearch Track Paper
Research Track
Katherine R. Dearstyne University of Notre Dame, Alberto D. Rodriguez University of Notre Dame, Jane Cleland-Huang University of Notre Dame
11:15
15m
Investigating developers’ perception on software testability and its effectsJ1C2 Paper
Journal First Track
Tushar Sharma Dalhousie University, Stefanos Georgiou Queen's University, Maria Kechagia University College London, Taher A Ghaleb Trent University, Federica Sarro University College London
Link to publication
11:30
15m
On the Rationale and Use of Assertion Messages in Test Code: Insights from Software PractitionersOpen Research ObjectDistinguished Paper AwardResearch Track Paper
Research Track
Anthony Peruma University of Hawai‘i at Mānoa, Taryn Takebayashi University of Hawai‘i at Mānoa, Rocky Huang University of Hawai‘i at Mānoa, Joseph Carmelo Averion University of Hawai‘i at Mānoa, Veronica Hodapp Columbia University, Christian D. Newman Rochester Institute of Technology, Mohamed Wiem Mkaouer University of Michigan - Flint
Pre-print
11:45
10m
Focused: An Approach to Framework-oriented Cross-language Link Specification and DetectionVideo presentationResearch Track Paper
Research Track
Ailun Yu Peking University, Yifan Shi Peking University, Bo Shen Huawei Cloud Computing Technologies Co., Ltd., Wei Zhang Peking University, Haiyan Zhao Peking University, Guangtai Liang Huawei Cloud Computing Technologies, Tianyong Wu , Zhi Jin Peking University
File Attached