As the market’s demand for software quality continues increasing, companies increase demand for excellent testing engineers. The online testing platform cultivates students by offering software testing courses. Students are encouraged to submit test codes by exams on the online testing platform during the course evaluation. However, how to effectively assess the test code written by students is to be solved. This paper implements a multidimensional evaluation system named META for software testing based on an online testing platform. META is designed to address the problem of how to evaluate testing effectiveness systematically. This paper evaluates students’ testing effectiveness in seven dimensions for three software testing types: developer unit testing, web application testing, and mobile application testing, combining test codes and test behaviors. For the validity of META, 14 exams are selected from MOOCTest for an experiment in this paper, of which ten exams for developer unit testing, three exams for mobile application testing, and one exam for web application testing, involving 718 students participating in the exam and 26666 records submitted. The experimental results show that META can present significant variability in different dimensions for different students with similar scores. Video URL:https://www.youtube.com/watch?v=EiCSMtefPMU
Tue 10 MayDisplayed time zone: Eastern Time (US & Canada) change
04:00 - 05:00 | |||
04:00 15mDemonstration | GIFdroid: An Automated Light-weight Tool for Replaying Visual Bug Reports DEMO - Demonstrations DOI Pre-print Media Attached | ||
04:15 15mDemonstration | TauLiM: Test Data Augmentation of LiDAR Point Cloud by Metamorphic Relation DEMO - Demonstrations Ju Lin Nanjing University, Jiawei Liu Nanjing University, Quanjun Zhang Nanjing University, Xufan Zhang Nanjing University, Chunrong Fang Nanjing University | ||
04:30 15mDemonstration | ReGVD: Revisiting Graph Neural Networks for Vulnerability Detection DEMO - Demonstrations Van-Anh Nguyen VNU - University of Science, Vietnam, Dai Quoc Nguyen Oracle Labs, Australia, Van Nguyen Monash University, Australia, Trung Le Monash University, Australia, Quan Hung Tran Adobe Research, San Jose, CA, USA, Dinh Phung Monash University, Australia Pre-print Media Attached | ||
04:45 15mDemonstration | META: Multidimensional Evaluation of Testing Ability DEMO - Demonstrations Tianqi Zhou Nanjing University, Jiawei Liu Nanjing University, Yifan Wang Shenzhen Research Institute of Nanjing University, Zhenyu Chen Nanjing University | ||