Preliminary Analysis of Review Method Selection Based on Bandit Algorithms
To enhance the reliability of software, it is important is to review artifacts such as design documents to remove defects earlier. There are various review methods, and project managers face the challenge of choosing a feasible method for their current projects. One of approaches to support the selection of review methods is to evaluate review methods beforehand, to identify the most effective method on average. However, past studies have not evaluated review methods thoroughly, because the evaluation is often time-consuming. We propose a new bandit-algorithm (BA) based method which evaluates candidates of review methods during review activity, and dynamically select the best one based on the evaluation. In the experiment, we assume that the proposed method is applied to design document review on basic design phase. We performed experiments based on the simulation, instead of using actual dataset. On our simulation, when review method is selected by our method, productivity (i.e., total development time) was improved by about 1.25 times, and it was the second highest among candidates of review methods.
Fri 9 DecDisplayed time zone: Osaka, Sapporo, Tokyo change
09:20 - 10:30 | Review and Natural Language ProcessingTechnical Track / ERA - Early Research Achievements at Room1 Chair(s): Renuka Sindhgatta IBM Research AI | ||
09:20 15mPaper | A checklist-based approach to assess the systematicity of the abstracts of reviews self-identifying as systematic reviews ERA - Early Research Achievements | ||
09:35 15mPaper | Preliminary Analysis of Review Method Selection Based on Bandit Algorithms ERA - Early Research Achievements Takuto Kudo Kindai University, Masateru Tsunoda Kindai University, Amjed Tahir Massey University, Kwabena Ebo Bennin Wageningen University and Research, Akito Monden Okayama University, Koji Toda Fukuoka Institute of Technology, Keitaro Nakasai National Institute of Technology, Kagoshima College, Kenichi Matsumoto Nara Institute of Science and Technology | ||
09:50 20mPaper | Reducing Syntactic Complexity for Information Extraction from Japanese Requirement Specifications Technical Track Maiko Onishi Ochanomizu University, Shinpei Ogata Shinshu University, Kozo Okano Shinshu University, Daisuke Bekki Ochanomizu University | ||
10:10 15mPaper | Quality assurance study with mismatched data in sentiment analysis ERA - Early Research Achievements Tinghui Ouyang National Institute of Advanced Industrial Science and Technology, Yoshiki Seo National Institute of Advanced Industrial Science and Technology, Yutaka Oiwa National Institute of Advanced Industrial Science and Technology |