PROFES 2024
Mon 2 - Wed 4 December 2024 Tartu, Estonia

User reviews on software platforms offer direct evaluations and attitudes of the software packages, serving as invaluable sources for assessing software quality. However, the large amount of noise, as well as the time-consuming processing of software user reviews, prevents software engineers from effectively utilizing this resource. This work introduces ISOftSentiment, a novel hybrid sentiment analysis tool that addresses this problem and helps software engineers efficiently evaluate what other users think about the quality of software packages from software user reviews. It enhances software quality assessment by integrating sentiment analysis with ISO/IEC 25010:2023 Established Product Quality Model and a fuzzy consensus mechanism. We selected four candidate models for sentiment analysis. These models were trained with 4,062 user reviews from three software review platforms. After an extensive evaluation of the models, we found that the fine-tuned BERT-BiLSTM model achieved the best score with 0.814 accuracy, 0.806 F1, 0.813 precision, and 0.810 recall. Utilizing this model, ISOftSentimen analyzed 51,178 review sentences. The quality analysis outcomes are visualized as a matrix to show the relevant quality attributes of particular software packages. ISOftSentiment provides an approach to assess the quality of specific software packages and visualization of detailed quality attribute analysis through a sentiment matrix, helping software engineers make informed software package selection decisions.

Tue 3 Dec

Displayed time zone: Athens change

11:00 - 12:30
PROFES Session 2: Human Factors in Software EngineeringResearch Papers / Short Papers and Posters at UT Library - Room 3 (Seminar Room Kodavere)
Chair(s): Silverio Martínez-Fernández UPC-BarcelonaTech
11:00
12m
Short-paper
Supporting value-aware software engineering through traceability and value tactics
Short Papers and Posters
Rebekka Wohlrab Chalmers University of Technology, Marc Herrmann Leibniz Universität Hannover, Christopher Lazik , Marvin Wyrich Saarland University, Ines Nunes , Kurt Schneider Leibniz Universität Hannover, Software Engineering Group, Lucas Gren Chalmers | University of Gothenburg, Robert Heinrich Karlsruhe Institute of Technology (KIT)
11:12
18m
Research paper
On Job Demands and Resources in the Italian Software Industry
Research Papers
Simone Romano University of Salerno, Alberto Conforti University of Turin, Gloria Guidetti University of Torino, Sara Viotti University of Torino, Daniela Converso University of Torino, Giuseppe Scanniello University of Salerno
11:30
18m
Research paper
Interest in Working Remotely: Is Gender a Factor?
Research Papers
Panagiota Chatzipetrou , Darja Šmite Blekinge Institute of Technology, Anastasiia Tkalich SINTEF, Nils Brede Moe SINTEF, Eriks Klotins Blekinge Institute of Technology
11:48
18m
Research paper
Evaluating Software Quality Through User Reviews: The ISOftSentiment Tool
Research Papers
Fang Hou Utrecht University, Liang Feng Utrecht University, Siamak Farshidi , Slinger Jansen
12:06
24m
Talk
Session 2 Discussion
Research Papers