Thu 18 Aug 2022 20:50 - 21:20 at Dunnart - Mining User Feedback Chair(s): Eduard C. Groen

Feedback from the users of software products is vital for engineering better requirements. One tool for generating requirements from online user feedback is clustering, where the most mentioned topics by users are found by grouping alike feedback together. These clusters have been summarized in previous work using characterizing phrases or sentences for these topics to be understood. This work evaluates which method of characterization (unigrams, bigrams, trigrams, sentences) is most effective for understanding the semantic meaning of a whole cluster using feedback from multiple feedback sources. We evaluate multiple characterization methods against random characterizations to determine the ability of each method to create distinct, descriptive characterizations. We further evaluate the amount of requirements relevant characterizations created by each characterization method. We find that unigrams, bigrams, trigrams, and full sentences all perform similarly in distinguishing clusters in the random characterization comparison task. However, we find that fewer and more expressive characterizations, such as full sentences, contain more requirements relevant information from a feedback cluster compared to more numerous but less expressive unigrams. Our findings inform the future development of user feedback clustering tools, with different cluster characterization methods being quantitatively measured for the first time.

Thu 18 Aug

Displayed time zone: Hobart change

20:20 - 21:20
Mining User FeedbackResearch Papers at Dunnart
Chair(s): Eduard C. Groen Fraunhofer IESE
20:20
30m
Talk
Mining User Feedback For Software Engineering: Use Cases and Reference ArchitectureReusableAvailable
Research Papers
Jacek Dąbrowski University College London & Fondazione Bruno Kessler, Emmanuel Letier University College London, Anna Perini Fondazione Bruno Kessler, Angelo Susi Fondazione Bruno Kessler
20:50
30m
Talk
What's Inside a Cluster of Software User Feedback: A Study of Characterisation MethodsReusableAvailable
Research Papers
Peter Devine The University of Auckland, James Tizard University of Auckland, Hechen Wang The University of Auckland, Yun Sing Koh The University of Auckland, Kelly Blincoe University of Auckland