Demystifying Feature Requests: Leveraging LLMs to Refine Feature Requests in Open-Source Software
This program is tentative and subject to change.
The growing popularity and widespread use of software applications (apps) across various domains have driven rapid industry growth. Along with this growth, fast-paced market changes have led to constantly evolving software requirements. Such requirements are often grounded in feature requests and enhancement suggestions, typically provided by users in natural language (NL). However, these requests often suffer from defects such as ambiguity and incompleteness, making them challenging to interpret. Traditional validation methods (e.g., interviews and workshops) help clarify such defects but are impractical in decentralized environments like open-source software (OSS), where change requests originate from diverse users on platforms like GitHub. This paper proposes a novel approach leveraging Large Language Models (LLMs) to detect and refine NL defects in feature requests. Our approach automates the identification of ambiguous and incomplete requests and generates clarification questions (CQs) to enhance their usefulness for developers. To evaluate its effectiveness, we apply our method to real-world OSS feature requests and compare its performance against human annotations. In addition, we conduct interviews with GitHub developers to gain deeper insights into their perceptions of NL defects, the strategies they use to address these defects, and the impact of defects on downstream software engineering (SE) tasks.
This program is tentative and subject to change.
Wed 3 SepDisplayed time zone: Brussels, Copenhagen, Madrid, Paris change
11:00 - 12:30 | Mining Requirements RepositoriesResearch Papers / Industrial Innovation Track at Room 1.1 Chair(s): Quim Motger Universitat Politècnica de Catalunya | ||
11:00 30mPaper | Navigating through Work Items in Issue Tracking Systems via Natural Language Queries Industrial Innovation Track Delina Ly VX Company, Utrecht University , Sruthi Radhakrishnan itemis AG, Fatma Başak Aydemir Utrecht University, Fabiano Dalpiaz Utrecht University Pre-print | ||
11:30 30mPaper | LSRM: A Hybrid LLM-SBERT Approach for Mapping User Requirements to Product Functionalities in Complex Products Research Papers Bin Liang Renmin University of China, Zhiwei Zhang The Chinese University of Hong Kong, Kam-Fai Wong The Chinese University of Hong Kong | ||
12:00 30mPaper | Demystifying Feature Requests: Leveraging LLMs to Refine Feature Requests in Open-Source Software Research Papers Pragyan K C University of Texas at San Antonio, Rambod Ghandiparsi University of Texas at San Antonio, Thomas Herron University of Texas at San Antonio, John Heaps University of Texas at San Antonio, Mitra Bokaei Hosseini University of Texas at San Antonio |