ICSE 2024 (series) / Posters /
Exploring the Effectiveness of LLM based Test-driven Interactive Code Generation: User Study and Empirical Evaluation
Fri 19 Apr 2024 10:30 - 11:00 at Open Space - Posters 5
We introduce a novel workflow, TiCoder, designed to enhance the trust and accuracy of LLM-based code generation through interactive and guided intent formalization. TiCoder partially formalizes ambiguous intent in natural language prompts by generating a set of tests to distinguish common divergent behaviours in generated code suggestions. We evaluate the code generation accuracy improvements provided by TiCoder at scale across four competitive LLMs, and evaluate the cost-benefit trade off of evaluating tests surfaced by TiCoder through a user study with 15 participants
Fri 19 AprDisplayed time zone: Lisbon change
Fri 19 Apr
Displayed time zone: Lisbon change
10:30 - 11:00 | |||
10:30 30mPoster | Exploring the Effectiveness of LLM based Test-driven Interactive Code Generation: User Study and Empirical Evaluation Posters Sarah Fakhoury Microsoft Research, Aaditya Naik University of Pennsylvania, Georgios Sakkas University of California at San Diego, Saikat Chakraborty Microsoft Research, Madan Musuvathi Microsoft Research, Shuvendu K. Lahiri Microsoft Research | ||
10:30 30mPoster | On the Need for Empirically Investigating Fast-Growing Programming Languages Posters Jahnavi Kumar Indian Institute of Technology Tirupati, India, Sridhar Chimalakonda Indian Institute of Technology, Tirupati | ||
10:30 30mPoster | Decoding Log Parsing Challenges: A Comprehensive Taxonomy for Actionable Solutions Posters Issam Sedki Concordia University, Wahab Hamou-Lhadj Concordia University, Montreal, Canada, Otmane Ait-Mohamed Concordia University, Naser Ezzati Jivan , Mohammed Shehab Concordia University | ||
10:30 30mPoster | Automated Code Editing with Search-Generate-Modify Posters Changshu Liu Columbia University, Pelin Cetin Columbia University, Yogesh Patodia Columbia University, Baishakhi Ray AWS AI Labs, Saikat Chakraborty Microsoft Research, Yangruibo Ding Columbia University | ||
10:30 30mPoster | Exploring the Impact of Inheritance on Test Code Maintainability Posters | ||
10:30 30mPoster | Improving Program Debloating with 1-DU Chain Minimality Posters Myeongsoo Kim Georgia Institute of Technology, Santosh Pande Georgia Institute of Technology, Alessandro Orso Georgia Institute of Technology Pre-print | ||
10:30 30mPoster | GoSpeechLess: Interoperable Serverless ML-based Cloud Services Posters Sashko Ristov University of Innsbruck, Philipp Gritsch University of Innsbruck, David Meyer University of Innsbruck, Michael Felderer German Aerospace Center (DLR) & University of Cologne | ||
10:30 30mPoster | Towards Precise Observations of Neural Model Robustness in Classification Posters Wenchuan Mu ISTD, Singapore University of Technology and Design, Kwan Hui Lim Singapore University of Technology and Design, Singapore | ||
10:30 30mPoster | Assessing AI-Based Code Assistants in Method Generation Tasks Posters Vincenzo Corso University of Milano - Bicocca, Leonardo Mariani University of Milano-Bicocca, Daniela Micucci University of Milano-Bicocca, Italy, Oliviero Riganelli University of Milano - Bicocca | ||
10:30 30mPoster | Recovering Traceability Links between Release Notes and Related Software Artifacts Posters | ||
10:30 30mPoster | Improving the Condensing of Reverse Engineered Class Diagrams using Weighted Network Metrics Posters Weifeng Pan Zhejiang Gongshang University, Wei Wu Zhejiang Gongshang University, Hua Ming Oakland University, Dae-Kyoo Kim Oakland University, Jinkai Yang Oakland University, Ruochen Liu Oakland University Media Attached | ||
10:30 30mPoster | Exploring Data Cleanness in Defects4J and Its Influence on Fault Localization Efficiency Posters Md Nakhla Rafi Concordia University, An Ran Chen University of Alberta, Tse-Hsun (Peter) Chen Concordia University, Shaohua Wang Central University of Finance and Economics | ||
10:30 30mPoster | Learning to Represent Patches Posters Xunzhu Tang University of Luxembourg, Haoye Tian University of Melbourne, Zhenghan Chen Peking University, Weiguo Pian University of Luxembourg, Saad Ezzini Lancaster University, Abdoul Kader Kaboré University of Luxembourg, Andrew Habib ABB Corporate Research, Germany, Jacques Klein University of Luxembourg, Tegawendé F. Bissyandé University of Luxembourg | ||
10:30 30mPoster | Bringing Structure to Naturalness: On the Naturalness of ASTs Posters Profir-Petru Pârțachi National Institute of Informatics, Japan, Mahito Sugiyama National Institute of Informatics, Japan | ||