Exploring Early Adopters' Perceptions of ChatGPT as a Code Generation Tool
ChatGPT is an artificial intelligence chatbot developed by OpenAI, able of interacting in a conversational way by taking into account successive input prompts. Among many possible uses, ChatGPT has been found to possess code generation capabilities, being able to generate code snippets and assist developers in their programming tasks. This paper performs a qualitative exploration of perceptions of early adopters regarding the use of ChatGPT for code generation, acknowledging the substantial impact this tool can have in the software development landscape. We collected a diverse set of discussions from early adopters of ChatGPT code generation capabilities and, leveraging an open card sorting methodology categorized it into relevant topics with the goal of extracting insights into the experiences, opinions, and challenges they faced. We found that early adopters (i) report their own mixed usage experiences, (ii) share suggestions for prompt engineering, (iii) debate the extent to which they can trust generated code, and (iv) discuss the impact that ChatGPT can have on the software development process. We discuss the implications of the insights we extracted from early adopters’ perspectives and provide recommendations for future research.
Gian Luca Scoccia received his PhD from the Gran Sasso Science Institute, Italy, in 2019. Currently is assistant professor at the Gran Sasso Science Institute, Italy. His research focuses on software engineering, empirical software engineering, privacy and security of mobile apps, mining of software repositories, program analysis.
Mon 11 SepDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
11:20 - 12:00 | Session 1: AI and Intelligent Systems[Workshop] ASYDE at Room FR Chair(s): Gianluca Filippone University of L'Aquila, Italy | ||
11:20 20mTalk | Exploring Early Adopters' Perceptions of ChatGPT as a Code Generation Tool [Workshop] ASYDE Gian Luca Scoccia Gran Sasso Science Institute Pre-print | ||
11:40 20mTalk | Automated Negotiation - Preliminary results of a systematic mapping study [Workshop] ASYDE Mashal Afzal Memon University of L’Aquila, Italy, Gian Luca Scoccia Gran Sasso Science Institute, Marco Autili University of L'Aquila, Italy Pre-print File Attached |