ICSE 2025
Sat 26 April - Sun 4 May 2025 Ottawa, Ontario, Canada
Sat 3 May 2025 11:51 - 12:09 at 203 - ML4ESE Chair(s): Andreas Jedlitschka

The exponential growth of text-based data in domains such as healthcare, education, and social sciences has outpaced the capacity of traditional qualitative analysis methods, which are time-intensive and prone to subjectivity. Large Language Models (LLMs), powered by advanced generative AI, have emerged as transformative tools capable of automating and enhancing qualitative analysis. This study systematically maps the literature on the use of LLMs for qualitative research, exploring their application contexts, configurations, methodologies, and evaluation metrics. Findings reveal that LLMs are utilized across diverse fields, demonstrating the potential to automate processes traditionally requiring extensive human input. However, challenges such as reliance on prompt engineering, occasional inaccuracies, and contextual limitations remain significant barriers. This research highlights opportunities for integrating LLMs with human expertise, improving model robustness, and refining evaluation methodologies. By synthesizing trends and identifying research gaps, this study aims to guide future innovations in the application of LLMs for qualitative analysis.

Sat 3 May

Displayed time zone: Eastern Time (US & Canada) change

11:00 - 12:30
ML4ESEWSESE at 203
Chair(s): Andreas Jedlitschka Fraunhofer IESE
11:00
15m
Talk
A Framework for Using LLMs for Repository Mining Studies in Empirical Software Engineering
WSESE
Vincenzo De Martino University of Salerno, Joel Castaño Fernández Universitat Politècnica de Catalunya, Fabio Palomba University of Salerno, Xavier Franch Universitat Politècnica de Catalunya, Silverio Martínez-Fernández UPC-BarcelonaTech
Pre-print
11:15
18m
Talk
Can Machine Learning Support the Selection of Studies for Systematic Literature Review Updates?
WSESE
Marcelo Costalonga Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Bianca Minetto Napoleão Université du Québec à Chicoutimi, Maria Teresa Baldassarre Department of Computer Science, University of Bari , Katia Felizardo Federal Technological University of Paraná, Igor Steinmacher NAU RESHAPE LAB, Marcos Kalinowski Pontifical Catholic University of Rio de Janeiro (PUC-Rio)
11:33
18m
Talk
Applications and Implications of Large Language Models in Qualitative Analysis: A New Frontier for Empirical Software Engineering
WSESE
Matheus de Morais Leça University of Calgary, Lucas Valença University of Calgary, Reydne Bruno dos Santos UFPE, Ronnie de Souza Santos University of Calgary
11:51
18m
Talk
Large Language Model for Qualitative Research - A Systematic Mapping Study
WSESE
Cauã Ferreira Barros Federal University of Goiás, Bruna Borges Azevedo Federal University of Goiás, Valdemar Graciano Neto Federal University of Goiás, Mohamad Kassab Boston University, USA, Marcos Kalinowski Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Hugo Alexandre D. do Nascimento Federal University of Goiás, Michelle C.G.S.P. Bandeira Federal University of Goiás
12:09
21m
Live Q&A
ML4ESE: Discussion
WSESE