TCSE logo 
 Sigsoft logo
Sustainability badge
Fri 2 May 2025 11:00 - 11:15 at 207 - Human and Social using AI 2 Chair(s): Sebastian Baltes

Foundation models (FMs) such as large language models (LLMs) have significantly impacted many fields, including software engineering (SE). The interaction between SE and FMs has led to the integration of FMs into SE practices (FM4SE) and the application of SE methodologies to FMs (SE4FM). While several literature surveys exist on academic contributions to these trends, we are the first to provide a practitioner’s view. We analyze 155 FM4SE and 997 SE4FM blog posts from leading technology companies, leveraging an FM-powered surveying approach to systematically label and summarize the discussed activities and tasks. We observed that while code generation is the most prominent FM4SE task, FMs are leveraged for many other SE activities such as code understanding, summarization, and API recommendation. The majority of blog posts on SE4FM are about model deployment & operation, and system architecture & orchestration. Although the emphasis is on cloud deployments, there is a growing interest in compressing FMs and deploying them on smaller devices such as edge or mobile devices. We outline eight future research directions inspired by our gained insights, aiming to bridge the gap between academic findings and real-world applications. Our study not only enriches the body of knowledge on practical applications of FM4SE and SE4FM but also demonstrates the utility of FMs as a powerful and efficient approach in conducting literature surveys within technical and grey literature domains. Our dataset, results, code and used prompts can be found in our online replication package at https://github.com/SAILResearch/fmse-blogs.

Fri 2 May

Displayed time zone: Eastern Time (US & Canada) change

11:00 - 12:30
Human and Social using AI 2Research Track / SE In Practice (SEIP) / Demonstrations at 207
Chair(s): Sebastian Baltes University of Bayreuth
11:00
15m
Talk
Software Engineering and Foundation Models: Insights from Industry Blogs Using a Jury of Foundation ModelsArtifact-AvailableArtifact-FunctionalArtifact-Reusable
SE In Practice (SEIP)
Hao Li Queen's University, Cor-Paul Bezemer University of Alberta, Ahmed E. Hassan Queen’s University
Pre-print
11:15
15m
Talk
FairLay-ML: Intuitive Debugging of Fairness in Data-Driven Social-Critical Software
Demonstrations
Normen Yu Penn State, Luciana Carreon University of Texas at El Paso, Gang (Gary) Tan Pennsylvania State University, Saeid Tizpaz-Niari University of Illinois Chicago
11:30
15m
Talk
Dear Diary: A randomized controlled trial of Generative AI coding tools in the workplace
SE In Practice (SEIP)
Jenna L. Butler Microsoft Research, Jina Suh Microsoft Research, Sankeerti Haniyur Microsoft Corporation, Constance Hadley Institute for Work Life
11:45
15m
Talk
Exploring GenAI in Software Development: Insights from a Case Study in a Large Brazilian Company
SE In Practice (SEIP)
Guilherme Vaz Pereira School of Technology, PUCRS, Brazil, Victoria Jackson University of California, Irvine, Rafael Prikladnicki School of Technology at PUCRS University, Andre van der Hoek University of California, Irvine, Luciane Fortes Globo, Carolina Araújo Globo, André Coelho Globo, Ligia Chelli Globo, Diego Ramos Globo
Pre-print
12:00
15m
Talk
Human-In-the-Loop Software Development Agents
SE In Practice (SEIP)
Wannita Takerngsaksiri Monash University, Jirat Pasuksmit Atlassian, Patanamon Thongtanunam University of Melbourne, Kla Tantithamthavorn Monash University, Ruixiong Zhang Atlassian, Fan Jiang Atlassian, Jing Li Atlassian, Evan Cook Atlassian, Kun Chen Atlassian, Ming Wu Atlassian
12:15
15m
Talk
Measuring the Runtime Performance of C++ Code Written by Humans using GitHub CopilotArtifact-FunctionalArtifact-AvailableArtifact-Reusable
Research Track
Daniel Erhabor University of Waterloo, Sreeharsha Udayashankar University of Waterloo, Mei Nagappan University of Waterloo, Samer Al-Kiswany University of Waterloo
DOI Pre-print File Attached
:
:
:
: