ICSE 2024
Fri 12 - Sun 21 April 2024 Lisbon, Portugal
Sat 20 Apr 2024 11:10 - 11:20 at Luis de Freitas Branco - Session 2: Full Papers Chair(s): Yiling Lou

The increasing use of information technology has led to a significant share of energy consumption and carbon emissions from data centers. These contributions are expected to rise with the growing demand for big data analytics, increasing digitization, and the development of large artificial intelligence (AI) models. The need to address the environmental impact of software development has led to increased interest in green (sustainable) coding and claims that the use of AI models can lead to energy efficiency gains. Here, we provide an empirical study on green code and an overview of green coding practices, as well as metrics used to quantify the sustainability awareness of AI models. In this framework, we evaluate the sustainability of auto-generated code. The auto-generate codes considered in this study are produced by generative commercial AI language models, GitHub Copilot, OpenAI ChatGPT-3, and Amazon CodeWhisperer. Within our methodology, in order to quantify the sustainability awareness of these AI models, we propose a definition of the code’s “green capacity”, based on certain sustainability metrics. We compare the performance and green capacity of human-generated code and code generated by the three AI language models in response to easy-to-hard problem statements. Our findings shed light on the current capacity of AI models to contribute to sustainable software development.

Sat 20 Apr

Displayed time zone: Lisbon change

11:00 - 12:30
Session 2: Full PapersLLM4Code at Luis de Freitas Branco
Chair(s): Yiling Lou Fudan University
11:00
10m
Talk
LLM-based and Retrieval-Augmented Control Code Generation
LLM4Code
Heiko Koziolek ABB Corporate Research, Sten Grüner ABB Corporate Research, Rhaban Hark ABB Research, Virendra Ashiwal ABB Research, Sofia Linsbauer ABB Research, Nafise Eskandani ABB Corporate Research Center
Pre-print
11:10
10m
Talk
Learn to Code Sustainably: An Empirical Study on Green Code Generation
LLM4Code
Tina Vartziotis TWT Science and Innovation, National Technical University of Athens, Ippolyti Dellatolas Massachusetts Institute of Technology, George Dasoulas Harvard University, Maximilian Schmidt TWT Science and Innovation, Florian Schneider TWT Science and Innovation, Tim Hoffmann Mercedes-Benz, Sotirios Kotsopoulos National Technical University of Athens, Massachusetts Institute of Technology, Michael Keckeisen TWT Science and Innovation
11:20
10m
Talk
Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructions
LLM4Code
Federico Cassano Northeastern University, Tao Li Northeastern University, Akul Sethi Northeastern University, Noah Shinn Northeastern University, Abby Brennan-Jones Wellesley College, Anton Lozhkov Hugging Face, Carolyn Jane Anderson Wellesley College, Arjun Guha Northeastern University; Roblox
Pre-print
11:30
10m
Talk
HierarchyNet: Learning to Summarize Source Code with Heterogeneous Representations
LLM4Code
Thai Minh Nguyen Monash University, Nghi D. Q. Bui Fulbright University, Viet Nam
11:40
10m
Talk
LLM-based Control Code Generation using Image Recognition
LLM4Code
Heiko Koziolek ABB Corporate Research, Anne Koziolek Karlsruhe Institute of Technology
Pre-print
11:50
10m
Talk
Translation of Low-Resource COBOL to Logically Correct and Readable Java leveraging High-Resource Java Refinement
LLM4Code
Shubham Gandhi TCS Research, Manasi Patwardhan TCS Research, Jyotsana Khatri TCS Research, Lovekesh Vig TCS Research, New Delhi, India, Raveendra Kumar Medicherla TCS Research, Tata Consultancy Services
Pre-print
12:00
10m
Talk
Unit Test Generation using Generative AI : A Comparative Performance Analysis of Autogeneration Tools
LLM4Code
Shreya Bhatia IIIT Delhi, Tarushi Gandhi IIIT Delhi, Dhruv Kumar Indraprastha Institute of Information Technology, Delhi, Pankaj Jalote IIIT Delhi
Pre-print
12:10
10m
Talk
StudentEval: A Benchmark of Student-Written Prompts for Large Language Models of CodeBest Presentation Award
LLM4Code
Hannah McLean Babe Oberlin College, Sydney Nguyen Wellesley College, Yangtian Zi Northeastern University, Arjun Guha Northeastern University; Roblox, Molly Q Feldman Oberlin College, Carolyn Jane Anderson Wellesley College
Pre-print
12:20
10m
Talk
PromptSet: A Programmer’s Prompting Dataset
LLM4Code
Kaiser Pister Univeristy of Wisconsin-Madison, Dhruba Jyoti Paul Univeristy of Wisconsin-Madison, Ishan Joshi Univeristy of Wisconsin-Madison, Patrick Brophy Univeristy of Wisconsin-Madison
Pre-print