SEALing the Gap: A Reference Framework for LLM Inference Carbon Estimation via Multi-Benchmark Driven Embodiment
Large Language Models (LLMs) are rapidly gaining traction in software engineering, yet their growing carbon footprint raises pressing sustainability concerns. While training emissions are substantial, inference quickly surpasses them due to the sheer volume of prompts processed. This shift underscores the urgent need for accurate, prompt-level carbon measurement during inference to enable informed, sustainability-focused decision-making. To address the limitations of existing approaches, in this paper, we outline the guiding principles for a novel reference framework for LLM inference carbon estimation that can guide the design of future tools and provide a systematic foundation for advancing sustainability research in this domain. We then introduce SEAL, an early embodiment of these guiding principles that leverages multi-benchmark-driven machine learning models for per-prompt carbon estimation. Its initial validation shows promising results, positioning SEAL as a foundation for standardized sustainability assessment across the LLM ecosystem.
Thu 16 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
14:00 - 15:30 | Human and Social Aspects 8Research Track / Journal-first Papers / New Ideas and Emerging Results (NIER) at Oceania IV Chair(s): Ivan Beschastnikh The University of British Columbia | ||
14:00 15mTalk | Determining Code Proficiency Levels from Python Textbooks Journal-first Papers Ruksit Rojpaisarnkit Nara Institute of Science and Technology, Gregorio Robles Universidad Rey Juan Carlos, Jesus M. Gonzalez-Barahona Universidad Rey Juan Carlos, Kenichi Matsumoto Nara Institute of Science and Technology, Raula Gaikovina Kula The University of Osaka Link to publication | ||
14:15 15mTalk | Guiding principles for mixed methods research in software engineering Journal-first Papers Margaret-Anne Storey University of Victoria, Rashina Hoda Monash University, Alessandra Maciel Paz Milani University of Victoria, Maria Teresa Baldassarre Department of Computer Science, University of Bari Link to publication | ||
14:30 15mTalk | SEALing the Gap: A Reference Framework for LLM Inference Carbon Estimation via Multi-Benchmark Driven Embodiment New Ideas and Emerging Results (NIER) Priyavanshi Pathania Accenture Labs, Rohit Mehra Accenture Labs, Vibhu Saujanya Sharma Accenture Labs, Vikrant Kaulgud Accenture Labs, India, Tiffani Nevels Accenture, Sanjay Podder Accenture, Adam P. Burden Accenture Media Attached | ||
14:45 15mTalk | Views on Internal and External Validity in Empirical Software Engineering: 10 Years Later and Beyond Research Track Alina Mailach Leipzig University, Janet Siegmund Chemnitz University of Technology, Sven Apel Saarland University, Norbert Siegmund Leipzig University Pre-print Media Attached | ||
15:00 15mTalk | Weak Programmers Need Not Apply, LLMs Welcome! Survey Screening in the AI Era Research Track Ita Ryan University College Cork, Utz Roedig School of Computer Science and Information Technology, University College Cork, Klaas-Jan Stol Lero; University College Cork; SINTEF Digital | ||
15:15 15mTalk | Sapling: Quantifying and Measuring the Maturity of the RISC-V Software Ecosystem Research Track Yuhang Liu Institute of Computing Technology, Chinese Academy of Sciences, Chenchen Ji Institute of Software, Chinese Academy of Sciences, Haoquan Li Institute of Computing Technology, Chinese Academy of Sciences, Jiageng Yu The Institute of Software, Chinese Academy of Sciences, Mingyu Chen Institute of Computing Technology, Chinese Academy of Sciences, Yanjun Wu Institute of Software, Chinese Academy of Sciences, Yungang Bao State Key Lab of Processors, Institute of Computing Technology, CAS; University of Chinese Academy of Sciences Media Attached | ||