CAIN 2025
Sun 27 - Mon 28 April 2025 Ottawa, Ontario, Canada
co-located with ICSE 2025
Mon 28 Apr 2025 17:00 - 17:12 at 208 - Generative Model Engineering Chair(s): Manel Abdellatif

The advent of Large Language Models (LLMs) has transformed traditional practices in product data science. In this presentation, we explore the complete lifecycle of GenAI tools within product data science teams, using the PayPal digital wallet data science team as an example. Specifically, we focus on the GenAI-powered text-to-SQL model we developed to support data scientists. This tool significantly reduces the time spent on ad-hoc data retrieval tasks—critical for business operations but often resource-intensive. We will delve into our modeling approach and demonstrate the tool’s fast and secure implementation. Additionally, we will discuss our user data collection and feedback processes, and how periodic measurement of the tool performance using a unique question bank for PayPal data has ensured the tool’s continuous improvement. Finally, we will address key challenges in adopting GenAI tools in large organizations, including gaps in data catalogs and the inherent complexities of data structures and lifecycles.

Mon 28 Apr

Displayed time zone: Eastern Time (US & Canada) change

16:00 - 17:30
Generative Model EngineeringResearch and Experience Papers / Industry Talks at 208
Chair(s): Manel Abdellatif École de Technologie Supérieure
16:00
15m
Talk
DDPT: Diffusion Driven Prompt Tuning for Large Language Model Code Generation
Research and Experience Papers
Jinyang Li The University of Adelaide, Sangwon Hyun CREST, University of Adelaide, Muhammad Ali Babar School of Computer Science, The University of Adelaide
16:15
15m
Talk
Engineering LLM Powered Multi-agent Framework for Autonomous CloudOpsDistinguished paper Award Candidate
Research and Experience Papers
Kannan Parthasarathy MontyCloud, Karthik Vaidhyanathan IIIT Hyderabad, Rudra Dhar SERC, IIIT Hyderabad, India, Venkat Krishnamachari MontyCloud, Adyansh Kakran International Institute of Information Technology, Hyderabad, Sreemaee Akshathala IIIT Hyderabad, Shrikara Arun IIIT Hyderabad, Amey Karan IIIT Hyderabad, Basil Muhammed MontyCloud, Sumant Dubey MontyCloud, Mohan Veerubhotla MontyCloud
16:30
15m
Talk
Generating and Verifying Synthetic Datasets with Requirements Engineering
Research and Experience Papers
Lynn Vonderhaar Embry-Riddle Aeronautical University, Timothy Elvira Embry-Riddle Aeronautical University, Omar Ochoa Embry-Riddle Aeronautical University
Pre-print
16:45
15m
Talk
LLM-Based Safety Case Generation for Baidu Apollo: Are We There Yet?
Research and Experience Papers
Oluwafemi Odu York University, Alvine Boaye Belle York University, Song Wang York University
17:00
12m
Talk
SqPal - text to SQL GenAI tool for PayPal
Industry Talks
Dan Liyanage PayPal, Mahshid Moha PayPal, Sandy Suresh PayPal
17:12
18m
Other
Discussion
Research and Experience Papers

:
:
:
: