Engineering LLM Powered Multi-agent Framework for Autonomous CloudOps
Distinguished paper Award Candidate
Cloud Operations (CloudOps) is a rapidly growing field focused on the automated management and optimisation of cloud infrastructure which is essential for organisations navigating increasingly complex cloud environments. ABC Org is one of the major companies in the CloudOps domain that leverages autonomous bots to manage cloud compliance, security and continuous operations. In order to make their platform more accessible and effective to the customers, ABC worked with us to leverage the use of GenAI.
Developing a GenAI-based solution for autonomous CloudOps for the existing ABC system presented us with various challenges such as: i) diverse data sources; ii) orchestration of multiple processes and iii) handling complex workflows to automate routine tasks. To this end, we developed a multi-agent framework that leverages GenAI and balances autonomy with the necessary human control. This framework integrates various internal and external systems and is optimised for factors like task orchestration, security, and error mitigation while producing accurate, reliable and relevant insights by utilising Retrieval Augmented Generation (RAG). Evaluations of our multi-agent system with the help of practitioners as well as using automated checks demonstrate enhanced accuracy, responsiveness, and effectiveness over non-agentic approaches across complex workflows.
Mon 28 AprDisplayed time zone: Eastern Time (US & Canada) change
16:00 - 17:30 | Generative Model EngineeringResearch and Experience Papers / Industry Talks at 208 Chair(s): Manel Abdellatif École de Technologie Supérieure | ||
16:00 15mTalk | DDPT: Diffusion Driven Prompt Tuning for Large Language Model Code Generation Research and Experience Papers Jinyang Li The University of Adelaide, Sangwon Hyun CREST, University of Adelaide, Muhammad Ali Babar School of Computer Science, The University of Adelaide | ||
16:15 15mTalk | Engineering LLM Powered Multi-agent Framework for Autonomous CloudOpsDistinguished paper Award Candidate Research and Experience Papers Kannan Parthasarathy MontyCloud, Karthik Vaidhyanathan IIIT Hyderabad, Rudra Dhar SERC, IIIT Hyderabad, India, Venkat Krishnamachari MontyCloud, Adyansh Kakran International Institute of Information Technology, Hyderabad, Sreemaee Akshathala IIIT Hyderabad, Shrikara Arun IIIT Hyderabad, Amey Karan IIIT Hyderabad, Basil Muhammed MontyCloud, Sumant Dubey MontyCloud, Mohan Veerubhotla MontyCloud | ||
16:30 15mTalk | Generating and Verifying Synthetic Datasets with Requirements Engineering Research and Experience Papers Lynn Vonderhaar Embry-Riddle Aeronautical University, Timothy Elvira Embry-Riddle Aeronautical University, Omar Ochoa Embry-Riddle Aeronautical University Pre-print | ||
16:45 15mTalk | LLM-Based Safety Case Generation for Baidu Apollo: Are We There Yet? Research and Experience Papers | ||
17:00 12mTalk | SqPal - text to SQL GenAI tool for PayPal Industry Talks | ||
17:12 18mOther | Discussion Research and Experience Papers |