Opening Keynote: Safe and Responsible Agent Engineering: A Requirement Engineering (RE) Perspective
Large language model (LLM) agents offer huge potential to boost productivity and have attracted significant attention across academia and industry. However, engineering agentic systems poses significant challenges due to their inherent autonomy, non-deterministic behaviour, and increasing concerns around AI safety. In this talk, I will first present our responsible AI engineering approach for addressing system-level challenges, e.g., how to assess and mitigate AI risks throughout the entire lifecycle of AI systems using Responsible AI Question Bank and Responsible AI Pattern Catalogue. I will then highlight the unique characteristics of agentic systems and share our recent research progress in agent engineering, including the Agent Design Pattern Catalogue, the AgentArcEval method, and the Swiss Cheese Model for agent safety. Finally, I will examine the intersection of RE and agents, covering both how agents can support RE activities and how RE can be adapted to guide the development of safe agents. I will conclude key open challenges and future research opportunities at the intersection of RE and agents.
Slides (Qinghua.pdf) | 3.6MiB |
Sat 3 MayDisplayed time zone: Eastern Time (US & Canada) change
09:00 - 10:30 | |||
09:00 10mOther | Welcome and Introduction RAISE Amel Bennaceur The Open University, UK, Gopi Krishnan Rajbahadur Centre for Software Excellence, Huawei, Canada, Ahmed E. Hassan Queen’s University, Bashar Nuseibeh The Open University, UK File Attached | ||
09:10 50mKeynote | Opening Keynote: Safe and Responsible Agent Engineering: A Requirement Engineering (RE) Perspective RAISE Qinghua Lu Data61, CSIRO File Attached | ||
10:00 30mKeynote | Keynote: Requirements in Engineering AI-Enabled Systems: Open Problems and Opportunities RAISE Lionel Briand University of Ottawa, Canada; Lero centre, University of Limerick, Ireland File Attached |