Sun 4 May 2025 15:30 - 16:00 at FSS2005 - AIware Bootcamp Sun 15:30
The session will discuss AIware observability challenges. Covered topics include:
- AIware Ops overview
- AIware observability overview - What is it, why is it important, and how is it different for AIware
- The importance of semantics vs raw observability
- Existing observability tools and platforms – strengths and weaknesses
- Evaluation and guardrails - Validating FM responses, comparing models on golden sets, measuring response time, tracking and altering observability metrics
Benjamin Rombaut is a Software Engineering Researcher with the Centre for Software Excellence, Huawei Canada, based in Montreal, Quebec, working on topics related to Software Engineering for AI and foundation model applications. He received his MSc (2022) in Computer Science from Queen’s University, Canada, and his BSc (2019) in Software Engineering from the University of New Brunswick, Canada. His research interests include AI4SE, SE4AI, AIware observability, empirical software engineering, and software bots. More about him can be found at https://www.benrombaut.ca.
Sun 4 MayDisplayed time zone: Eastern Time (US & Canada) change
Sun 4 May
Displayed time zone: Eastern Time (US & Canada) change
15:30 - 16:00 | |||
15:30 30mTalk | AIware: AIware ObservabilitySE for AI Tutorials and Technical Briefings Benjamin Rombaut Centre for Software Excellence, Huawei Canada |