TCSE logo 
 Sigsoft logo
Sustainability badge
Sun 4 May 2025 15:30 - 16:00 at FSS2005 - AIware Bootcamp Sun 15:30

The session will discuss AIware observability challenges. Covered topics include:

  • AIware Ops overview
  • AIware observability overview - What is it, why is it important, and how is it different for AIware
  • The importance of semantics vs raw observability
  • Existing observability tools and platforms – strengths and weaknesses
  • Evaluation and guardrails - Validating FM responses, comparing models on golden sets, measuring response time, tracking and altering observability metrics

Benjamin Rombaut is a Software Engineering Researcher with the Centre for Software Excellence, Huawei Canada, based in Montreal, Quebec, working on topics related to Software Engineering for AI and foundation model applications. He received his MSc (2022) in Computer Science from Queen’s University, Canada, and his BSc (2019) in Software Engineering from the University of New Brunswick, Canada. His research interests include AI4SE, SE4AI, AIware observability, empirical software engineering, and software bots. More about him can be found at https://www.benrombaut.ca.

Sun 4 May

Displayed time zone: Eastern Time (US & Canada) change

15:30 - 16:00
AIware Bootcamp Sun 15:30Tutorials and Technical Briefings at FSS2005
15:30
30m
Talk
AIware: AIware ObservabilitySE for AI
Tutorials and Technical Briefings
Benjamin Rombaut Centre for Software Excellence, Huawei Canada
:
:
:
: