Unseen Data Detection using Routing Entropy in Mixture-of-Experts for Autonomous Vehicles
This program is tentative and subject to change.
Unseen data that differ significantly from the training data can cause machine learning models to behave unpredictably, which is particularly problematic in safety-critical systems like autonomous vehicles. Detecting such data, commonly called out-of-distribution (OOD) data, is essential for ensuring the robustness of these models. Existing methods often rely on the model’s final output, which are limited since the model can be overconfident on unseen data. In this paper, we propose Routing Entropy, a novel OOD detection method that leverages the internal routing behavior of Mixture-of-Experts (MoE) models, a design increasingly adopted in modern neural networks. We hypothesize that MoE models exhibit high confidence routing for in-distribution (ID) inputs, but greater uncertainty for OOD inputs. We quantify this uncertainty by calculating the entropy of the routing scores for a given input. Experimental results on a MoE-based semantic segmentation model used for perception in autonomous driving demonstrate that Routing Entropy is effective on its own and, more importantly, provides a complementary signal to existing output-based methods. Combining Routing Entropy with an existing method significantly improves OOD detection performance. These results suggest that leveraging internal routing behavior of MoE models is a promising direction for robust OOD detection.
This program is tentative and subject to change.
Mon 17 NovDisplayed time zone: Seoul change
| 16:00 - 17:00 | |||
| 16:0010m Talk | Human-In-The-Loop Oracle Learning for Simulation-Based Testing NIER Track Ben-Hau Chia Carnegie Mellon University, Eunsuk Kang Carnegie Mellon University, Christopher Steven Timperley Carnegie Mellon University | ||
| 16:1010m Talk | Taming Uncertainty via Automation: Observing, Analyzing, and Optimizing Agentic AI Systems NIER Track | ||
| 16:2010m Talk | Out of Distribution Detection in Self-adaptive Robots with AI-powered Digital Twins Industry Showcase Erblin Isaku Simula Research Laboratory, and University of Oslo (UiO), Hassan Sartaj Simula Research Laboratory, Shaukat Ali Simula Research Laboratory and Oslo Metropolitan University, Beatriz Sanguino Norwegian University of Science and Technology, Tongtong Wang Norwegian University of Science and Technology, Guoyuan Li Norwegian University of Science and Technology, Houxiang Zhang Norwegian University of Science and Technology, Thomas Peyrucain PAL Robotics | ||
| 16:3010m Talk | Unseen Data Detection using Routing Entropy in Mixture-of-Experts for Autonomous Vehicles NIER Track Sang In Lee Chungnam Naitional University, Donghwan Shin University of Sheffield, Jihun Park Chungnam National UniversityPre-print | ||
| 16:4010m Talk | Evaluating Large Language Models for Time Series Anomaly Detection in Aerospace Software Industry Showcase Yang Liu Beijing Institute of Control Engineering, Yixing Luo Beijing Institute of Control Engineering, Xiaofeng Li Beijing Institute of Control Engineering, Xiaogang Dong Beijing Institute of Control Engineering, Bin Gu Beijing Institute of Control Engineering, Zhi Jin Peking University | ||
| 16:5010m Talk | Bridging Research and Practice in Simulation-based Testing of Industrial Robot Navigation Systems Industry Showcase Sajad Khatiri Università della Svizzera italiana and University of Bern, Francisco Eli Vi˜na Barrientos ANYbotics AG, Maximilian Wulf ANYbotics AG, Paolo Tonella USI Lugano, Sebastiano Panichella University of Bern | ||

