SDEFL: A Lightweight Fault Detection and Localization Method for Deep Neural Networks
Fault detection and localization in deep neural networks (DNN) refers to identifying and diagnosing the causes of errors or performance degradation in the learning process of the network. Faults include identifying incorrect weights, biases, activation functions, or network structures, which can be caused by problems such as overfitting, underfitting, vanishing gradients, or explosions. Fault detection and localization of deep neural networks is a key task to ensure the performance, safety, and reliability of the model, which has important research value and application prospects for promoting the application and development of deep learning technology. The existing research on Fault detection and localization of deep neural networks includes rule-based methods and learning-based methods, which monitor the training process of deep learning models from multiple perspectives and locate the faults generated by the models when abnormal behaviors are found. However, these methods are carried out around the features of model failures, and lack of the code structure and syntax information of the model.
In this paper, we propose a Fault detection and localization method (SDEFL) based on the static structural fault features, dynamic training fault features, and program source code features based on extended AST of the deep neural network, which takes the static structure information of the neural network, the dynamic training information, and the syntax and semantic information of the representation program as the model source code as features, learns the relationship between the DNN and its fault class, and conducts code-level localization after identifying the fault class. A series of experiments have been conducted to evaluate SDEFL on data containing 48 type faults. The experimental results show that SDEFL delivers higher fault detection localization than the state-of-the-art techniques.
Thu 5 DecDisplayed time zone: Beijing, Chongqing, Hong Kong, Urumqi change
16:00 - 17:30 | Session (12)Technical Track at Room 1 (Zunhui Room) Chair(s): Tao Zhang Macau University of Science and Technology | ||
16:00 30mTalk | SDEFL: A Lightweight Fault Detection and Localization Method for Deep Neural Networks Technical Track Bo Yang Beijing Forestry University, Jiawei Hu Beijing Forestry University, Jialun Cao Hong Kong University of Science and Technology | ||
16:30 30mTalk | A Study of Using Multimodal LLMs for Non-Crash Functional Bug Detection in Android Apps Technical Track Bangyan Ju University of Cincinnati, Jin Yang University of Cincinnati, Tingting Yu University of Connecticut, Tamerlan Abdullayev University of Cincinnati, Yuanyuan Wu University of Cincinati, Dingbang Wang University of Connecticut, Yu Zhao | ||
17:00 30mTalk | Effective Model Replacement for Solving Objective Mismatches in Pre-trained Model Compositions Technical Track Arogya Kharel School of Computing, KAIST, KyeongDeok Baek School of Computing, KAIST, In-Young Ko Korea Advanced Institute of Science and Technology |