A Framework for On the Fly Input Refinement for Deep Learning Models
Advancements in deep learning have significantly improved model performance across tasks involving code, text, and image processing. However, these models still exhibit notable mispredictions in real-world applications, even when trained on up-to-date data. Such failures often arise from slight variations in inputs such as minor syntax changes in code, rephrasing in text, or subtle lighting shifts in images that reveal inherent limitations in these models’ capability to generalize effectively. Traditional approaches to address these challenges involve retraining, a resource-intensive process that demands significant investments in data labeling, model updates, and redeployment.
This research introduces an adaptive, on-the-fly input refinement framework aimed at improving model performance through input validation and transformation. The input validation component detects inputs likely to cause errors, while input transformation applies domain-specific adjustments to better align these inputs with the model’s handling capabilities. This dual strategy reduces mispredictions across various domains, boosting model performance without necessitating retraining. As a scalable and resource-efficient solution, this framework holds significant promise for high-stakes applications in software engineering, natural language processing, and computer vision.
Tue 29 AprDisplayed time zone: Eastern Time (US & Canada) change
16:00 - 17:00 | Session 4: Testing (talks and panel)Doctoral Symposium at 212 Chair(s): Tayana Conte Universidade Federal do Amazonas | ||
16:00 6mTalk | TestifAI: Probabilistic Context-Aware Testing For Safe Deep Learning Models Doctoral Symposium AroojArif Northeastern University London | ||
16:06 6mTalk | Foundation Models for Automatic Issue Labeling Doctoral Symposium Giuseppe Colavito University of Bari | ||
16:12 6mTalk | Automatically Generating Single-Responsibility Unit Tests Doctoral Symposium Geraldine Galindo-Gutierrez Centro de Investigación en Ciencias Exactas e Ingenierías, Universidad Católica Boliviana | ||
16:18 6mTalk | Automatic Test Case Generation for Smart Human-Centric Ecosystems Doctoral Symposium Alind Xhyra Universitá della Svizzera Italiana (USI) Lugano, Constructor Institute of Technology (CIT) Schaffhausen | ||
16:24 6mTalk | A Framework for On the Fly Input Refinement for Deep Learning Models Doctoral Symposium Ravishka Shemal Rathnasuriya University of Texas at Dallas | ||
16:30 30mPanel | Panel: Testing Doctoral Symposium Shaukat Ali Simula Research Laboratory and Oslo Metropolitan University, Xavier Devroey University of Namur, Annibale Panichella Delft University of Technology, Ahmed Arif University of California, Merced, Giuseppe Colavito University of Bari, Geraldine Galindo-Gutierrez Centro de Investigación en Ciencias Exactas e Ingenierías, Universidad Católica Boliviana, Ravishka Shemal Rathnasuriya University of Texas at Dallas, Alind Xhyra Universitá della Svizzera Italiana (USI) Lugano, Constructor Institute of Technology (CIT) Schaffhausen |