TraCC: Efficient Multi-Label Code Comment Classification Through Knowledge Distillation and Adaptive Thresholding
Code comments provide essential documentation for software understanding, yet their automated classification remains challenging due to severe class imbalance and computational constraints. This paper proposes TraCC (Transformer-aided Code Comment Classification), a solution that combines CodeBERT teacher models with TinyBERT student models through knowledge distillation. We address class imbalance using LLM-based data augmentation with Google Gemini, asymmetric focal loss, and per-label dynamic threshold optimization. Evaluated on an augmented dataset derived from 14,875 comments across Java, Python, and Pharo, our distilled TinyBERT models achieve an average F1 score of 0.671 with superior computational efficiency: 481 GFLOPs and 0.565 seconds runtime. The approach demonstrates 23-63% improvements on minority classes while achieving 88% parameter reduction compared to teacher models.
Sun 12 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
16:00 - 18:30 | NLBSE ToolsNLBSE at Oceania VI Chair(s): Fabio Marcos De Abreu Santos Colorado State University, USA, Moritz Mock Free University of Bozen-Bolzano | ||
16:00 5mDay opening | NLBSE Tool Competition Opening NLBSE | ||
16:05 7mShort-paper | High-quality data augmentation for code comment classification NLBSE | ||
16:12 7mShort-paper | TraCC: Efficient Multi-Label Code Comment Classification Through Knowledge Distillation and Adaptive Thresholding NLBSE A: Pir Sami Ullah Shah FAST National University, A: Abdullah Ashfaq National University of Computer & emerging Sciences (FAST-NUCES), A: Ahmed Fasseh National University of Computer & emerging Sciences (FAST-NUCES), A: Dilawar Shah National University of Computer & emerging Sciences (FAST-NUCES) | ||
16:19 7mShort-paper | X-LoRA MME: Multi-Model Ensemble with Mixture of Experts for Code Comment Classification NLBSE | ||
16:26 7mShort-paper | Distilling Semantics: Efficient Multi-label Code Comment Classification NLBSE A: Muhammad Abdul Majeed National University of Computer & emerging Sciences (FAST-NUCES), A: Ahmed Bin Asim National University of Computer & emerging Sciences (FAST-NUCES) | ||
16:33 5mProduct announcement | NLBSE Tool Competition Awards and Closing NLBSE | ||
16:38 1h50mTutorial | NLBSE NVIDIA Tutorial: Building an LLM-based coding copilot NLBSE | ||
18:28 2mDay closing | NLBSE Closing NLBSE | ||