Individual fairness testing evaluates a machine learning (ML) classifier by estimating its individual fairness ratio (IFr) and has become an important approach for assessing ML classifiers. However, existing studies on ML fairness testing focus exclusively on the Fairness Through Awareness (FTA) setting, where protected attributes are explicitly used. In this study, we introduce the first framework for individual fairness testing under Fairness Through Unawareness (FTU), where protected attributes are not explicitly available. The proposed framework, called IFT_UNAWARE , evaluates a classifier by estimating its IFr in the FTU setting. It extends individual fairness testing approaches developed for FTA by incorporating techniques, including protected attribute inference with confidence control, a generalized notion of individual similarity, and statistically guaranteed termination criteria. Our experiments show that IFT_UNAWARE can compute IFr estimates with statistical guarantees and demonstrate the effectiveness of both the generalized simi- larity notion and confidence-based protected attribute inference. These results highlight both the feasibility and the limitations of assessing individual fairness under FTU and provide a foundation for future methodological advances.
Wed 20 MayDisplayed time zone: Seoul change
15:30 - 17:00 | Security, Fairness & Architectural AlignmentResearch Papers / Industry at Room 101 Chair(s): Amjed Tahir Massey University | ||
15:30 25mTalk | Do Language Models Prefer Vulnerable Code? A Probabilistic Study of Insecure Code Preference Research Papers Rui Melo Carnegie Mellon University and Faculty of Engineering, University of Porto, Sofia Reis Faculty of Engineering of the University of Porto, Andre Catarino Faculty of Engineering, University of Porto, Rui Abreu University of Porto Pre-print | ||
15:55 25mTalk | Raven: Mining Defensive Patterns in Ethereum via Semantic Transaction Revert Invariants Categories Research Papers Mojtaba Eshghie Umeå University, Melissa Mazura KTH Royal Institute of Technology, Alexandre Bartel Umeå University | ||
16:20 25mTalk | Individual Fairness Testing in Fairness through Unawareness Research Papers | ||
16:45 15mTalk | Formalizing Test Levels for Architectural Alignment and Overall Optimization Industry | ||