Beyond the Name: Demographic Leakage in De-Identified R\'esum\'es and Evaluation Artifacts in LLM Bias Audits
Researchers found that de-identified resumes can still leak demographic information through non-language prose, and that LLMs are affected by the design of evaluation protocols, including the handling of ties in pairwise judgments. This highlights the need for careful consideration of evaluation design and the potential for demographic signals to be recovered from resume content.
Save an API key to vote.