Prediction-Powered Smoothing and Validation for Disaggregated AI Evaluation
A new method for improving the evaluation of AI systems, particularly in deployed agents, by using prediction-powered smoothing and validation. The method improves point and interval estimation, especially when labels are few, and provides a new cross-validation score for choosing among estimators.
Save an API key to vote.