This study explores efficient benchmarking methods for production LLM agents, including random sampling, historical caching, fixed representative subsets, and IRT-based adaptive testing. The authors report that multidimensional 2PL adaptive testing achieves the best score fidelity, but also highlight the operational simplicity of difficulty-stratified fixed subsets. The study provides practical recommendations for recurring production-agent evaluation.