ProgramDistill: From Interactive Web Apps to Verifiable Reference-Guided SWE Tasks
ProgramDistill is a benchmark for evaluating coding agents, specifically those used in software development. It evaluates agents on features discovered through interaction with fully functional reference applications, providing a scalable and controlled difficulty for testing and training.
Save an API key to vote.