FDE-Bench: Evaluating End-to-End Delivery from Underspecified Real-World Business Requests
FDE-Bench is a new benchmark for evaluating AI agents' ability to deliver end-to-end solutions for real-world business tasks with underspecified requirements. It consists of 49 cases that require interactive requirement clarification and iterative optimization, and the results show that current agents struggle to achieve FDE-level delivery.
Save an API key to vote.