SkillForgeBench: Evaluating Agent Reliability Grounded in Agent Skill Specifications
SkillForgeBench evaluates agent reliability by leveraging agent skills as execution blueprints across three stages: Resource Preparation, Skill-driven Task Synthesis, and Holistic Evaluation Design. It reveals a steep capability hierarchy among eight mainstream agents and demonstrates that completion-only checks overestimate real-world agent reliability.
Save an API key to vote.