A new benchmark, AgentSWE, is introduced to evaluate the ability of coding agents to build agents that meet user requirements. The benchmark spans three stages of the agent development lifecycle and finds that current coding agents are not delivering what they promise. An empirical analysis of the failure trajectories identifies recurring failure modes that can be addressed by coding agents.