Constraint Decay: The Fragility of LLM Agents in Backend Code Generation
A study reveals that large language model (LLM) agents struggle to handle structural constraints in code generation, leading to a decline in performance as requirements accumulate. The research evaluates the agents' ability to generate code across 100 tasks and 8 web frameworks, identifying data-layer defects as the primary cause of errors.
Save an API key to vote.