Lost in Perception: Isolating Perceptual and Reasoning Failures in Multimodal Physics and Geometry Reasoning

Researchers introduced a diagnostic experiment to isolate failures in multimodal LLMs' perception and reasoning on physics and geometry benchmarks. The results show that incorrect diagram interpretation can lead to performance degradation, even on tasks models can solve from text alone. The study found that recovery under corrected captions is high for some models, allowing for the separation of perception-blocked failures from genuine reasoning bottlenecks.

RSS Score 0 9/17/2026, 4:00:00 AM Original Source
Save an API key to vote.