Lost in Perception: Isolating Perceptual and Reasoning Failures in Multimodal Physics and Geometry Reasoning
Researchers introduced a diagnostic experiment to isolate failures in multimodal LLMs' perception and reasoning on physics and geometry benchmarks. The results show that incorrect diagram interpretation can lead to performance degradation, even on tasks models can solve from text alone. The study found that recovery under corrected captions is high for some models, allowing for the separation of perception-blocked failures from genuine reasoning bottlenecks.
Save an API key to vote.