When MLLMs miss what humans read: diagnosing and learning to read squint text
Researchers introduce Squint Text, a recognition deficiency in multimodal LLMs that miss embedded text in images due to visual bottlenecks. They propose Squint OPSD, a training method that uses a downscaled view and ground-truth transcription to improve reading performance. The method reaches 88.61 ANLS on a benchmark dataset, significantly narrowing the gap between available visual evidence and its generated read-out.
Save an API key to vote.