VLMs have Tunnel Vision: Evaluating Nonlocal Visual Reasoning in Leading VLMs

TL;DR

Vision Language Models (VLMs) excel at complex visual tasks such as VQA and chart understanding, yet recent work suggests they struggle with simple perceptual tests…

Opening excerpt from the authors’ abstract. source