On the Generalization Capacities of MLLMs for Spatial Intelligence

TL;DR

We show that RGB-only MLLMs are fundamentally flawed for spatial reasoning due to an inherent geometric ambiguity, and propose a camera-aware MLLM framework that incorporates camera intrinsics for robust, generalizable spatial intelligence.

Opening excerpt from the authors’ abstract. source