Probing Spatial State Representations in Visual Foundation Models
AI Digest - ArXiv AI
Probing Spatial State Representations in Visual Foundation Models
An observer sees only part of the surrounding world, yet must keep track of what lies beyond the current view. Spatial perception therefore involves more than recognizing individual images: it calls for a persistent spatial state that is updated under self-motion and used to guide action. Do visual foundation models provide representations that support such a state? We study this question through four levels of spatial capability---spatial structure, object persistence, predictive spatial update
Source: ArXiv AI