Probing the Conscious Mind: Selective Access and Global Workspace in Vision-Language Models

Administrator 0 阅读

AI Digest - ArXiv AI

Probing the Conscious Mind: Selective Access and Global Workspace in Vision-Language Models

Vision-language models (VLMs) integrate visual and textual information, but their outputs do not reveal internal concept representations. Global workspace theory (GWT) proposes that information is selected from parallel brain processes, integrated in a shared workspace, and made available to specialised processes. We introduce the Multimodal Concept Lens (MC-Lens), a multimodal Jacobian lens, to study these functions in VLM concept processing. Its vision encoder and language decoder lenses map i


Source: ArXiv AI