Causal Chain of Thought: Mitigating Attention Leakage via Context Isolation
AI Digest - ArXiv AI
Causal Chain of Thought: Mitigating Attention Leakage via Context Isolation
Chain-of-thought (CoT) prompting elicits step-by-step rationales that appear to explain model predictions, but there is no guarantee these steps causally drive the final answer. In standard autoregressive generation, dense attention allows each reasoning step to attend to the full context, enabling the model to derive answers through direct lookup while generating plausible-sounding but post-hoc justifications. We introduce CausalCoT, an inference framework that enforces causal transparency by d
Source: ArXiv AI