MaxIM: Maximally Informative Incremental Summarization via Reinforcement Learning
AI Digest - ArXiv AI
MaxIM: Maximally Informative Incremental Summarization via Reinforcement Learning
AI systems must often maintain bounded memory of unbounded interaction histories. However, optimizing the memory representation, and its updates, for downstream task utility is difficult for standard reinforcement learning (RL) due to severe credit assignment bottlenecks induced by sparse, delayed rewards. We introduce MaxIM (Maximally Informative Incremental Memory), a framework that formulates incremental summarization as a capacity-constrained, information-theoretic reward-shaping problem. Gr
Source: ArXiv AI