Interactive Memory Learning for Long-Term Conversations
When an agent learns what to remember from later conversational rewards, memory becomes a policy over the user's future context and therefore requires governable rights to inspect, correct, delete and constrain that policy.
Review
Ke and colleagues recast long-term conversational memory from passive storage into a learned policy. ICML separates a Planner that decides which information merits encoding from a Trigger that decides when stored information should be retrieved. Delayed reward links later conversational feedback to earlier memory decisions, allowing both components to co-evolve as interactions accumulate. Experiments across three long-term conversation datasets report improved generation metrics against memory baselines while maintaining low latency and stable token use.
The architectural move is governance-relevant because memory selection is not neutral archival machinery. The Planner determines which observations about a person become durable; the Trigger determines when that retained state re-enters future contexts; delayed reward determines which past storage choices are reinforced. Together these components exercise persistent decision rights over the informational representation through which the agent subsequently encounters the user.
The paper operationalizes conversational utility effectively, but utility and legitimate memory authority are different propositions. Its evaluation prioritizes open-domain engagement and personalized alignment, and the authors explicitly bound the work away from rigid reasoning and fact-retrieval tasks. For deployment, the paper does not make privacy, consent, correction, deletion, purpose limitation or user-visible memory governance part of the learning objective. A memory policy can therefore improve measured personalization while preserving an erroneous inference, retaining information the user no longer wants remembered, or learning retrieval behavior whose rationale is opaque to the person affected.
A stronger governance layer would make memory state inspectable and attributable, distinguish user assertions from system inferences, support correction and deletion that also invalidate downstream learned effects, and constrain reinforcement by explicit retention and purpose rules. Otherwise self-evolving memory risks converting successful interaction into implicit authorization for persistent processing.
Key Insight
When an agent learns what to remember from later conversational rewards, memory becomes a policy over the user's future context and therefore requires governable rights to inspect, correct, delete and constrain that policy.