AI & ML
RecallFlow: Episodic Memory as the Source Distribution of Generative Robot Policies
arXiv cs.RO0 views
arXiv:2611.23731v1 Announce Type: new Abstract: Diffusion and flow-matching policies have become a standard choice for visuomotor imitation learning, owing to their ability to model multimodal action distributions. In memory-dependent manipulation, the robot must act on information that is no longer visible. Existing methods feed the observation history to the policy as an additional condition, while action generation still starts from Gaussian noise. However, the policy must then pick out the relevant target from a long and redundant history, leading to spurious correlations and unreliable decisions as the memory load grows. Additionally, the initial noise carries no information about what the robot has seen, leaving generation without guidance toward the remembered target. To address these issues, we propose RecallFlow, a flow-policy framework that builds the source distribution from episodic memory. Recall-Relocalization relates the memory to the current view through a few recall slots, so that the source reflects where the remembered targets are now. Recall Anchors then turns each slot into a Gaussian component of the source, enabling generation to start close to the intended action instead of from noise. The transport network then completes the action from the current observation alone, keeping inference nearly as cheap as a memoryless policy. We further build a suite of memory-dependent tasks grouped by memory load and compare all policies under a matched protocol. Extensive experiments show that RecallFlow achieves a state-of-the-art average success rate of 80.4% on the public MIKASA-Robo memory benchmark, and outperforms the strongest baseline by 20.3 points on our suite and by 18.8 points on four real-robot tasks.
Source:https://arxiv.org/abs/2611.23731PreviousImproving While Deployed: Learning Proactive End-to-End Driving from Imperfect Human Takeover DataNextZERITH V2.5: From Predictive Power to Policy Learnability
Related posts
An Interview With Eric Seufert About Agentic Commerce
0Stratechery
Bring charts, queries, and context into one shareable document: Introducing Grafana Notebooks
0Grafana Blog

Four Days Early: Why AI-Found Vulnerabilities Demand Protection That’s Already On
0Imperva Blog
Two language fields, not one: what grandparent songs taught us about input design
0dev.to UX
Análise de Ações com IA: Conheça o daily_stock_analysis
0dev.to GitHub
Phân tích dữ liệu Lorient vs Rennes: Sự chuyển dịch cán cân áp đảo tại Ligue 1
0dev.to Data