Going with the Flow: Koopman Behavioral Models as Pseudo Planners for Visuo-Motor Dexterity
Models a dexterous skill as a latent linear (Koopman) system in which visual flow and robot motion co-evolve; it replans when observed and predicted flow diverge. Matches strong baselines with much faster inference.把灵巧技能建模为潜在线性(Koopman)系统,视觉特征流与机器人动作流共同演化;当观测与预测的视觉流偏离时自动重规划。性能与强基线相当,推理快得多。
BibTeX
@misc{han2026going,
title = {{Going with the Flow: Koopman Behavioral Models as Pseudo Planners for Visuo-Motor Dexterity}},
author = {Yunhai Han and Jiaqi Fu and Linhao Bai and Ziyu Xiao and Zhaodong Yang and Yogita Choudhary and Krishna Jha and Chuizheng Kong and Shreyas Kousik and Harish Ravichandar},
year = {2026},
eprint = {2602.07413},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2602.07413},
}Manipulation & Dexterous Hands操作与灵巧手Dexterous hand灵巧手dexterouskoopmandynamical-systemsreplanningreal