Tue 11/10, 5:00–6:30 PM · JW Marriott · 231 papers · Lone Star (3rd floor): posters 1–116 · Griffin (2nd floor): posters 117–232
Jialei Chen, Kai Wang, Kang Chen, Shuaihang Chen et al.
World action model without video generation: predicts future features in a vision foundation model's latent space as policy subgoals. Reports 98.6% on LIBERO and up to 24× lower latency than pixel WAMs.不生成视频的世界动作模型:在视觉基础模型的特征空间中训练潜动作模型,预测未来观测特征作为“潜在视觉子目标”来条件化动作生成。报告 LIBERO 98.6%、RoboTwin 91.22%,每个动作块推理 187 ms,比像素级 WAM 延迟低最多 24 倍。
Jadelynn Dao, Milan Ganai, Yasmina Abukhadra, Ajay Sridhar et al.
A router picks a VLM planner per subtask from scene context (CoT depth, model size, memory). On a Franka DROID setup it matches a stronger model's success at up to 65% lower average latency.路由器根据场景上下文为每个子任务选择 VLM 规划器(思维链深度、模型规模、记忆长度)。在 Franka DROID 平台上以最多降低 65% 的平均延迟达到更强模型的成功率。
Andrew Zou Li, Gokul Swamy, Yonatan Bisk, Andrea Bajcsy
Learns, with RL, a meta-policy that picks per state how many denoising steps (sequential) and candidate samples (parallel) a frozen diffusion/flow policy gets, trading success against compute.用强化学习训练一个元策略,按状态决定冻结的扩散/流策略在每步分配多少去噪步数(串行)和多少候选采样(并行),在成功率与计算量之间权衡。
Xiaopeng Zhang, Yongjin Mu, Yueyang Weng, Chengzhi Zhao et al.
Distills intermediate denoising features of a video diffusion model into an action model during training and drops the video model at test time. Reports 95.9% on LIBERO and about 21x faster inference than a WAM baseline.训练时把视频扩散模型的中间去噪表示蒸馏进动作模型,测试时完全丢弃视频模型。在 LIBERO 上报告 95.9% 平均成功率,推理比代表性世界动作模型快约 21 倍。
Yiheng Ji, Xingru Zhou, Luis Sentis, Mingyo Seo
Keeps the last denoising step of a diffusion VLA as a fast feedback layer, so each action is corrected with the newest image. Reports dynamic sim tasks 27.5% to 85.0% and real tasks 51% to 73%.把扩散 VLA 的最后一步去噪保留为快速反馈层,用最新图像修正每个动作。报告动态仿真任务从 27.5% 升到 85.0%,真机任务从 51% 升到 73%。
Wenbo Yu, Jifan Li, Wenke Xia, Yuchen Li et al.
FreeBar: training-free plugin that keeps consecutive action chunks of flow-based VLAs consistent with a CBF-style constraint solved in closed form, with little extra inference cost.FreeBar:无需训练的推理插件,用闭式求解的类 CBF 一致性约束让流式 VLA 的相邻动作块与已执行动作衔接,额外推理开销很小。
Pengcheng Wang, Kaiwen Hong, Chensheng Peng, Katherine Driggs-Campbell et al.
Shows discrete diffusion policies do real-time chunking natively, since inpainting is just unmasking: no fine-tuning, ~0.7x compute. Reports 65% higher success than flow-matching RTC on a real hockey task.指出离散扩散策略天然支持实时分块异步执行(补全即解掩码),无需微调、计算量约为 0.7 倍。报告在真机冰球防守任务上成功率比流匹配 RTC 高 65%。
Zekai Li, Jiaming Tang, Zhijian Liu
Keeps a streaming buffer of action chunks at different noise levels with chunk-wise causal attention, so each inference step emits one executable chunk and asynchronous execution stays smooth.维护一个包含多个不同噪声水平动作块的流式缓冲区,并使用块级因果注意力,使每次推理产出一个可执行动作块,异步执行时动作保持连贯。
Trong-Bao Ho, Quang-Tan Nguyen, Thien-Loc Ha, Gia-Binh Nguyen et al.
PAINT keeps action chunks consistent under async execution by picking the initial noise (backward Euler inversion), not by guiding the flow. No training; reports RTC-level task success with better prefix consistency.PAINT 通过选择初始噪声(后向欧拉反演)而非引导流场,让异步执行时的动作块首尾一致;无需训练,报告任务成功率与 RTC 相当、前缀一致性更好。
Haoyu Wei, Xiuwei Xu, Ziyang Cheng, Hang Yin et al.
Predicts object flow to synthesize future observations, aligned to real future frames by a contrastive loss, so an asynchronous policy can act ahead of its own latency on moving objects.利用预测的物体流合成未来观测,并以对比学习目标使其特征与真实未来帧对齐,让异步策略能提前补偿自身延迟,处理运动中的物体。
Sangkyu Lee, Seohyeon Park, Tackgeun You, Avi Caciularu et al.
Shows autoregressive policies can run in real time by tuning the tokenization horizon and constrained decoding under strict latency bounds; reports they beat an equivalent flow-matching policy.说明通过调整分词时域并在严格延迟上限下做约束解码,自回归策略也能实时执行;报告其表现优于同级别的流匹配策略。
Pankhuri Vanjani, Zhuoyue Li, Jakub Suliga, Moritz Reuss et al.
Lets each modality update at its own sensor rate through latent buffers read by the action head, adding fast signals via gated cross-attention. Reports 95.2% vs 40.95% on seven contact-rich real tasks at 100 Hz.各模态按各自传感器频率刷新潜在缓存,供动作头持续读取,高频信号通过门控交叉注意力接入。报告在七个富接触真机任务上成功率 95.2%,对比基线 40.95%,控制频率 100 Hz。
Jonathan C. Kao, Jason Chan, Andy Wang
Steers a flow-matching VLA in real time from a keyboard by writing the user input into the action expert's initial noise; no retraining. Fine-tuning on steered runs also improves the autonomous policy.把键盘等简单用户输入写入流匹配动作专家的初始噪声,即可实时引导 VLA,无需重训;用引导后的轨迹微调还能提升自主策略。
Rohan Bansal, David He, Nadun Ranawaka Arachchige, Zhenyang Chen et al.
Serving one robot policy to a fleet from a remote GPU, posed as scheduling. Naive batching fails when robots consume action chunks at different rates; their scheduler reports up to 18% higher real-world throughput.把从远程 GPU 为多台机器人提供策略推理建模为调度问题。当各机器人消耗动作块的速度不同时,简单批处理失效;所提调度算法在真机上报告吞吐量最高提升 18%。
Quentin Clark, Florian Shkurti
Finds that shift equivariance, local receptive fields and inference choices let diffusion planners stitch sub-trajectories without TD learning; locality matters most. Proposes the Eq-Net architecture.发现平移等变性、局部感受野和推理设置使扩散规划器无需 TD 学习就能拼接子轨迹,其中局部性最关键;据此提出 Eq-Net 架构。
Kechun Xu, Zhenjie Zhu, Anzhe Chen, Rong Xiong et al.
Pretrain the action expert first as a language-free vision-action prior, then inject language through gated fusion. Targets VLAs that ignore unseen instructions; works with π-style and GR00T-style designs.先把动作专家预训练为不含语言的视觉-动作先验,再通过门控融合注入语言。针对 VLA 对未见指令泛化差的问题,适用于 π 系和 GR00T 系架构。
Shiang-Feng Tsai, Jin-Cheng Jhang, Yen-Ling Tai, Jia-Hong Lai et al.
Feeds a grounded 3D target point through a two-layer MLP straight into a VLA's action head. On LIBERO-PRO it lifts GR00T-N1.6 from 31.2 to 77.5 under task perturbation; π0.5 gains similarly.把一个已定位的 3D 目标点经两层 MLP 直接注入 VLA 的动作头。在 LIBERO-PRO 任务扰动下,GR00T-N1.6 成功率从 31.2 提升到 77.5,π0.5 也有类似提升。
Yuri Ishitoya, Jeremy Siburian, Masashi Hamaya, Kuniaki Saito et al.
Turns a VLM into a VLA without architecture changes by writing a short language action description before the numeric action tokens. 2B model reports 90.8% on LIBERO after 4–5 hours of training; 0.8B–4B weights.不改结构直接把 VLM 变成 VLA:在数值动作 token 之前先生成一句自然语言动作描述。2B 模型训练 4–5 小时,报告 LIBERO 90.8%;发布 0.8B–4B 开放权重。
Shuo Liu, Ishneet Sukhvinder Singh, Yiqing Xu, Jiafei Duan et al.
Adapts a frozen diffusion or flow policy at test time: a VLM writes differentiable rewards that steer denoising when obstacles or clutter shift the scene. Reports +31% on CALVIN and +13% on LIBERO-PRO; no retraining.在测试时适配冻结的扩散或流匹配策略:当障碍或杂物改变场景时,由 VLM 生成可微奖励来引导去噪。报告 CALVIN 提升 31%、LIBERO-PRO 提升 13%,无需重新训练。
Jason Chan, Jonathan C. Kao
Steers autoregressive VLAs at inference by injecting low-dimensional user input into the action-token space. Reports success from 10.0% to 72.5% and 16.7% to 93.8% on two household tasks.推理时把低维用户输入注入自回归 VLA 的动作 token 空间来引导轨迹,无需训练。报告两个家务任务成功率分别从 10.0% 升到 72.5%、从 16.7% 升到 93.8%。
Yiyuan Pan, Hanjiang Hu, Shangtao Li, Xusheng Luo et al.
ReStruct splits a policy into a state-machine skeleton and residual controller; a VLM turns a language preference into a temporal-logic automaton that reshapes the skeleton. 92.5% preference success on a real robot.ReStruct 把视觉运动策略分解为状态机骨架和残差控制器;VLM 把语言偏好编译成时序逻辑自动机来重构骨架。真机上偏好遵循成功率 92.5%。
Chuanruo Ning, Tianrui Wang, Wei-Chiu Ma, Kuan Fang
Adapts a frozen generalist policy at inference: two small proxies (one copies base behaviour, one is fine-tuned on the task) and their velocity difference steers each denoising step. Base weights are not needed.推理时适配冻结的通用策略:训练两个小代理策略(一个模仿基座行为,一个在目标任务上微调),以二者的速度场差值引导每一步去噪。无需访问基座参数。
Jiahong Tang, Jiaju He, Zhiyuan Yang, Ruyang Han et al.
Improves a frozen one-step generative policy offline by learning a residual on its input noise, trained with advantage-weighted reconstruction instead of critic gradients, so the base behavior does not drift.离线改进冻结的一步生成策略:学习对输入噪声的残差修正,用优势加权的动作重建来训练而不是用评论家梯度,从而避免偏离原有行为。
Michael Murray, Daphne Chen, Simran Bagaria, Dean Fortier et al.
CoRL 2026 Spotlight. Adapts frozen generative policies from human interventions in latent space, as a cheaper alternative to mass data collection or online RL on hardware.CoRL 2026 Spotlight。在隐空间中根据人类干预适配冻结的生成式策略,替代大规模采集或实机在线强化学习。
Tung M. Luu, Tri Ton, Duc M. Nguyen, Xuan Thanh Nguyen et al.
Fine-tunes diffusion and flow policies with automatic preference labels: rollouts are ranked by progress measured against a few expert demos, no human labels or reward design. Reports beating SFT on long-horizon tasks.用自动生成的偏好标签微调扩散与流匹配策略:以少量专家示教为参照衡量自主回放的顺序进度并据此排序,无需人工标注或手工奖励;报告在长时程操作任务上优于监督微调基线。
Haru Kondoh, Kei Ota, Asako Kanezaki, Yueh-Hua Wu
Turns expert demos into negative supervision by pairing actions with mismatched instructions, training an instruction-grounded reward for offline RL of VLAs. More robust on LIBERO-PRO and a real AgiBot-G2-type robot.把专家动作与不匹配的指令配对生成反事实样本,训练与指令对齐的奖励模型,用于 VLA 离线强化学习,无需额外采集。在 LIBERO-PRO 和真机上提升鲁棒性。
Zeyuan He, Bowen Yang, Zhirui Fang, Keru Zhou et al.
Adds an auxiliary branch that predicts future 3D tracks of robot keypoints, computed for free by forward kinematics, with gradient isolation from the VLM. The branch is dropped at inference.增加一个辅助分支,预测机器人关键点未来的 3D 轨迹(由正运动学免费得到),并与视觉语言主干做梯度隔离。推理时丢弃该分支,策略接口不变。
Michael Piseno, Guy Tevet, C. Karen Liu
Masks the end-effector in the wrist camera (rendered from known geometry, plus mask augmentation). A VLA trained on one parallel gripper then transfers zero-shot to another gripper, another arm and a five-finger hand.在腕部相机画面中遮住末端执行器(依据已知几何实时渲染遮罩,并做遮罩增强)。只用单一平行夹爪数据训练的 VLA 可零样本迁移到其他夹爪、其他机械臂和五指手。
Jaehyeon Son, Junhyun Kim, Kyle Kam, Jeremiah Coholich et al.
A VLA conditioned on one demo video of an unseen task predicts visibility-aware future end-effector traces for precise grounding. Releases RoboCasa-DC; reports +9.5 pts real-world success from human demos.以未见任务的一段示教视频为条件的 VLA,通过预测考虑可见性的未来末端轨迹实现精确定位。发布 RoboCasa-DC 基准;在以人类示教为条件的真机实验中成功率提升 9.5 个百分点。
Mingyu Liu, Zeju Li, Jiuhe Shu, Hanqing Wang et al.
Fluent expert demos rush through alignment and recovery. Slowing down there and resampling those segments helps; STAIR adds a compact short-horizon motion feature between the VLM and the action expert.熟练的示教会把对准与纠错一带而过,导致策略在关键处缺少监督。在这些片段放慢、重采样有帮助;STAIR 进一步在 VLM 与动作专家之间加入紧凑的短时运动特征。
Audrey Lee, Nathaniel Dennler, Ilia Sucholutsky, Andreea Bobu
FLEX lets language corrections edit a robot's task features via add, generalize and mask (not add-only). Reports higher normalized reward than other editing methods in 2D nav, Franka tabletop and a real user study.FLEX 用自然语言纠正来迭代修改机器人的任务特征集合,支持添加、泛化、屏蔽三种操作(而非只能添加);在二维导航、Franka 桌面操作和真实用户研究中报告比其他特征编辑方法获得更高的归一化奖励。
Aiden Swann, Lachlain McGranahan, Hugo Buurmeijer, Monroe Kennedy et al.
Trains sparse autoencoders on VLA activations and finds features for motion primitives and concepts that transfer across episodes and can be amplified to steer behaviour. LIBERO + real DROID tests.在 VLA 隐层激活上训练稀疏自编码器,发现对应运动基元和语义概念、可跨回合迁移的特征,放大这些特征即可引导行为。在 LIBERO 和真实 DROID 平台验证。
Andy Tang, William Chen, Andrew Wagenmaker, Chelsea Finn et al.
Runs rough actions (from a human or a VLM) backwards through a flow policy to their noise, then forward again to land on a nearby good action mode. Distilling this reports up to 95-point success gains in under a minute.把粗糙动作(来自人或 VLM 的指引)反向送入流策略得到其噪声,再正向生成,落到附近的优质动作模态。将其蒸馏后,不到一分钟训练即可报告最高 95 个百分点的成功率提升。
Jiachi Yang, Zhiyi Xu, Hongquan Zhang, Xin Tan et al.
Adds skill-conditioned LoRA mixture-of-experts adapters to the LLM backbone and turns a predicted affordance heatmap into a spatial prior for the action head. Reports Avg. Len 4.65 on CALVIN ABC→D.在大模型主干中加入以技能为条件的 LoRA 混合专家适配器,并把预测的可供性热图转为动作头的空间先验。在 CALVIN ABC→D 上报告平均完成长度 4.65。
Chaoran Zhu, Hengyi Wang, Chenglin Cui, Yazhe Wan et al.
Aligning VLA features point-wise with 3D foundation models causes rank collapse; aligning pairwise relations instead adds 3D awareness without losing expressivity. Adds a new spatial reasoning benchmark.将 VLA 特征逐点对齐到 3D 基础模型会导致秩坍塌;改为对齐成对关系,可在不损失表达力的前提下注入 3D 空间感知。并提出新的空间推理基准。
Yizhi Chen, Zhanxiang Cao, Xinyi Peng, Yixiao Zheng et al.
Post-trains an RGB geometry branch with RGB-D supervision, then lets state-generated queries pull eight geometry tokens for action prediction. Reports 99.0% on LIBERO and 78.8% on eight real ALOHA tasks.先用 RGB-D 监督后训练 RGB 几何分支,再由机器人状态生成查询,提取 8 个几何 token 用于动作预测。报告 LIBERO 99.0%,八个真实 ALOHA 任务 78.8%。
Libang Zhao, Qixin Zeng, Hongyin Zhang, Donglin Wang
Info-VLA fights forgetting in continual VLA learning by keeping cross-modal structure: replay anchors from a frozen teacher for contrastive alignment, plus a vision-language mutual-information term.Info-VLA 通过保持跨模态信息结构来缓解 VLA 持续学习中的遗忘:以冻结教师模型构造回放锚点做对比对齐,并加入视觉-语言互信息约束。
Yun Li, Ehsan Javanmardi, Simon Thompson, Jiachen Gong et al.
Shivansh Patel, Kaifeng Zhang, Sanjay Pokkali, Svetlana Lazebnik et al.
PGRD simulates deformables with an optimizable spring-mass backbone plus learned residuals, reporting better accuracy than either alone; used for MPC and action-conditioned video prediction.PGRD 以可优化的弹簧质点模型为骨架,加上学习得到的残差来仿真可变形物体,报告精度优于单用任一方法;可用于 MPC 和动作条件视频预测。
Haocheng Yin, Shuohan Tao, Yongsheng Chen, Lu Gan
World model for deformable objects that couples a differentiable MPM simulator with networks that infer per-particle elasticity from video and correct the simulator's residual errors. Real manipulation sequences.可变形物体世界模型:可微 MPM 仿真器配合两个网络,一个从视觉推断逐粒子弹性,一个学习修正仿真器的残差误差。在真实操作序列上验证。
Wei-Chen Li, Jeffrey Fang, Sasanka Polisetti, Yuexi Song et al.
CORD-SLS pairs a GPU-parallel differentiable simulator with robust MPC and conformal bounds for rope and cloth, reporting millisecond planning with safety margins on hardware.CORD-SLS 将 GPU 并行可微仿真与鲁棒 MPC、共形预测误差界结合,用于绳索和布料操作,报告在实机上以毫秒级规划并保持安全裕度。
Xin Liu, Yulin Li, Ziming Li, Pengyu Jing et al.
Refines cloth actions online from one RGB image: a real-to-sim module estimates the cloth state, then simulator rollouts with prior-guided MPPI correct the policy's trajectory.仅凭单张 RGB 在线修正布料动作:先由 real-to-sim 模块估计布料状态,再用仿真器并行推演和先验引导的 MPPI 修正策略轨迹。
Stone Tao, Jie Xu, Hesam Rabeti, Yashraj Narang et al.
Sim-to-real RL for multi-stage cable routing: GPU-parallel cable simulation, localized policies and a simulation-in-the-loop executor. Reports higher success and 2x shorter cycle times than prior learning methods.多阶段线缆布线的仿真到真机强化学习:GPU 并行线缆仿真、局部化策略,加上执行时“仿真在环”的部署框架。报告成功率更高、节拍时间缩短一半。
Chongyu Zhu, Ramy ElMallah, Hyegang Kim, Zachary Tang et al.
CoRL 2026 Spotlight. Simulation benchmark for wires and cables in industrial assembly, aimed at the gap left by benchmarks tied to specific hardware or lacking modular, customizable task assets.CoRL 2026 Spotlight。面向工业装配中线缆等可变形线状物体(DLO)的仿真基准,针对现有基准绑定特定硬件、缺少模块化可定制任务资产等问题。
Yilong Wang, Cheng Qian, Edward Johns
In-context imitation for folding: from a single human demo, a flow-matching transformer infers and executes the shown folding mode without gradient updates. Trained only in sim, transfers zero-shot to real.面向折叠的上下文模仿学习:只看一条人类演示,流匹配 Transformer 即可推断并执行其中的折叠方式,无需梯度更新。完全在仿真训练,零样本迁移到真机。
Yuxing Chen, Zhiyuan Wei, Bowen Xiao, Zhizheng Zhang et al.
Synthetic T-shirt folding and unfolding data: 6 robots, 1K shirts, 120K episodes. Policies trained only on it are reported above 90% success on unseen real shirts.合成 T 恤折叠与展开数据:6 种机器人、1000 件 T 恤、12 万条轨迹。报告仅用其训练的策略在未见过的真实 T 恤上成功率超过 90%。
Arthur Jakobsson, Abhinav Mahajan, Karthik Pullalarevu, Krishna Suresh et al.
A short safe wiggle reveals rope parameters that condition a trajectory optimiser for zero-shot dynamic throws. Reports 3.55 cm average error on real 3D target striking vs 15.29 cm for uninformed baselines.先做一次短暂安全的“抖绳”动作来辨识绳子参数,再以此驱动轨迹优化,零样本完成动态甩绳。报告真机 3D 目标击打平均误差 3.55 cm,无辨识基线为 15.29 cm。
Ruijie Zheng, Dantong Niu, Yuqi Xie, Jing Wang et al.
CoRL 2026 Oral. Trains a VLA on over 20,854 hours of action-labeled egocentric human video to test whether large-scale human data can support fine, high-DoF dexterous manipulation.CoRL 2026 Oral。用超过 20,854 小时带动作标注的第一视角人类视频训练 VLA,检验大规模人类数据能否支撑高自由度精细灵巧操作。
Ye Wang, Pei Lin, Xiong-Hui Chen, Haoqi Yuan et al.
CoRL 2026 Spotlight. A pipeline that turns egocentric human manipulation videos into robot training data, testing whether this helps VLA pretraining at scale.CoRL 2026 Spotlight。把第一视角人类操作视频转换为机器人训练数据的流程,并检验其能否大规模助力 VLA 预训练。
Shuo Sha, Yixuan Wang, Binghao Huang, Antonio Loquercio et al.
CoRL 2026 Spotlight. Augments contact-rich teleoperation with corrective behaviors learned in simulation, using a simple kNN surrogate of the human operator.CoRL 2026 Spotlight。为富接触遥操作叠加在仿真中学到的纠正行为,并用简单的 kNN 模型替代人类操作员进行训练。
Yangcen Liu, Shuo Cheng, Xinchen Yin, Woo Chul Shin et al.
Converts egocentric human videos into robot data: a video with the human replaced by a robot plus a feasible robot action trajectory. Claims the first zero-shot dexterous visuomotor policy with no real-robot demos.把第一人称人类视频转为机器人数据:生成把人替换成机器人的视频,以及满足可行性约束的机器人动作轨迹。声称首次在无真机演示下零样本训练出灵巧视觉运动策略。
Jinho Jeong, Se June Joo, Jaehyun Kang, Dongyun Kim et al.
Converts human videos from five sources into robot-aligned observations and actions (about 630K episodes). Pretraining a VLA on more of it raises real-task completion from 51.5% to 80.3% and OOD from 34.9% to 72.2%.把五个来源的人类视频转换成与机器人对齐的观测和动作(约 63 万条轨迹)。报告用更多此类数据预训练 VLA,真机任务完成率从 51.5% 升到 80.3%,分布外从 34.9% 升到 72.2%。
Zhiyuan Xiang, Peidong Liu, Mingyang Li, Jiawei Li et al.
Continuous (not vector-quantized) latent actions learned from 23.3K hours of egocentric human video serve as pre-training labels for a VLA; reports consistent scaling gains.从 2.33 万小时第一人称人类视频中学习连续(非向量量化)的潜动作,结合感知、语义与光流对齐信号,作为 VLA 预训练的动作监督;报告随规模持续提升。
Hao Li, Ganlong Zhao, Yufei Liu, Haotian Hou et al.
Joint VLA pretraining on 4.53K h of robot/sim data plus 1.48K h of egocentric human video with pseudo-actions, camera-space actions and a reliability-weighted loss. Reports SOTA on RoboCasa GR1 TableTop and RoboTwin 2.0.用 4530 小时机器人/仿真数据加 1480 小时带伪动作的第一视角人类视频联合预训练 VLA,采用相机空间动作与按可靠性加权的损失。报告在 RoboCasa GR1 TableTop 和 RoboTwin 2.0 上达到最优。
Baoyu Li, Xinchen Yin, Mengying Lin, Yixin Zhang et al.
Controlled study of which world-prediction target best transfers egocentric human data to robots: pixels transfer weakly, DINO features give up to 4x OOD generalization, 3D flow gives +20–30% in domain.对照研究哪种世界预测目标最能把第一人称人类数据迁移到机器人:像素迁移较弱,DINO 特征带来最高 4 倍的分布外泛化,3D 运动流在域内提升 20–30%。
Brent Yi, Hongsuk Choi, Himanshu Gaurav Singh, Xiaoyu Huang et al.
CoRL 2026 Oral. Makes flow matching policy gradients work for robot control, bypassing action likelihoods, so policies need not be Gaussian. Applied to legged locomotion, humanoid motion tracking and manipulation.CoRL 2026 Oral。让流匹配策略梯度可用于机器人控制:绕过动作似然计算,策略不再限于高斯分布。应用于足式运动、人形动作跟踪与操作。
Charles Xu, Jost Tobias Springenberg, Michael Equi, Ali Amin et al.
CoRL 2026 Oral. Adapts a VLA to expose a compact RL token, an interface for sample-efficient online RL, so a pretrained policy gains precision and speed from a few hours of real-world practice.CoRL 2026 Oral。让 VLA 输出紧凑的 RL token 作为在线强化学习接口,预训练策略只需几小时真实练习即可提升精度与速度。
Xiaoman Li, Zhiqiang Yang, Jiayu Hu, Jipeng Kong et al.
Weights each action chunk by how much it shortens the path to success on a reachability graph built over demos, rollouts and interventions. Reports 91% on precise tasks after a few offline rounds; no reward model.在示教、rollout 与人工干预构成的可达图上,按每个动作块缩短到成功的步数来加权行为克隆。报告经几轮离线迭代在精细任务上达到 91%,无需奖励模型。
Zechen Wang, Zhenqi Qiu, Houlong Xiong, Suohang Zhang et al.
Advantage-conditioned BC for VLAs: predicts pairwise conditions directly and injects them into the DiT action expert via AdaRMS. On real retry-heavy data: 90.0% vs 56.7% (bowl stacking), 56.7% vs 33.3% (key hanging).面向 VLA 的优势条件行为克隆:直接预测成对条件,并通过 AdaRMS 注入 DiT 动作专家。在含大量重试的真机数据上,叠碗成功率 90.0%(基线 56.7%),挂钥匙 56.7%(基线 33.3%)。
Xinyu Zhou, Zikun Cai, Kuangji Zuo, Gen Li et al.
One-step flow policy that puts observation, timestep and action tokens in one sequence for a single transformer. Reports 86.4% average success (+7.5 points) at 3.0 ms latency, 43.9x faster than DP3.一步生成的流策略:把观测、时间步与动作 token 拼成一个序列,由同一 Transformer 联合建模。报告平均成功率 86.4%(提升 7.5 个百分点),推理延迟 3.0 ms,比 DP3 快 43.9 倍。
Koki Seno, Daichi Yashima, Yusuke Takagi, Kento Tokura et al.
Models robot flow as dense velocity fields in a flow-matching formulation rather than sparse keypoint displacements, about 24x faster than standard flow matching; tested in 13 real tasks with 260 trials per method.在流匹配框架中把机器人流建模为稠密速度场,而非稀疏关键点位移,生成速度比标准流匹配快约 24 倍;在 13 个真实任务上每种方法测试 260 次。
Seoyoon Kim, Kanghyun Kim, Dongwoo Ko, Yeong Jin Heo et al.
Single-camera diffusion policy: points along intermediate end-effector trajectories in the denoising loop sample multi-scale image features, acting as attention anchors. Comparable to multi-camera baselines in sim.单相机扩散策略:在去噪循环中沿中间末端轨迹的点采样多尺度图像特征,作为视觉注意力锚点。仿真中表现与多相机基线相当。
Dian Yu, Sebastian Sanokowski, Majid Khadiv
Feynman-Kac correctors with a new guiding potential push diffusion-policy samples toward rare but promising modes; trajectory optimization repairs them and they are added back to training.用 Feynman-Kac 校正器配合新的引导势能,把扩散策略的采样推向少见但有前景的模态;再以基于采样的轨迹优化修复这些轨迹,并加回训练集重训策略。
Meipo Dai, Qiyuan Zhuang, He-Yang Xu, Ying-Jie Shuai et al.
LeaP replaces the standard Gaussian source of a flow/diffusion-bridge policy with a proprioception-conditioned Gaussian over action chunks from a small MLP. 81.6% average on 15 RoboTwin tasks.LeaP 用一个小型 MLP 预测、以本体感觉为条件的动作块高斯分布,替换流匹配/扩散桥策略的标准高斯起点。在 15 个 RoboTwin 任务上平均成功率 81.6%。
Seung Hyun Lee, Stella X. Yu
Replaces a policy MLP's first layer with learned multiplicative (bilinear) features, plug-and-play for RL and imitation. Reports humanoid survival up from 51.0% to 92.5%, holding under friction and payload shifts.把策略 MLP 的第一层替换为可学习的乘性(双线性)特征,即插即用于强化学习与模仿学习。报告人形机器人存活率从 51.0% 提升到 92.5%,在摩擦、负载变化下依然有效。
Andrew Kang, Priya Narasimhan
Behavioral INR represents a policy as a state-to-action function modulated by an episode latent (FiLM), so policy identity in unlabeled multi-policy data can be inferred without labels.Behavioral INR 把策略表示为由回合级潜变量(FiLM)调制的“状态→动作”函数,从而在无标签的多策略行为数据中无监督地推断策略身份。
Filippo Lazzati, Kyle Stachowicz, William Chen, Alberto Maria Metelli et al.
Tests why action chunking helps BC: not temporal consistency or horizon reduction, but non-Markovian expressivity and less compounding error (also matched by delayed policies), plus an 'implicit ensembling' effect.检验动作分块为何有助于行为克隆:并非时间一致性或缩短时域,而是非马尔可夫表达力与更少的误差累积(延迟策略也能做到),另外还有一种“隐式集成”效应。
Alec Laprevotte, Haonan Chen, Xiaoshen Han, Yilun Du
Composed diffusion policies often learn identical components. A drop-in score-decorrelation loss makes each factor specialize, with no loss in multitask performance.组合式扩散策略的各个分量常常学成相同的副本。即插即用的得分去相关损失让各分量各自专门化,且不损失多任务性能。
Hao Wang, Jiuzhou Lei, Dayou Li, Bangya Liu et al.
MoRE 'unclones' unwanted behavior modes (e.g. handing a knife blade-first) by distilling a temporary mode classifier into the policy weights, with a retain loss. +44 pts success across eight tasks, no inference cost.MoRE 通过把临时模式分类器的重定向信号蒸馏进策略权重,并配合保持损失,“去克隆”不想要的行为模式(如刀刃朝前递刀)。八个任务平均成功率提升 44 个百分点,推理零开销。
Nethmi Jayasinghe, Diana Gontero, Amit Ranjan Trivedi
Sleeping Robots: learn a new skill while 'awake', then consolidate one shared policy offline during 'sleep' from frozen critics or actor snapshots, combining gradients by Nash bargaining. +64% success on Meta-World MT5.Sleeping Robots:“清醒”时学习新技能,“睡眠”时利用冻结的评估器或策略快照离线巩固单一共享策略,并以纳什议价合并梯度。在 Meta-World MT5 上平均成功率提升 64%。
Xinyao Qin, Junjie Lu, Kaixin Wang, Chuheng Zhang et al.
ReTVL learns a mistake-sensitive value function from imperfect demos, using sparse retry keypoints as pairwise preferences on top of global progress, then reweights demo chunks for behavior cloning.ReTVL 从不完美示教中学习对失误敏感的价值函数:在全局进度校准之上,以稀疏标注的“重试”关键点构造局部成对偏好,再用该价值为行为克隆的示教片段加权。
Kaneyoshi Hiratsuka, Benjamin Yen, Ryosuke Kojima
New manipulation tasks where the target must be found by sound, plus an imitation framework that adds acoustic spatial and spectral features to ACT, Diffusion Policy, VQ-BeT and π0. Sim + real.提出需要靠声音确定操作目标的新任务,以及把声源空间信息与频谱特征接入 ACT、Diffusion Policy、VQ-BeT 和 π0 的多模态模仿学习框架。仿真与真机验证。
Jiawen Wang, Kevin Yao, Khalid Jawed
Diffusion policy with an obstacle-aware encoder that splits the scene into target, obstacle and background. 61 real greenhouse trials per method: 75.41% success and 8.20% collision rate.带障碍感知编码器的扩散策略,把场景分解为目标、障碍和背景。每种方法在温室真机测试 61 次:成功率 75.41%,碰撞率 8.20%。
Tim Walter, Xinyu Chen, Jonathan Külz, Matthias Althoff
CoRL 2026 Spotlight. A morphology-conditioned implicit neural model of pose reachability, differentiable, self-collision aware and able to generalize to unseen morphologies.CoRL 2026 Spotlight。以形态为条件的隐式神经位姿可达性模型,可微、考虑自碰撞,并能泛化到未见形态。
Chang Guo, Yukun Xie, Bohan Tan, Zheng Chang et al.
Benchmark showing VLA success often hides weak instruction following: scenes allow several valid tasks so language matters. Nine VLA and WAM policies drop sharply beyond the base level.揭示 VLA 的高成功率常掩盖薄弱的指令遵循:场景支持多种合法任务,必须依赖语言。九个 VLA 与 WAM 策略在基础级以外的测试中明显下降。
Xunzhe Zhou, Yiyang Cai, Fengyi Wang, Ran Ju et al.
Four-level benchmark that widens the gap between a human demo and the robot's scene, plus IG-10K (20,000+ paired human-robot episodes). Nine models collapse at the hardest level; all stay below 13% zero-shot.四级基准逐步拉大人类演示与机器人场景的差异,并发布 IG-10K(2 万余条人-机配对片段)。九个模型在最高级别全面失效,未见任务零样本成功率均低于 13%。
Haoran Wang, Jingwei Huang, Anqing Duan, Ho Seok Ahn et al.
HelpMeOut: 20,000 paired household activity episodes with nine neuropsychology-based error types; agents must spot when a person's task execution goes wrong. Learned, symbolic and LLM monitors all do poorly.HelpMeOut:2 万对家务活动片段,涵盖九类基于神经心理学的执行错误,要求智能体尽早发现人做事出错。学习型、符号型与大模型监控方法表现都较差。
Florian Seligmann, Emiliyan Gospodinov, Enes Ulas Dincer, Gerhard Neumann
Two cheap failure detectors for fine-tuned VLAs that need no failure data: last-layer Mahalanobis distance and consistency between overlapping action chunks, plus a metric that also scores detection time.为微调后的 VLA 提出两种无需失败数据的轻量失败检测器:末层特征马氏距离与相邻动作块一致性,并提出同时衡量检测时间的指标。
Quentin Rolland, Fabrice Mayran de Chamisso, Jean-Baptiste Mouret
Self-supervised failure detection from nominal demos only, using object-centric spatio-temporal scene graphs; both of its scores beat image-based detectors, especially on semantic and interaction failures.仅用正常演示做自监督失败检测:把操作场景建模为以物体为中心的时空图,所提两种失败评分都优于基于图像的检测器,尤其擅长语义和交互层面的失败。
Bowen Li, Mayank Mishra, Y. Isabel Liu, Stone Tao et al.
Learns recovery skills with RL and, from them, discovers new relational predicates for an abstract planner, turning local recoveries into failure avoidance. Reports >50% gains over baselines in four sim domains.用强化学习学习失败恢复技能,并据此发现新的关系谓词、完善抽象规划模型,把局部恢复转化为全局避免失败。报告在四个仿真领域比基线高 50% 以上,并迁移到真机。
Haoran Hao, Shahram Najam Syed, Jeffrey Ichnowski, Jeff Schneider
Retries that learn from failure: preference pairs from failed attempts steer the policy away from them, plus small action perturbations, and feeds recoveries back into training. Reports +17.6% sim, +11.7% real.会从失败中学习的重试机制:用失败尝试构造偏好数据,引导策略避开失败行为,并加入小幅动作扰动做局部探索,成功恢复的轨迹再回流训练。报告仿真提升 17.6%,真机提升 11.7%。
Suyeon Shin, Juwon Kim, Hyeonbin Park, Hyunseo Kim et al.
B2FF: before execution the VLA imagines a bank of future milestone images; after a deviation a selector picks a reachable one as a fixed visual goal. Failure-injected LIBERO: 56.3% → 74.0%, no fine-tuning.B2FF:执行前让 VLA 想象一组未来里程碑图像;偏离轨迹后,由选择器挑出可恢复的那个作为固定视觉目标。在注入失败的 LIBERO 上成功率从 56.3% 升至 74.0%,无需微调。
Loan Bernat, Matthieu Grard, Ariane Herbulot, Florent Lamiraux
Turns ambiguous failed rollouts into recovery training data: a privileged coach proposes a corrected high-level decision, kept only if re-executing from the same state improves progress.把含义不明的失败推演转化为恢复训练数据:由特权教练推测早期的高层决策错误并提出修正,只有从同一状态重新执行确实提升进度时才保留。
Gokul Puthumanaillam, Vardhan Dongre, Pranay Thangeda, Hooshang Nayyeri et al.
Shows a prompt that still reads like the intended task can redirect a VLA's rollout to an attacker's target; an on-policy prompt search finds such near-benign prompts. Sim + hardware.揭示 VLA 的轨迹级漏洞:看起来仍在描述原任务的指令,可以把机器人执行结果引向攻击者指定的目标;作者用在线提示搜索找到这类近乎无害的提示。仿真与真机验证。
Marino Watanabe, Takami Sato, Kentaro Yoshioka
FLARE, a physical spotlight attack, drops VLA success to zero. Naive augmentation defenses make models ignore color (≤47.5% on color tasks); ChromaGuard keeps color and reaches 97.5% and 92.5% on a real arm.FLARE 物理聚光灯攻击可让 VLA 成功率降为零。朴素的增强防御会让模型忽略颜色(颜色相关任务至多 47.5%);ChromaGuard 保留色彩信息,在真机上达到 97.5% 与 92.5%。
Yu Qi, Zhang Ye, Xinyi Xu, Yuxuan Lu et al.
Measures which instruction factors policies over-rely on: across six foundation policies, color ≥ object ≥ spatial ≥ verb ≥ size. Collecting more data for under-grounded factors wins with half the demos.量化策略过度依赖哪些指令要素:六个基础策略普遍呈现颜色 ≥ 物体 ≥ 空间 ≥ 动词 ≥ 尺寸的顺序。把采集预算倾斜给欠落地的要素,只用一半示教即可胜出。
Albert Wilcox, Frank Chang, Nhi Nguyen, Aishani Chakraborty et al.
Suites isolate generalisation across spatial layout, object instance, object category and subtask composition, plus bimanual BiMESA. The best of seven baselines reaches only 52% and 49%.五组评测分别隔离空间布局、物体实例、物体类别和子任务组合上的泛化能力,并提供双臂版 BiMESA。七种基线中最好的也只有 52% 和 49%,仍有很大提升空间。
Yunfu Deng, Sangwoo Shin, Brahma S. Pavse, Josiah P. Hanna
RoboFQE scores visual manipulation policies from offline trajectories, no rollouts: fitted Q-evaluation on a pretrained vision encoder plus learned success labels. Keeps rankings where video world models drift.RoboFQE 无需推演、直接用离线轨迹评估视觉操作策略:在预训练视觉编码器上做拟合 Q 评估并学习终止成功标注。在视频世界模型会累积误差的长时任务上仍能保持策略排序。
Huapeng Li, Fuxiang Feng, Jinqiu Fan, Shuo Yang et al.
Mobile-manipulation benchmark with 70 task scenarios combining navigation and manipulation in continuous spaces. Finds leading VLMs still struggle with spatial localization.移动操作评测基准:70 个在连续空间中结合导航与操作的任务场景。发现主流 VLM 在空间定位上仍有明显困难。
Weiwei Gu, Anmol Gupta, Anant Sah, Ryan Varghese et al.
RoboReel: a unified benchmark for policies learned from human videos, bundling real human demos, simulated robot trajectories and ten tasks with four test suites; sim trends hold on real-robot recreations.RoboReel:从人类视频学习策略的统一基准,打包真实人类演示视频、仿真机器人轨迹与十个任务及四套测试;在真机复现中仿真结论保持一致。
Anurag Maurya, Sukhvansh Jain, Prajwal Avhad, Gautham Balachandran et al.
IMBench: 35 tasks and 14K trajectories testing reasoning and execution together under explicit constraints. VLMs reason partly but fail to plan executable steps; VLAs struggle with the constraints.IMBench:35 个任务、1.4 万条轨迹,在显式约束下同时考察物理推理与动作执行。VLM 有部分推理能力但给不出可执行计划,VLA 难以满足任务约束。
Jiahao Ji, Ji Ma, Runhan Zhang, Runyi Yu et al.
600+ hours of whole-body human motion and object interaction from optical mocap with sub-millimetre marker accuracy, organised by FrameNet primitives, with a benchmark suite for humanoid learning.600 余小时的高精度全身人体运动与物体交互数据,由光学动捕采集(亚毫米级标记精度),按 FrameNet 动作基元组织,并配套面向人形机器人学习的评测套件。
Anjali Parashar, Rachel Luo, Apoorva Sharma, Sushant Veer et al.
Finds real-system failures on a small budget by correcting cheap proxy (e.g. simulator) failure signals with residual modeling and choosing diverse, well-supported scenarios. Up to 2x the failures of random sampling.在有限测试预算下寻找真实系统的失败:用残差建模校正廉价代理(如仿真器)的失败信号,并挑选多样且有数据支撑的场景。发现的失败数最多为随机采样的 2 倍。
Dijie Zhu, Seunghun Oh, Ruopeng Huang, Zhiyu Huang et al.
SCAPE predicts per-scenario real-world policy performance from a few paired sim/real runs plus many sim runs, correcting sim bias and calibrating with conformal prediction. Tested on driving and quadrupeds.SCAPE 利用少量成对的仿真/真机数据和大量仿真推演,按场景预测策略在真实世界的表现:先校正仿真标签偏差,再用共形预测校准不确定性。在自动驾驶与四足速度跟踪上验证。
Apurva Badithela, David Snyder, Tenny Yin, Jade Sceats et al.
AnyRank ranks robot policies with sequential tests: trials go to hard-to-separate pairs, a (partial) ranking holds at any stopping time, and imperfect priors (sim, world model) save trials safely.AnyRank 用序贯检验为多个机器人策略排序:把试验分给难以区分的策略,任何时刻停止都能给出有误差保证的(部分)排序,可借助不完美的先验(仿真、世界模型)节省试验而不破坏保证。
Yanzhe Chen, Zhijun Cao, Mike Zheng Shou
DLS finds where VLA success breaks via on-policy digital-twin rollouts, locates the crossing with privileged progress signals, and shapes the flow toward success-producing denoising directions.DLS 通过数字孪生中的在策略推演大规模发现 VLA 成功与失败的边界,用特权进度信号定位越界位置,并据此强化导向成功的去噪方向、抑制导向失败的方向。
Nico Bohlinger, Jan Peters
Reuses a frozen multi-robot value function as a differentiable surrogate for robot design, avoiding a new co-design RL loop per robot; handles over 1100 design parameters.把冻结的多机器人价值函数作为可微代理模型来优化机器人设计,无需为每台机器人重跑协同设计 RL;可处理 1100 多个设计参数。
Huy Ha, C. Karen Liu, Shuran Song
Diffusion transformer over a shared tokenization of robot bodies, states and actions that generates robot designs to track target motions. A fabricated optimised ALOHA design cut tracking error by over 70%.基于统一的机器人本体/状态/动作 token 表示的扩散 Transformer,按目标末端轨迹生成机器人设计。实际制作的优化版 ALOHA 跟踪误差降低 70% 以上。
Xin Fei, Zhixuan Xu, Huaicong Fang, Fangjun Chen et al.
A simulation benchmark of about 0.5B grasp labels over eight dexterous hands and ~50K objects, plus a diffusion model for cross-embodiment grasps in clutter: 88% average success, 0.3 s inference.构建约 5 亿条抓取标注、覆盖 8 种灵巧手和约 5 万个物体的仿真基准,并提出跨本体的杂乱场景灵巧抓取扩散模型:平均成功率 88%,推理 0.3 秒。
Zhiyuan Wu, Xiangyu Zhang, Zhuo Chen, Jiankang Deng et al.
Diffusion grasp generator conditioned on a graph of the hand's kinematics, so grasps transfer zero-shot to unseen hand designs; comes with a cross-morphology grasp benchmark.以手部运动学结构图为条件的扩散抓取生成模型,可零样本迁移到未见过的机器人手型;同时提出跨手型抓取评测基准。
Haosheng Li, Weixin Mao, Weipeng Deng, Chenyu Meng et al.
Multi-GraspSet, a large multi-hand grasp dataset with automatic contact annotations, and an LLM that generates language-guided grasps for different robot hands in one model.发布带自动接触标注的大规模多手型抓取数据集 Multi-GraspSet,并用一个基于大模型的统一框架,根据语言指令为不同机器人手生成抓取。
Jiyao Zhang, Junhan Wang, Tianyu Wang, Zeyuan Chen et al.
CoRL 2026 Oral. Generates executable dexterous grasps from free-form language, inferring the function a task implies from multi-view images and geometry, supported by the OpenDexVerse data.CoRL 2026 Oral。根据自由语言生成可执行的灵巧抓取:结合多视角图像与几何推断任务所需的功能,由 OpenDexVerse 数据支撑。
Mu Lin, Yi-Lin Wei, Jiaxuan Chen, Yuhao Lin et al.
CoRL 2026 Spotlight. A large-scale bimanual dexterous grasp dataset, built with a two-stage synthesis pipeline, together with a learning-based grasp generation framework.CoRL 2026 Spotlight。大规模双手灵巧抓取数据集(由两阶段合成流程生成),并配套基于学习的抓取生成框架。
Mingrui Yu, Yongpeng Jiang, Yongyi Jia, Kangchen Lv et al.
Learns an object-conditioned human grasp prior from 1.8K human grasps to pick contact modes and wrist starts for force-closure optimisation; synthesises 3.2M grasps from pinches to bimanual, 2–30 cm objects.从 1800 次人类抓取中学习物体条件的人类先验,用来选择接触模式和手腕初值以指导力封闭优化;合成 320 万个抓取,覆盖两指捏取到双手抓取、2–30 cm 物体。
Ying Yuan, Xinyu Liu, Sriram Krishna, David Held
Pretrains a low-level dexterous controller on 355K trajectories built from grasp datasets, then fine-tunes for articulated tool use. Introduces the DexCraft benchmark; reports +33.3 points over DP3 on a real robot.用抓取数据集构造的 35.5 万条轨迹预训练灵巧手底层控制器,再微调到需要操作工具活动部件的任务;提出 DexCraft 基准。报告真机完整任务成功率比 DP3 高 33.3 个百分点。
Linyi Huang, Guowei Huai, Weibin Liu, Shulong Jiang et al.
Hierarchical real-world RL for functional dexterous tasks: a hand skill handles contact, an arm-hand policy coordinates and triggers it. Reports 98.3% average success on six tasks within one hour of online training.面向功能性灵巧操作的分层真机强化学习:手部技能负责精确接触,臂-手协调策略负责手臂运动与技能触发。报告在六个任务上一小时在线训练即达 98.3% 平均成功率。
Tyler Ga Wei Lum, Kushal Kedia, C. Karen Liu, Jeannette Bohg
CoRL 2026 Oral. Asks what dexterous play pretraining actually needs before precise assembly, a contact-rich, sparse-reward task that is hard for both imitation and direct RL.CoRL 2026 Oral。探究灵巧“玩耍”预训练究竟需要什么,才能胜任精密装配这类富接触、稀疏奖励、模仿与直接 RL 都难以解决的任务。
Jing Xiong, Jiale Xie, Haoqi Yuan, Chaoyi Xu et al.
Grasps several objects at once with a dexterous hand by learning one-step residual corrections to a reference trajectory, with a strategy that adapts to how the objects are laid out.让灵巧手一次抓取多个物体:学习对参考轨迹的单步残差修正,并根据物体的空间布局调整抓取策略。
Mingi Choi, Gunhee Kim, Jisoo Kim, Taeksoo Kim et al.
AutoDex runs real dexterous-grasp trials, labels outcomes and resets objects with little human help: 3,500+ trials on 100 objects (Allegro, Inspire); about 0.2 human-hours per 500 trajectories vs 9.3 by teleop.AutoDex 自动执行真机灵巧抓取、标注结果并复位物体,几乎无需人工:在 100 个物体上用 Allegro 与 Inspire 手采集 3500 多次试验;每 500 条轨迹约需 0.2 人时,遥操作需 9.3 人时。
Yang Yang, Tengyu Liu, Puhao Li, Zeyuan Chen et al.
Category-level in-hand manipulation of articulated objects: procedural objects and functional grasps, then two-stage training with articulation physics randomization, reward curriculum and latent distillation.类别级的铰接物体手内操作:程序化生成物体与功能性抓取,再用两阶段训练(铰接物理随机化、奖励课程、潜表示蒸馏)学习策略,可泛化到未见实例。
Arjun Bhardwaj, Mayank Mittal, Maximum Wilder-Smith, Vaishakh Patil et al.
End-to-end in-hand reorientation from RGB and proprioception, with no object pose estimation: distilled from privileged-state teachers, and the target is given as an image. One policy transfers to five real objects.仅凭 RGB 与本体感觉、无需物体位姿估计的端到端手内重定向:由特权状态教师蒸馏而来,目标姿态直接用图像给出。单一策略直接迁移到五个真实物体。
Yushan Bai, Boyu Zheng, Zhiyang Mao, Hongzheng Sun et al.
Uses hand-object proximity from reconstructed point clouds as a hardware-agnostic contact signal, for VR teleop feedback and a policy with learned proximity dynamics. More robust under occlusion.以重建点云得到的手-物距离作为与硬件无关的接触信号,用于 VR 遥操作反馈,并训练带接近度动力学的策略;在遮挡下更稳健。
Zhen Zhang, Weinan Wang, Hejia Sun, Qingpeng Ding et al.
Puts miniature cameras in each fingertip of a multi-fingered hand and trains a whole-body diffusion policy on third-view plus fingertip views. Reports 56.6% relative gain over external and wrist cameras.在多指手的每个指尖装入微型摄像头,用第三视角加多指尖视角训练全身扩散策略。报告比外部+腕部相机方案平均成功率相对提升 56.6%。
Yuansen Huang, Jiayi Chen, Haoran Liu, Yubin Ke et al.
Generates dexterous grasps as 3D hand keypoints with a plain Transformer flow model, with no contact losses or refinement; reports 76.3% success on Dexonomy and 0.032 s per grasp.以 3D 手部关键点表示灵巧抓取,用普通 Transformer 流模型生成,无需接触损失或后处理优化;报告 Dexonomy 成功率 76.3%,每次抓取 0.032 秒。
Giulio Schiavi, Andrei Cramariuc, Michael Pantic, Roland Siegwart
6-DoF grasping that keeps learning on the job through memory in an embedding space: outcomes rescore future grasps and user demos are recalled in new scenes. Reports over 90% on hard categories after 50 tries.通过嵌入空间中的记忆在部署中持续学习的 6-DoF 抓取:抓取结果更新后续评分,用户示范可在新场景中被召回。报告在困难类别上仅 50 次尝试后成功率超过 90%。
Ayush Kaura, Vignesh Vembar, Md Faizal Karim, Keshab Patra et al.
Dual-arm grasps for large objects from partial point clouds: a convolutional occupancy network reasons about local thickness and clearance, producing force-closure grasp pairs refined by sampling-based optimization.从局部点云为大型物体生成双臂抓取:卷积占据网络推断局部厚度与夹爪间隙等几何,生成满足力封闭的抓取对,再用基于采样的优化修正几何不完整带来的歧义。
Baijun Chen, Weijie Wan, Tianxing Chen, Xianda Guo et al.
Simulation platform for visuo-tactile data supporting three common sensors, plus an encoder trained on its synthetic data and an 8-task benchmark. Reports +17.1% on the benchmark and +25% in real tasks.视触觉仿真数据合成平台,支持三种常用传感器,并基于合成数据训练视触觉编码器、发布 8 个任务的基准。报告基准成功率提升 17.1%,真机提升 25%。
Kevin Robledo, Matías I. Torres Galaz, Kumar Dixhant Rai, Shelly Sara Ulman et al.
Learns a structured latent space of behaviour styles (e.g. how much force to apply), and lets language reason over it instead of generating actions directly, for personalized tactile policies like wiping or folding.学习按行为风格(如施力大小)组织的结构化潜空间,让语言在其中推理用户偏好而非直接生成动作,从而实现个性化的触觉策略,如擦拭、叠衣。
Junsung Park, Sachin Bhadang, Carmelo Sferrazza, Sha Yi et al.
Encoders for resistive, magnetic and vision-based tactile sensors are trained on paired contacts into one latent space, so a policy trained with one sensor transfers zero-shot to another on four manipulation tasks.为电阻式、磁式和视觉触觉传感器分别训练编码器,利用成对接触数据映射到同一潜空间;在四个操作任务中,用一种传感器训练的策略可零样本迁移到另一种。
Jianxin Bi, Qiang Wang, Jayaram Reddy, Kelvin Lin et al.
Shared tactile representation across sensors: sensor-specific encoders plus a common transformer, pretrained on a new 1.6M-frame paired dataset from four sensors; adapts to new tasks and unseen sensors.跨传感器的统一触觉表征:各传感器独立编码器加共享 Transformer 主干,在新的 160 万帧四传感器配对数据集上预训练,可迁移到新任务和未见传感器。
Chengbo Yuan, Zicheng Zhang, Mingjie Zhou, Wendi Chen et al.
Tactile policy pretrained on ~3,000 hours from 26 sources and 21 sensors, mapping image, array and state signals into shared tokens. Reports +17.2% on seen setups and +31% on two unseen sensor setups.触觉基础策略:在 26 个数据源、21 种传感器约 3000 小时数据上预训练,把图像型、阵列型与状态型触觉信号映射到统一 token。报告已见配置提升 17.2%,两种未见传感器提升 31%。
Rickmer Krohn, Erik Helmut, Niklas Funk, Jan Peters et al.
Fuses an RGB camera, a GelSight Mini and a high-rate event-based tactile sensor for a flow-matching policy. Reports 80% average success on five contact-rich tasks vs 35.5% vision-only.融合 RGB 相机、GelSight Mini 与高频事件型触觉传感器的多分辨率表示,驱动流匹配策略。报告五个富接触任务平均成功率 80%,纯视觉仅 35.5%。
Guo Ye, Zexi Zhang, Xu Zhao, Shang Wu et al.
DreamTacVLA feeds high-res tactile images with wrist and third-person views, aligns them spatially, then fine-tunes with a tactile world model that predicts future touch signals.DreamTacVLA 把高分辨率触觉图像与腕部、第三人称视角一起输入并做空间对齐,再用预测未来触觉信号的触觉世界模型微调。
Haotian He, Zeyu Yan, Qipeng Liu, Ning Guo et al.
FAWAM uses 6-axis force/torque in perception, jointly predicts future actions and wrenches, and corrects actions online against the predicted wrench. Reports +36.25 pts over vision-only baselines on real tasks.FAWAM 在感知、预测与闭环执行三层使用六维力/力矩:联合预测未来动作与末端力旋量,并以预测的力轨迹为参考在线修正动作。真机任务上比纯视觉基线成功率高 36.25 个百分点。
Jiaju He, Zhiyuan Yang, Ruyang Han, Jiahong Tang et al.
FR-VLA uses learnable force query tokens to let vision-language context decide how much measured force should enter the action pathway, rather than feeding force in through a fixed path. Five real tasks, two robots.FR-VLA 通过可学习的力查询 token,由视觉语言上下文判断测得的力应在多大程度上进入动作生成通路,而不是走固定的注入路径。在两种机器人的五个接触密集任务上验证。
Ruicheng Li, Qixiu Li, Ruichun Ma, Yu Deng et al.
Gives a VLA memory through compact force-history tokens from a pretrained VAE, for tasks like pressing a button a set number of times. Reports over 80% success on three memory-dependent tasks.用预训练 VAE 把力信号历史压缩成记忆 token 输入 VLA,解决按指定次数按按钮、擦盘子等依赖记忆的接触任务。报告三个记忆型任务成功率超过 80%。
Yi Wang, Wendi Chen, Zimo Wen, Han Xue et al.
LIFT: grafts a reactive force-driven action expert onto a pretrained, vision-driven VLA, keeping its output unchanged at initialization, so post-training gains contact reactivity; CoRL 2026 Spotlight.LIFT:在以视觉为主的预训练 VLA 旁接入由力觉驱动的反应式动作专家,初始化时保持原策略输出不变,使后训练获得接触反应能力,应对遮挡、深度歧义等接触阶段难题;CoRL 2026 Spotlight。
Siyu Ma, Yuqi Liang, Chang Yu, Yunuo Chen et al.
Adds touch to a VLA via sim-real co-training and simulated RL in a real-aligned simulator, learning how contact should change actions near failure. Reports 72.5% vs 50.0% on four bimanual tasks.通过仿真-真机协同训练和在对齐真实的模拟器中做强化学习,为 VLA 加入触觉,学习接近失败时触觉应如何调整动作。报告四个双臂任务成功率 72.5%,基线 50.0%。
Kelin Yu, Haode Zhang, Harish Ravichandar, Yunhai Han et al.
Real-world RL that adds a lightweight tactile residual on top of any pretrained visual policy, bootstrapped from the base policy's own rollouts. Reports 5–40% success raised to 85–100% within 40–80 minutes.真实世界强化学习:在任意预训练视觉策略之上学习轻量的触觉残差修正,先用基础策略自主执行的数据冷启动。报告四个任务成功率在 40–80 分钟内从 5–40% 提升到 85–100%。
Shengcheng Luo, Xiyan Huang, Zhe Xu, Wanlin Li et al.
Tactile-only blind grasping on a LEAP Hand: calibrate a digital twin to reproduce real touch signals, pretrain a layout-aware tactile encoder, and distill object-specific RL experts into a diffusion policy.在 LEAP 手上实现只凭触觉的盲抓:先构建能复现真实触觉信号的校准数字孪生,再自监督预训练感知传感器布局的触觉编码器,最后把各物体的强化学习专家蒸馏为扩散策略。
Rosy Chen, Mustafa Mukadam, Michael Kaess, Tingfan Wu et al.
Learns tactile dexterous skills without tactile simulation: privileged sensors in the real world collect data to distil a tactile state estimator for a sim-trained policy. Reports 182% gain on in-hand rotation.无需触觉仿真即可学习触觉灵巧操作:在真实环境中借助特权传感器采集数据,蒸馏出基于触觉的状态估计器,用于仿真训练的策略。报告手内旋转任务提升 182%。
Chenyang Ma, Yunchao Yao, Zhenyu Wei, Ruogu Li et al.
Uses motor current as a touch signal on low-cost dexterous hands: a model predicts a compliant PD target position whose error yields the right grasp force, with no tactile or force sensors.把电机电流当作触觉:在低成本灵巧手上预测一个“柔顺参考位置”,让 PD 控制器的位置误差产生合适的抓握力,无需触觉或力传感器。
Steven Oh, Jason Jingzhou Liu, Tony Tao, Philip Han et al.
CoRL 2026 Oral. NEXT estimates external joint torques without force sensors, training in 1 minute from 10 minutes of free-motion data, enabling force-feedback teleoperation and better policy learning on low-cost arms.CoRL 2026 Oral。NEXT 无需力传感器即可估计外部关节力矩,用 10 分钟自由运动数据训练 1 分钟,为低成本机械臂带来力反馈遥操作与更好的策略学习。
Zhirui Zhang, Yunkai Tang, Jiahang Li, Fan Fei et al.
CoRL 2026 Spotlight. Dual-branch generative framework that extracts clean shading and marker images at once from one marker-based tactile frame, avoiding serial mask-based inpainting.CoRL 2026 Spotlight。双分支生成框架,可从单帧带标记点的触觉图像同时分离出干净的明暗图与标记图,避免串行掩码修复。
Yankai Fu, Ning Chen, Junkai Zhao, Heng Zhang et al.
Dexterous visuotactile VLA on a mixture-of-transformers: contact-aware gating decides when touch matters; the model jointly imagines future visual and tactile latents. Reports 71% average success on contact-rich tasks.基于混合 Transformer 的灵巧视触觉 VLA:接触感知门控决定何时引入触觉,并联合想象未来的视觉与触觉潜变量。报告在富接触任务上平均成功率 71%。
Yilin Wu, Zilin Si, Zeynep Temel, Oliver Kroemer et al.
Inference-time steering with vision and touch: visual sampling picks the behaviour, tactile-guided diffusion editing fixes local contact, scored by a visuo-tactile latent world model. Reports +51% over the base policy.视觉+触觉的推理时策略引导:视觉采样验证决定执行何种行为,触觉引导的扩散编辑修正局部接触,并由视触觉潜在世界模型打分。报告比基础策略提升 51%。
Zhixuan Xu, Yichen Li, Xuanye Wu, Tianyu Qiu et al.
CoRL 2026 Spotlight. Fingertip sensing that combines binocular RGB cameras with a compliant contact surface, giving feedback from pre-contact approach through post-contact control.CoRL 2026 Spotlight。指尖传感将双目 RGB 相机与柔顺接触面结合,从接触前接近到接触后控制全程提供反馈。
Zhiyuan Chen, Shixiong Xu, Shuai Chen, Yangwei You
CoRL 2026 Oral. Splits one tactile stream into three temporal roles, persistent states, abrupt contact events and future consequences, instead of a single fusion path in chunk-based insertion policies.CoRL 2026 Oral。不再用单一融合路径,而是把同一触觉流拆成三种时序角色:持续接触状态、突发接触事件与未来接触后果,用于分块式插接策略。
Metin Alp Dogan, Edward Sun, Feng Xu, Daniel Wu et al.
CoRL 2026 Spotlight. Brings contact into image-conditioned policies by rendering it, targeting the gap left by approaches that need tactile hardware, separate tactile encoders or non-image backbones.CoRL 2026 Spotlight。通过渲染接触信息把触觉带入基于图像的视觉运动策略,针对现有方法需要专用触觉硬件、独立触觉编码器或非图像主干,难以与预训练 2D 视觉表征策略兼容的问题。
Carlota Parés-Morlans, Nils Kuhn, Y. Isabel Liu, Alberta Longhini et al.
CoRL 2026 Spotlight. Studies why VLA models struggle in contact-rich manipulation and separates two failure modes: precision failures, where policies struggle to produce small corrective actions, and force failures.CoRL 2026 Spotlight。分析 VLA 模型为何难以完成接触丰富的操作任务,并区分两类失败模式:难以输出接触时所需微小修正动作的精度失败,以及力失败。
Marc Toussaint, Cornelius V. Braun, Armand Jordana, Sayantan Auddy et al.
Helps RL explore contact-rich tasks by resetting episodes with a contact-aware constrained state sampler, covering diverse contact modes; trains universal in-hand and whole-body policies.用感知接触的约束状态采样器重置回合,覆盖多样接触模式,帮助 RL 探索接触丰富任务;可训练通用的手内和全身操作策略。
Kyungseo Park, Byeongdo Lim, Jungbin Lim, Minseok Choi et al.
CoRL 2026 Spotlight. Addresses impedance gain selection for articulated tasks such as doors, bolts and drawers, where neural policies may violate kinematic constraints.CoRL 2026 Spotlight。针对开门、拧螺栓、拉抽屉等铰接任务解决阻抗增益选择问题,这类任务中神经策略可能违反运动学约束。
Dongwon Son, Florian Shkurti, Jason Lee, Naman Shah et al.
CoRL 2026 Spotlight. A module for contact-rich motion transfer across sim-to-real gaps, payloads and robot instances, as an alternative to domain randomization or system ID.CoRL 2026 Spotlight。面向富接触动作迁移的模块,应对仿真到现实、负载与个体差异,用于替代域随机化或系统辨识。
Mario Gomez Andreu, Michael Amir, Antonio Marino, Tianxu An et al.
Robots that never trained together share value functions, so a robot finishing a task leaves the workspace in a state the next robot prefers; a KNN uncertainty filter blocks overconfident values. Up to +48.5 pts.从未共同训练的机器人通过共享价值函数来协作,前一个机器人会把工作空间留在后一个机器人偏好的状态;KNN 不确定性过滤避免分布外的过度自信。成功率最高提升 48.5 个百分点。
Sunghwan Kim, Byeonghyun Pak, Kehan Long, Yulun Tian et al.
CoRL 2026 Spotlight. Conditions a mobile manipulation policy on a spatiotemporal map of neural points that represents environment and robot body in one latent space, updated online.CoRL 2026 Spotlight。用时空神经点地图作为移动操作策略的条件:环境与机器人本体处于同一隐空间,并在线更新。
Martin Büchner, Adrian Röfer, Tim Engelbracht, Tim Welschehold et al.
MoMa-SG builds 3D scene graphs that encode how objects articulate, from RGB-D sequences, and adds the Arti4D-Semantic dataset; demonstrated on a quadruped and a mobile manipulator.MoMa-SG 从 RGB-D 序列构建包含物体铰接方式的 3D 场景图,并发布 Arti4D-Semantic 数据集;在四足和移动操作机器人上演示。
Zhiyuan Yang, Jiaju He, Ruiteng Zhao, Anqi Cheng et al.
NISE targets the sharp failure of 3D policies under realistic depth noise, carrying position uncertainty into attention; tested on transparent and reflective objects with commodity RGB-D.NISE 针对 3D 策略在真实深度噪声下的急剧失效,把位置不确定性带入注意力计算;在透明和反光物体上用普通 RGB-D 相机测试。
Kallol Saha, Yining Hong, Amber Li, Yejin Choi et al.
DISCO runs progressive-widening MCTS in GPU-parallel simulation, with a learned policy proposing continuous actions, then distills plans into a policy-value model used without search. Reports wins over BC, RL and search.DISCO 在 GPU 并行物理仿真中用渐进展宽 MCTS 搜索长程重排计划,由学习的策略提出连续动作、价值函数打分,并周期性把搜索结果蒸馏回策略-价值模型;部署时无需仿真搜索。报告在仿真与真机重排任务上优于行为克隆、强化学习与搜索基线(CoRL 2026 Oral)。
Haoyu Shao, Yunshen Wang, Jingze Zhang, Shaohang Zhu et al.
A latent motion prior distilled from human soccer MoCap lets one skill-conditioned policy move, dribble, trap and kick with human-like motion; transfers zero-shot to a Unitree G1.从人类足球动捕数据蒸馏出潜在运动先验,使单一技能条件策略能完成移动、带球、停球和射门,动作自然流畅;零样本迁移到 Unitree G1。
Zhangchen Ye, Enxuan Ruan, Yifei Bao, Runhan Huang et al.
One command-conditioned policy for humanoid soccer skills (dribbling, trapping, shooting) with per-skill motion priors and critics; deployed on a real Noetix E1.单一指令条件策略实现人形足球多种技能(带球、停球、射门),每个技能有独立的运动先验与评论家;部署在真实 Noetix E1 上。
Jingzhi Cui, Zhexiong Wang, Bangjie Xu, Pengyu Zhao et al.
Three-stage hierarchical RL for humanoid badminton: sparse human strokes are augmented into a latent skill space, and a high-level planner composes skills online from the observed shuttle.三阶段分层强化学习实现人形机器人打羽毛球:把少量人类击球动作扩充为连续的潜技能空间,高层规划器再根据观测到的羽毛球在线组合技能。
Tao Huang, Ruofei Liu, Xuchen Tang, Xinyin Zhang et al.
Learns professional tennis serve and rally styles from broadcast video with a planner-plus-tracker design and speed adaptation for sim-to-real. Deployed on a G1 and a 1.7 m Dobot Atom serving without mocap.从比赛转播视频学习职业网球发球与对打风格,采用“规划器+跟踪器”分层结构并加入速度自适应缩小仿真-真机差距。部署在 G1 和 1.7 m 的 Dobot Atom 上,无需动捕即可发球。
Yichao Zhong, Yidan Lu, Yuhang Lu, Tianyang Tang et al.
CoRL 2026 Oral. Three-stage curriculum for humanoid soccer shooting: a single human-kick reference serves as a scaffold, bridging stable motion tracking and goal-driven RL that struggles to discover kicks.CoRL 2026 Oral。人形足球射门的三阶段课程:以单条人类踢球参考为脚手架,兼顾动作跟踪的稳定性与任务奖励 RL 的目标适应能力。
Zong Chen, Xuebin Li, Jinpeng Xiao, Shaoyang Li et al.
Carries several free-rolling balls on a wheel-legged robot's back with no fences: per-frame Deep Sets respect that ball order can change every frame, which standard history encoders miss and exploit as a shortcut.在轮腿机器人背上无围栏地同时运送多个自由滚动的球:逐帧 Deep Sets 编码器考虑到球的顺序每帧都可能变化,而常规历史拼接编码器忽略这一点并把槽位当作捷径。
Yinhuai Wang, Qihan Zhao, Yuen Fui Lau, Runyi Yu et al.
Compiles human video into generalizable real-world humanoid interaction skills, without task-specific design.把人类视频转化为可泛化的真实人形交互技能,无需按任务设计。
Zihan Wang, Zhen Wu, Pieter Abbeel, Rocky Duan et al.
PRISM turns a few real videos into hundreds of counterfactual human-object clips via video generation, rebuilds them in sim, and trains one humanoid carrying policy that handles unseen objects with no real fine-tuning.PRISM 用视频生成把少量真实视频扩增为数百段反事实人-物交互视频,在仿真中重建并训练单一人形搬运策略,无需真机微调即可泛化到未见物体。
Kevin Lin, Ajay Mandlekar, Caelan Reed Garrett, Nikita Chernyadev et al.
MimicGen-style data generation for humanoids: adapts a few whole-body demos to new object poses and links them with locomotion planning, plus a 9-task benchmark. Co-training reports +20% over real data only.面向人形机器人的 MimicGen 式数据生成:把少量全身演示适配到新物体位姿,并用移动与操作规划串联,另提出 9 任务基准。协同训练比仅用真机数据提升 20%。
Songlin Wei, Zhenhao Ni, Jie Liu, Zhenyu Zhao et al.
Humanoid loco-manipulation testbed pairing MuJoCo physics with Isaac Sim rendering: 16 whole-body tasks, 50 scenes, 1,000+ objects, motion-planning and VR data pipelines; benchmarks imitation, VLA and WAM policies.人形移动操作仿真平台,结合 MuJoCo 物理与 Isaac Sim 渲染:16 个全身任务、50 个室内场景、1000 多个物体资产,提供运动规划与 VR 数据管线,并评测模仿、VLA 与世界动作模型策略。
Haoran Yang, Jiacheng Bao, Yucheng Xin, Haoming Song et al.
Teleop-free humanoid interaction: a fine-tuned VLM generates human whole-body motion from an egocentric image and instruction, retargeted and run by an interaction-aware tracker on a Unitree G1.无需遥操作的人形交互:微调后的 VLM 根据第一人称图像和语言指令生成人体全身运动 token,重定向到机器人后由注重交互的跟踪策略在 Unitree G1 上执行。
Yen-Jen Wang, Jiaman Li, Sirui Chen, Takara E. Truong et al.
Generates 48,000 vision-language-kinematics trajectories in 3DGS-reconstructed rooms with no human input, trains a policy that outputs whole-body kinematics, and runs it on a real G1 via a tracker.在 3D 高斯泼溅重建的室内场景中无人工合成 4.8 万条“视觉-语言-运动学”轨迹,训练输出全身运动学轨迹的策略,并通过全身跟踪器在真实 G1 上运行。
Xuanbin Peng, Lai Wei, Yuze Zhai, Qingyuan Yu et al.
Trained in simulation with no real demos. Controller-in-the-loop filtering rejects 73% of kinematically valid grasps that would destabilize the robot; reports 87.5% real-world success on a multi-level shelf task.完全在仿真中训练,无真实示范。把控制器放进回路筛选数据,剔除 73% 运动学可行但会使机器人失稳的抓取;作者报告多层货架任务真实成功率 87.5%。
Runyi Yu, Xiaoyi Lin, Ji Ma, Yinhuai Wang et al.
Uses 'contact flow' (key body trajectories plus binary contact signals) as the interface between a skill-tracking policy and a planner that generates future contact flows; releases a MoCap humanoid-object dataset.以“接触流”(关键身体轨迹 + 二值接触信号)作为接口:底层策略跟踪统一的移动操作技能库,高层模块生成未来接触流来串联技能;并发布基于动捕的人-物交互数据集。
Minku Kim, Kuan-Chia Chen, Aayam Shrestha, Li Fuxin et al.
Humanoid box-rearranging challenge that chains pickup, walking and placing skills. A shared whole-body controller hardened with closed-loop skill data composes best; controller handoffs cause much of the loss.人形机器人“汉诺塔”式搬箱挑战,需要反复串联拾取、行走与放置技能。发现用技能闭环数据加固的共享全身控制器组合最稳健,控制器切换是性能损失的重要来源。
Juntong Zhang, Chun Gu, Li Zhang
Cross-embodiment humanoid whole-body controller: shared human-motion command tokens and a causal transformer trained on mixed multi-robot rollouts, with small robot-specific modules. Nine sim bodies, four real robots.跨本体的人形全身控制基础模型:共享的人体运动指令 token 与在多机器人混合数据上训练的因果 Transformer,加上轻量的机器人专属模块。覆盖 9 种仿真本体与 4 台真机。
Vongani H. Maluleke, James Ni, Kie Horiuchi, Lea Wilken et al.
Humanoid that reacts to a human partner: a token model generates G1 whole-body motion conditioned on the partner, and a tracker executes it. Adds a 260-hour human-humanoid interaction benchmark.让人形机器人对人类伙伴做出回应:token 化序列模型以伙伴动作为条件生成 G1 全身动作,再由跟踪控制器执行。并提供 260 小时的人-人形交互基准。
Yuto Shibata, Kotaro Amaya, Kashu Yamazaki, Lalit Jayanti et al.
REACT learns humanoid-human contact interactions from human-human mocap: VLM-guided contact retargeting, then onboard-depth policies that also predict the occluded partner. A real G1 does all five interactions.REACT 从人-人动捕中学习人形与人的接触交互:VLM 引导接触重定向,再蒸馏为只用机载深度的策略,并预测被遮挡伙伴的状态。真实 G1 完成全部五种交互。
Yuhang Lin, Jiyuan Shi, Dewei Wang, Jipeng Kong et al.
Box-carrying humanoid policy conditioned on a desired root trajectory, with reference motion used only in the reward; a persistent object estimator fuses detection with a digital twin to spot slips and re-grasp.人形机器人搬箱策略以期望的根轨迹为条件,参考动作只用于奖励;持续物体估计模块融合实时检测与数字孪生,发现滑落后自动重新抓取。
Ilyass Taouil, Michal Ciebelski, Shafeef Omar, Haizhou Zhao et al.
Discovers long-horizon, contact-rich humanoid loco-manipulation from scratch: LLM-guided evolutionary search over interaction sequences plus kinodynamic trajectory optimization, then RL tracking on a real humanoid.从零发现长时域、多接触的人形机器人移动操作动作:由大模型引导的进化搜索交互序列,配合运动动力学轨迹优化,再训练强化学习跟踪策略部署到真实人形机器人。
Hojune Kim, Timothy Chen, Jiankai Sun, Lars W. Osterberg et al.
Hybrid simulator (mesh foreground over a calibrated 3DGS background) that generates humanoid loco-manipulation demos without teleop. On a G1, VLAs trained only on it match or beat teleop-trained ones.混合模拟器:网格前景叠加校准过的 3D 高斯泼溅背景,无需遥操作即可生成人形移动操作演示。在 G1 上,仅用其数据训练的 VLA 达到或超过遥操作数据训练的效果。
Peng Ren, Haoyang Ge, Jiang Zhao, Cong Huang et al.
POT-VLA keeps role-indexed 3D object records from RGB-D as tokens for the whole-body action expert and for checking whether actions succeeded. On a Unitree G1: 71/80 successes vs 39/80 for GR00T-N1.7.POT-VLA 从 RGB-D 维护按角色索引的 3D 物体记录,既作为全身动作专家的输入 token,也用于检验动作是否达成。在 Unitree G1 上成功 71/80 次,GR00T-N1.7 基线为 39/80。
Muqun Hu, Yuhao Zhou, Kabir Ray Malik, Chi Lin et al.
One RL policy for legs, arm and gripper that adds a tactile latent from compliant grippers to proprioception, regulating grasp force and preventing slip. Zero-shot on a Unitree Go2 with a WidowX 250 arm.单一强化学习策略同时控制腿、机械臂与夹爪,把柔顺夹爪的触觉潜表示与本体感觉结合,调节握力并防止物体滑落。零样本部署在装有 WidowX 250 机械臂的 Unitree Go2 上。
Jaehwi Jang, Zhaoyuan Gu, Alfred Cueva, Zimeng Chai et al.
Wearable whole-body tactile interface for both human demos and humanoid teleop, with a planner that predicts poses plus contact forces for a tactile admittance controller. Five contact-rich tasks.可穿戴的全身触觉接口,可用于人类演示和人形遥操作;规划器同时预测末端位姿与接触力,作为触觉导纳控制器的参考。在五个富接触任务上验证。
Runpei Dong, Ziyan Li, Arjun Gupta, Xialin He et al.
Modular humanoid grasping: large vision models handle the scene, a sim-trained end-effector tracker with IK and a learned forward model handles the arm. Reports 2.44 cm tracking error, 5.5x better than prior work.模块化人形抓取:大视觉模型负责场景理解,仿真训练的末端跟踪策略结合 IK 与学习的正运动学模型负责执行。报告末端跟踪误差 2.44 厘米,比先前最好方法低 5.5 倍。
Daniel Morton, Pranit Mohnot, Marco Pavone
Adds runtime constraints (collisions, joint limits, CoM stability) to RL humanoid tracking policies via operational-space control and CBFs at over 1 kHz, even for constraints set after training.借助操作空间控制与控制障碍函数,以 1 kHz 以上频率为强化学习人形跟踪策略施加运行时约束(碰撞、关节限位、质心稳定),训练后新增的约束也能满足。
Zepeng Wang, Jiangxing Wang, Shiqing Yao, Yu Zhang et al.
FAST: a general humanoid motion tracker with a small residual adaptation policy under orthogonality and KL constraints for new motions without forgetting, plus center-of-mass-aware terms for balance.FAST:通用人形运动跟踪控制器,在正交与 KL 约束下学习轻量残差策略来快速适配新动作且不遗忘,并加入质心相关观测与目标提升平衡。
Ziyan Xiong, Lixing Fang, Junyun Huang, Kashu Yamazaki et al.
Low-latency humanoid teleoperation: scaled velocity feedforward cuts tracking delay by ~70 ms and link-pose control skips retargeting. End-to-end latency down to 50 ms, enough for juggling and ping-pong ball balancing.低延迟人形遥操作:缩放速度前馈让跟踪延迟减少约 70 ms,直接控制末端连杆位姿省去关节重定向。端到端延迟低至 50 ms,可完成抛接与乒乓球平衡等反应型动作。
Lixing Fang, Ziyan Xiong, Sunli Chen, Zhiyang Dou et al.
VR humanoid teleoperation for long tasks: a robot-mounted binocular fisheye, wide stereo display, head-decoupled free-looking and stabilization keep the operator aware of the surroundings.面向长时任务的人形机器人 VR 遥操作:机载双目鱼眼相机、宽视场立体显示、与机器人运动解耦的自由环视及画面稳定,让操作者持续掌握周围空间信息。
Yujie Xiong, Peng Zhai, Taixian Hou, Quancheng Qian et al.
Humanoid brachiation with passive wrist hooks: biomimetic keyframes make release-swing-capture reachable early in training, and a recurrent estimator gives position/contact latents. Continuous bar traversal on hardware.带被动腕钩的人形机器人臂荡移动:仿生关键帧让“松手-摆荡-抓杆”在训练早期就能被探索到,循环网络估计位置与接触潜变量。真机实现连续过杆。
Chenxin Liu, Qingzhou Lu, Guangxiao Yang, Xuanyang Shi et al.
Teleoperation for a full-size humanoid carrying heavy loads: privileged motion guidance cleans noisy VR references and a payload curriculum builds robustness. A 175 cm, 65 kg robot tracks motions with up to 24 kg.面向全尺寸人形机器人的重载遥操作:特权运动引导修正带噪 VR 参考,窗口化载荷课程提升鲁棒性。175 cm、65 kg 的机器人可携带最多 24 kg 负载跟踪动作。
Jean-Pierre Sleiman, Bilal Hammoud, He Li, Jonathan Foster et al.
Trains the low-level humanoid controller by motion imitation with the object physically in the scene, then a high-level policy on top; on a Unitree G1 it carries varied boxes and recovers from drops.让人形底层控制器在场景中真实带着物体做动作模仿训练,再在其上训练高层策略;在宇树 G1 上可搬运不同箱子,并能从掉落中恢复。
Yudong Zhong, Pengfei Mai, Sikai Guo, Jiahang Cao et al.
Fault-tolerant whole-body control for legged manipulators: a fault estimator finds failed leg joints from proprioception, and a posture module turns arm-driven base requests into safe ones.面向腿足机械臂的容错全身控制:故障估计器从下肢本体感觉历史中识别失效关节,姿态适配模块把机械臂策略提出的底盘姿态请求转为安全可执行的指令。
Xinyao Li, Xialin He, Runpei Dong, Saurabh Gupta
Humanoid motion tracking that follows explicit part-level contact commands as well as keypoints, so the robot really sits, wipes or pushes, and contact can be switched on or off. 10 sim motions, 5 on hardware.人形动作跟踪在关键点之外还跟踪部位级接触指令,让机器人真正坐下、擦拭或推动物体,并可按需产生或抑制接触。仿真 10 种动作,真机 5 种。
Tianyi Xie, Haotian Zhang, Jinhyung Park, Zi Wang et al.
CoRL 2026 Oral. A fully virtual pipeline for humanoid loco-manipulation data: grounds video world models in 3D assets and simulator-ready scenes, with no teleoperation or physical setups.CoRL 2026 Oral。全虚拟的人形移动操作数据管线:把视频世界模型落到 3D 资产与可仿真场景中,无需遥操作或搭建实体环境。
Qiayuan Liao, Yiyang Shao, Junfeng Long, Kevin Zakka et al.
Rather than distilling per-motion experts or brute-forcing one RL policy, trains a humanoid tracking policy jointly with one differentiable world model of shared dynamics, fit from simulator logs (CoRL 2026 oral).SuperMimic 不再蒸馏逐动作专家或用大算力硬训单一 RL 策略,而是把人形机器人动作跟踪策略与一个从仿真日志拟合的、共享动力学的可微世界模型联合训练(CoRL 2026 口头报告)。
Simon Kohaut, Felix Divo, Julius Hahnewald, Benedict Flade et al.
TraCS adds interpretable, probabilistic traffic-rule logic to black-box motion predictors, generated from natural-language regulations; reports consistent gains on Argoverse 2. Oral.TraCS 将由自然语言交规生成的可解释概率逻辑加到黑盒运动预测模型上;报告在 Argoverse 2 上稳定提升。Oral 论文。
Gabriel Rodriguez, Henri Sayag, Abhishek Rathod, John Stecklein et al.
RL policies modulate a reference trajectory for compact quadrotor flips with reversible thrust, one policy per direction. In JAX simulation: 32% lower position RMSE and 57% shorter settling than baselines.强化学习策略调制参考轨迹,实现可反向推力四旋翼的紧凑翻转,正翻与回翻各训一个策略。JAX 仿真中位置 RMSE 降低 32%,稳定时间缩短 57%。
Riccardo Bianco, Yunfan Ren, Jiaxu Xing, Davide Scaramuzza
Visuomotor quadrotor policy flies through moving narrow gaps, trained in one stage from scratch by differentiable simulation; a signed-distance-gated objective turns the sparse pass-through event into a dense loss.视觉运动四旋翼策略穿越移动的狭窄缝隙,借助可微仿真从零单阶段训练;以到时变缝隙平面的有符号距离门控各项损失,把稀疏的穿越事件变成稠密目标。
Nico Messikommer, Jiaxu Xing, Leonard Bauersfeld, Marco Cannici et al.
Event-camera drone flight: learn the representation offline from a large dataset, then fine-tune the policy online on cheap state only, with no event rendering. Training drops from 52.44 h to 1.86 h.事件相机无人机飞行:先在大规模离线数据上学习表示,再只用轻量状态信息在线微调策略,无需在训练中渲染事件。训练时间从 52.44 小时降到 1.86 小时。
Yutong Wang, Dongjae Lee, Xiaofeng Guo, Yuanzhu Zhan et al.
Benchmark for multirotor aerial manipulation: under-, fully and over-actuated platforms, 12 tasks, configurable wind and saturation, standard low-level controllers and learning baselines for system-level comparison.多旋翼空中操作基准:包含欠驱动、全驱动与过驱动平台,12 个任务,可配置气动扰动与执行器饱和,并提供标准底层控制器和策略学习基线,便于系统级比较。
Johnathan Tucker, Denis Liu, Aiden Swann, Allen Ren et al.
Transfers a pretrained π0 to aerial pick-and-place: payload-aware guidance in flow sampling handles flight dynamics and 3DGS data covers navigation. Reports pick-and-place success up from 23% to 50% in 460 real trials.把预训练 π0 迁移到空中抓放:在流采样中注入载荷约束以应对飞行动力学,并用高斯泼溅合成导航数据。在 460 次真机实验中报告抓放成功率从 23% 提升到 50%。
Boning Feng, Haoran Zhang, Xiaowen Bi, Yanzhen Zhang et al.
UAV target following that conditions a flow-based trajectory generator on predicted target futures and repairs risky trajectory prefixes inside the sampling loop. Best safety-tracking trade-off; Future-MPC is smoother.无人机目标跟随:用预测的目标未来轨迹作为条件引导流式轨迹生成,并在采样循环中修复高风险的可执行前段。安全与跟踪的权衡最好,但 Future-MPC 更平滑。
Jonas Eschmann, Giuseppe Loianno
GPU batch-rendering quadrotor simulator; reports 20×+ the speed of existing batch quadrotor sims, with a new ray tracer rendering RGB, depth, segmentation, normals and optical flow (CoRL 2026).以 GPU 批量渲染为核心的四旋翼仿真器;报告比现有批量四旋翼仿真器快 20 倍以上,新的光线追踪引擎(支持 OptiX、Vulkan、Metal、WebGPU)可渲染 RGB、深度、分割、法向和光流(CoRL 2026)。
Bowen Feng, Keqin Wang, Yulong Yang, Amogh Joshi et al.
One VLM acts as teacher (sees the whole trajectory, infers the goal and reasoning) and student (onboard view only), so language-conditioned navigation reasoning is learned with no human labels. 13 real tasks.同一个 VLM 既当教师(看到完整轨迹,推断导航目标与推理过程)又当学生(只看机载观测),无需人工标注即可学会以语言为条件的导航推理。在 13 个真实任务上验证。
Rwik Rana, Jesse Quattrociocchi, Christian Ellis, Nathan Tsoi et al.