EgoContact: Evaluating Physical Intelligence with Egocentric Video
Benchmark of 22.5K verified egocentric interactions with pixel-precise contact points: current models often miss where to touch. As a memory bank for an affordance policy it lifts real grasp success from 16% to 58%.第一视角接触点预测基准:2.25 万个人工核验的交互事件,每个含接触前画面、语义意图与像素级接触位置。现有方法常常定位不准甚至找不到目标物体;把 EgoContact 用作已有可供性迁移策略的记忆库,真机抓取成功率从 16% 提升到 58%。
BibTeX
@misc{deryo2026egocontact,
title = {{EgoContact: Evaluating Physical Intelligence with Egocentric Video}},
author = {Adam Deryło and Alexey Gavryushin and Daniel Cremers and Marc Pollefeys and Xi Wang},
year = {2026},
eprint = {2610.39167},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2610.39167},
}Datasets & Benchmarks数据集与基准Manipulation & Dexterous Hands操作与灵巧手Perception, SLAM & 3D Mapping感知、SLAM 与三维建图egocentric-videocontact-predictionaffordancebenchmarkhuman-datareal