Eye, Robot: Learning Expressive Gaze Dynamics via a VLM-Guided Transformer-VAE
Humanoid gaze system: a VLM picks where to look and a Transformer-VAE trained on retargeted human recordings generates coordinated eye, neck and eyelid motion. Lowest joint error on a 2-second benchmark.人形机器人注视系统：VLM 选择注视目标，基于重定向人类录像训练的 Transformer-VAE 生成协调的眼、颈与眼睑运动。在 2 秒基准上关节误差最低。
BibTeX
@misc{hu2026eye,
title = {{Eye, Robot: Learning Expressive Gaze Dynamics via a VLM-Guided Transformer-VAE}},
author = {Yuhang Hu and Junlin Lyu and Yuan Fang and Xiaoying Shen and Lechen Zhang and Jiong Lin and Judah Goldfeder and Steven Tian and Hod Lipson},
year = {2026},
eprint = {2610.19635},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2610.19635},
}