RoboJudge: Multimodal Language Models as Judges for Embodied Video Generation
Benchmark of 800 human-rated robot/hand videos from 10 generators to test MLLM judges on physical adherence and instruction alignment, plus a 12K-video training set and RoboJudge-9B (Pearson 0.719 with humans).评测多模态大模型能否评判具身视频生成：800 条人工标注视频（10 个生成模型，夹爪/人手/灵巧手），考察物理合理性与指令一致性；另提供 1.2 万条训练视频及 RoboJudge-9B（与人类评分 Pearson 0.719）。
BibTeX
@misc{ma2026robojudge,
title = {{RoboJudge: Multimodal Language Models as Judges for Embodied Video Generation}},
author = {Siyuan Ma and Yu Qi and Cheng Ye and Ruotian Peng and Xinyi Xu and Zitiantao Lin and Zedong Cai and Yijian Huang and Weiyang Liu and Siyuan Wang and Yandong Wen},
year = {2026},
eprint = {2610.27782},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2610.27782},
}Datasets & Benchmarks数据集与基准World Models世界模型benchmarkvideo-generationmllm-judgephysical-adherencehuman-annotation