BEAKER: An Expert-Curated Benchmark for Embodied Brains in Self-Driving Chemical Laboratories
1,000 expert-curated questions over 11 image and video task types test multimodal LLMs as the brain of a self-driving chemistry lab: affordances, trajectories, apparatus setup, safety and step reasoning.1000 道专家整理的题目、11 种图像和视频任务，检验多模态大模型能否担任自动化化学实验室的“大脑”：可供性、轨迹、仪器搭建、安全与步骤推理。
BibTeX
@misc{lin2026beaker,
title = {{BEAKER: An Expert-Curated Benchmark for Embodied Brains in Self-Driving Chemical Laboratories}},
author = {Fei Lin and Tengchao Zhang and Ziyang Gong and Xiaotong Yu and Bohan Zhang and Yifan Zhou and Qihao Yang and Ji Dai and Dong Li and Yining Jiang and Qinghua Ni and Jun Huang and Qiang Zhang and Yue Zhou and Zhihang Zhong and Yonglin Tian and Fei-Yue Wang and Xue Yang},
year = {2026},
eprint = {2611.06911},
archivePrefix = {arXiv},
primaryClass = {cs.AI},
url = {https://arxiv.org/abs/2611.06911},
}