DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution
Multi-exit VLA that stops at the smallest model fit for the moment, with budgets for power, latency and GPU memory; on CALVIN it reports 5.2–6.5× lower LLM compute and 2–6× less memory without hurting performance.多出口 VLA:按当前情境停在够用的最小模型,并按功耗、时延和显存预算设定退出条件;在 CALVIN 上报告 LLM 计算量降低 5.2–6.5 倍、显存降低 2–6 倍,性能不降。
BibTeX
@misc{yue2024deer,
title = {{DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution}},
author = {Yang Yue and Yulin Wang and Bingyi Kang and Yizeng Han and Shenzhi Wang and Shiji Song and Jiashi Feng and Gao Huang},
year = {2024},
eprint = {2411.02359},
archivePrefix = {arXiv},
primaryClass = {cs.RO},
url = {https://arxiv.org/abs/2411.02359},
}