A Touch, Vision, and Language Dataset for Multimodal Alignment
TVL pairs tactile and visual observations with language descriptions and trains a touch-vision-language encoder plus a model that describes how things feel.TVL 数据集将触觉与视觉观测配上语言描述,并训练触觉-视觉-语言编码器以及能描述物体触感的模型。
BibTeX
@misc{fu2024touch,
title = {{A Touch, Vision, and Language Dataset for Multimodal Alignment}},
author = {Letian Fu and Gaurav Datta and Huang Huang and William Chung-Ho Panitch and Jaimyn Drake and Joseph Ortiz and Mustafa Mukadam and Mike Lambeta and Roberto Calandra and Ken Goldberg},
year = {2024},
eprint = {2402.13232},
archivePrefix = {arXiv},
primaryClass = {cs.CV},
url = {https://arxiv.org/abs/2402.13232},
}Tactile & Visuotactile Sensing触觉与视触觉感知Datasets & Benchmarks数据集与基准datasetvision-based-tactilelanguagerepresentation