RobotArena ∞: Scalable Robot Benchmarking via Real-to-Sim Translation
Yash Jangir, Yidi Zhang, Kashu Yamazaki, Chenyu Zhang, Kuan-Hsun Tu, and 4 more authors
In International Conference on Learning Representations (ICLR), 2026
RobotArena infinity shifts vision-language-action policy evaluation into large-scale simulated environments built automatically from real robot video. The pipeline converts demonstrations from widely used robot datasets into physics-consistent simulated counterparts using vision-language models, 2D-to-3D generative modeling and differentiable rendering, requiring only a single RGB image from a static-camera demonstration. Policies are scored by both VLM-guided automatic evaluation and scalable human preference judgments.