Antonio Torralba

EnvDreamer: Large-Scale Multimodal-to-Environment Generation for Embodied AI

Large datasets and high capacity models have accelerated progress in vision and language. This work introduces a platform aimed at bringing comparable gains to embodied learning, world models, and robotics. We present EnvDreamer, a framework that uses large language and vision language models to generate Unreal Engine...