代码仓库
模型 / 科研
genrl · mazpie
GenRL:多模态基础世界模型通过将语言和视频提示转变为潜在世界模型状态的序列,使语言和视频提示能够扎根于具体域。潜在状态序列可以……
概述
GenRL:Multimodal-foundation world models enable grounding language and video prompts into embodied domains, by turning them into sequences of latent world model states. Latent state sequences can…<br><br>Publisher purpose:[NeurIPS 2024] GenRL:Multimodal-foundation world models enable grounding language and video prompts into embodied domains, by turning them into sequences of latent world model states. Latent state sequences can be decoded using the decoder of the model, allowing visualization of the expected behavior, before training the agent to execute it.<br><br>Review observation/action interfaces, checkpoints, robot embodiments and adaptation requirements. Repository code licensing does not automatically license weights or training data.
项目信息
- 维护者
- mazpie
- 主要语言
- Python
- 存储库代码许可证
- MIT
- 模型重量许可证
- 未记录
- 数据集许可
- 未记录
- 硬件设计许可证
- 未记录
- 维护
- 未存档在最后记录的元数据中
- 最后观察到的存储库推送
- 2025-04-04
代码许可不会自动涵盖模型权重、数据集或硬件设计。未记录的许可证详细信息需要与发布者确认。
文档部分
- GenRL:Multimodal-foundation world models for generalization in embodied agents
- 📰 Updates
- Get started
- Creating the environment
- Downloading InternVideo2
- Data