Cosmos3
kazuto-07/TTS-cacherCosmos3Jun 1, 2026by mingyuliutw
Upgrading?
AI Summary
NVIDIA launches Cosmos 3, an open-source family of omnimodal world foundation models designed for Physical AI, unifying text, images, video, audio, and actions with specialized models for robotics.
Key Highlights
- Unified omnimodal architecture supporting text, image, video, audio, and actions.
- Introduces 'Reasoner + Generator' architecture for world understanding and simulation.
- Features specialized models for robotics, including Cosmos3-Nano-Policy-DROID.
- Open release of models, code, datasets, and evaluation tooling for the community.
- Includes high-capacity models like Cosmos3-Super (64B) and Cosmos3-Nano (16B).
New Features
- Cosmos3-Nano (16B) model
- Cosmos3-Super (64B) model
- Cosmos3-Super-Text2Image model
- Cosmos3-Super-Image2Video model
- Cosmos3-Nano-Policy-DROID model
Full Release Notes
# Cosmos 3 is Here π Today, we're excited to release Cosmos 3 β NVIDIA's next-generation family of open omnimodal world foundation models for Physical AI. Cosmos 3 unifies language, images, video, audio, and actions within a single architecture, enabling developers to build agents that can understand, reason about, simulate, and act in the physical world. From world generation and simulation to robotics and embodied AI, Cosmos 3 serves as a general-purpose foundation model for Physical AI. What's new: - π Unified omnimodal world model supporting text, image, video, audio, and action modalities - π§ Integrated Reasoner + Generator architecture for world understanding and world generation - π¬ Flexible generation across Text-to-Image, Image-to-Video, Video-to-World, and multimodal simulation tasks - π€ Native support for robot action generation and policy learning through Cosmos3-Policy models - π State-of-the-art open model performance across world understanding, generation, and robotics benchmarks - π Open release of models, code, datasets, evaluation benchmarks, and inference tooling for the Physical AI community :book: [Read the Paper](https://research.nvidia.com/labs/cosmos-lab/cosmos3/technical-report.pdf) | :point_right: [Download the Models](https://huggingface.co/collections/nvidia/cosmos3) | π§βπ³ [Explore the Cosmos Cookbook](https://github.com/NVIDIA/cosmos/tree/main/cookbooks/cosmos3) The Cosmos 3 release includes: - Cosmos3-Nano (16B) β Compact omnimodal world foundation model optimized for efficient deployment and development. - Cosmos3-Super (64B) β High-capacity world model for advanced reasoning, generation, simulation, and Physical AI applications. - Cosmos3-Super-Text2Image β State-of-the-art text-to-image generation model built on Cosmos 3. - Cosmos3-Super-Image2Video β High-fidelity image-to-video generation model with strong temporal consistency and controllability. - Cosmos3-Nano-Policy-DROID β Open robot foundation model for learning manipulation and control policies directly from demonstrations. Cosmos 3 represents a major step toward general-purpose world models that can perceive, reason, simulate, and actβbringing us closer to a future where Physical AI can learn from both the real world and generated worlds at scale.
Related Repositories
public-apis/public-apisβ
491,256
A collective list of free APIs
NousResearch/hermes-agentβ
256,126
The agent that grows with you
yt-dlp/yt-dlpβ
200,304
A feature-rich command-line audio/video downloader
microsoft/markitdownβ
191,591
Python tool for converting files and office documents to Markdown.
Significant-Gravitas/AutoGPTβ
187,703
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.