Starstruk Logo MarkStarstruk

v1.0.0

sherlock-project/sherlockv1.0.0Mar 17, 2024by FrankLeeeee

AI Summary

The initial release of Open-Sora, an open-source initiative for high-quality video generation offering training pipelines, data processing code, and optimized system architectures.

Key Highlights

  • Open-source video generation initiative
  • Data processing source code
  • Sora-like training and inference pipeline
  • System optimization with ColossalAI and Flash Attention
  • Model weights for 16x256x256 and 16x512x512

New Features

  • Data processing source code
  • Video generation training and inference pipeline
  • System optimization (ColossalAI, Flash Attention)
  • Available model weights

Full Release Notes

We present Open-Sora, an initiative dedicated to efficiently produce high-quality video and make the model, tools and contents accessible to all. By embracing open-source principles, Open-Sora not only democratizes access to advanced video generation techniques, but also offers a streamlined and user-friendly platform that simplifies the complexities of video production. With Open-Sora, we aim to inspire innovation, creativity, and inclusivity in the realm of content creation.

In this release, we have included
- source code for data processing
- source code for sora-like video generation training and inference pipeline
- system optimization powered by ColossalAI and flash attention
- model weights trained for 16×256×256 and 16×512x512 resolutions, available on Hugging Face