Allegro: video generator — what it does and what you need to run it

Allegro is an open source video generator from Rhymes AI that tackles the text-to-video task. The model turns a text description into a short clip and is distributed freely: both the code and the weights are released under the Apache-2.0 license.

What it does

As described by the author, Allegro generates videos up to 6 seconds long at 15 frames per second and 720p resolution. The model is built on the diffusers library and takes a simple text description as input. The authors do not specify which prompt languages are supported, but the examples in the repository are in English.

What you need to run it

Allegro is written in Python. You will need PyTorch version 2.4 or higher and CUDA 12.4 or newer — the authors explicitly mention only the CUDA platform. The full list of dependencies is in requirements.txt.

The largest model weights file is 8.9 GB, and the full set is 41.3 GB. As described by the author, without special measures the model requires about 27.5 GB of VRAM. If you enable --enable_cpu_offload, usage drops to roughly 9.3 GB, but inference time increases noticeably. The minimum threshold the developers mention in the context of memory savings is 3 GB, though this figure is not elaborated on verbatim in the documentation.

The code is available in the repository github.com/rhymes-ai/Allegro, and the weights are on huggingface.co/rhymes-ai/Allegro. Project website: rhymes.ai.

Who it is for

Allegro is aimed at those looking for an open source video generator that can be run on your own hardware. The model suits researchers and developers willing to deal with setting up a CUDA environment and managing memory via CPU offload. If you have a GPU with less than 9–10 GB of VRAM, you should count on the CPU offload mode and accept slower performance.

Allegro is not suitable for those who need generation longer than 6 seconds, a frame rate above 15 FPS, or operation without an NVIDIA GPU with CUDA support. The model is also not designed for users expecting a ready-made application with an interface: it runs via Python scripts.

Allegro is one of the few fully open source video generators where both the code and the weights are available under the permissive Apache-2.0 license. The repository was created in October 2024 and updated in early February 2025, so the project is in an active development phase.