Spectral Transport Homeostasis method corrects temporal consistency in video without
A group of researchers has published a paper on arXiv about diagnosing and correcting temporal consistency in video generation. The authors introduce the concept of Spectral Tension — a signed diagnostic metric that compares local attention dispersion with global spectral diversity. With its help, they identify two opposite failure modes: fragmented state transfer and over-averaging at "hot spots." Based on this diagnosis, they propose a Spectral Transport Homeostasis regulator that, without fine-tuning, gently corrects pathological temporal states. Details are in the paper on arXiv.
What it means
The work belongs to methods that are applied on top of already trained video generators, so it should be considered in conjunction with the models from our video generators section.
Lance from Bytedance claims an any-to-any task, including video generation and editing. The model weighs 13.2 GB as its largest file, all files total 28.6 GB, and the code and weights licenses are Apache-2.0. The author states that inference requires a GPU with at least 40 GB of VRAM and CUDA 12.4+. If the Spectral Transport Homeostasis method proves effective on unified models, it could be useful for improving temporal coherence in this class of architectures, but the Lance fact sheet has no information about support for external attention regulators.
LTX-Video from Lightricks is an open source image-to-video generator (Apache-2.0), with the largest weights file at 26.6 GB. The authors claim a requirement of only 1 GB of VRAM and MPS support on macOS. Since the method from the paper requires no fine-tuning and operates at the attention level, it is potentially applicable to diffusion models like LTX-Video; however, the tool fact sheet has no information about compatibility with such regulators.
CogVideoX from Zhipu AI handles the text-to-video task, weighs 9.2 GB as its largest file, the code license is Apache-2.0, and the weights license is The CogVideoX License: commercial use after registration, up to 1 million visits per month. The platform, as described by the author, is CUDA, with NVIDIA H100 and above recommended. As with LTX-Video, the method from the paper may be of interest for improving temporal consistency, but the CogVideoX fact sheet makes no mention of support for external training-free regulators.
The authors have released the method's code as open source, so it can be studied and tested for compatibility with specific generators. For now, the fact sheets of our tools contain no data on whether they support connecting such regulators, so practical applicability to Lance, LTX-Video, and CogVideoX remains to be tested separately.How the method works. The diagram was drawn for this news note.