Qwen-Image Video-Edit

Instruction-based video editing by repurposing an image editing model

Yunpeng BaiYossi GandelsmanMichaël GharbiQixing Huang

Long-video editing β€” every 45-frame segment edited with a different instruction. Drag to compare.

Portrait videos supported natively (aspect-preserving).

How it works

Video generation models read and write video-VAE latents. We teach Qwen-Image-Edit's transformer to edit those latents directly: two tiny projections bridge Wan 2.1's latent space into the DiT's token space, warm-started from the DiT's own input/output layers so that a static video is embedded exactly like an image the model already understands. The latent frames are arranged as tiles of one big virtual image β€” the same positional treatment the image model was pretrained on. Fine-tuned with LoRA or full parameters on Ditto-1M (source, edited, instruction) triplets, then refined by a few steps of Wan 2.2 denoising-enhancement.

Source videoβ†’ Wan 2.1 VAE ❄→ In-projection πŸ”₯β†’ Qwen-Image-Edit DiT πŸ”₯
grid RoPE over latent frames Β· prompt via Qwen2.5-VL
β†’ Out-projection πŸ”₯β†’ Wan 2.1 VAE ❄→ Wan 2.2 enhance ❄→ Edited video
trained (LoRA / full FT)frozen

Results

Drag the divider on any clip to compare the original (left) with the edited result (right).

BibTeX

@misc{qwenvideoedit2026,
  title  = {Qwen-Video-Edit: Instruction-based Video Editing by Repurposing an Image Editing Model},
  author = {Yunpeng Bai, Yossi Gandelsman, MichaΓ«l Gharbi, Qixing Huang},
  year   = {2026},
  url    = {https://github.com/yunpeng1998/Qwen-Video-Edit}
}