Episode
OrbitQuant: Data-Agnostic Quantization for Image and Video Diffusion Transformers
- Podcast
- Daily Paper Cast
- Published
- Jul 7, 2026
- Duration seconds
- 1387
- Processing state
not_requested- Canonical source
- https://share.transistor.fm/s/f03d2d1c
Actions
POST https://stenobird.com/v1/public/podcasts/daily-paper-cast-7079649/episodes/orbitquant-data-agnostic-quantization-for-image-and-video-diffusion-transformers/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/daily-paper-cast-7079649/orbitquant-data-agnostic-quantization-for-image-and-video-diffusion-transformers.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
🤗 Upvotes: 28 | cs.CV, cs.AI, cs.LG Authors: Donghyun Lee, Jitesh Chavan, Duy Nguyen, Sam Huang, Liming Jiang, Priyadarshini Panda, Timo Mertens, Saurabh Shukla Title: OrbitQuant: Data-Agnostic Quantization for Image and Video Diffusion Transformers Arxiv: http://arxiv.org/abs/2607.02461v1 Abstract: Diffusion transformers (DiTs) achieve state-of-the-art image and video generation, but their multi-step sampling and growing parameter count make inference expensive. Post-training quantization (PTQ) is the natural remedy, yet DiT activations shift across timesteps, prompts, and guidance branches, forcing prior methods to re-fit calibration data for every new checkpoint or modality. We present OrbitQuant, a data-agnostic weight-activation quantizer that bypasses range estimation by quantizing in a normalized, rotated basis. In this basis, a randomized permuted block-Hadamard (RPBH) rotation concentrates each coordinate around one fixed, known marginal regardless of the input, so a single Lloyd-Max codebook serves all timesteps, prompts, and layers of a given input dimension. We extend the same quantizer to weight rows offline, absorbing the rotation into the weights so that it cancels inside each linear layer and only a forward rotation on the activations remains at runtime. The same recipe transfers from image to video with no per-modality tuning. Across FLUX.1, Z-Image-Turbo, Wan 2.1, and CogVideoX, it sets the state of the art for PTQ at several low-bit settings. It also pushes PTQ of image diffusion transformers to W2A4 with usable generation quality.