# Towards Streaming Synchronized Spatial Audio Generation via Autoregressive Diffusion Transformer

Page: https://stenobird.com/podcast/daily-paper-cast-7079649/towards-streaming-synchronized-spatial-audio-generation-via-autoregressive-diffusion-transformer
Text version: https://stenobird.com/podcast/daily-paper-cast-7079649/towards-streaming-synchronized-spatial-audio-generation-via-autoregressive-diffusion-transformer.md
Podcast: [Daily Paper Cast](https://stenobird.com/podcast/daily-paper-cast-7079649)
Published: 2026-06-02T04:13:05+00:00
Episode link: https://share.transistor.fm/s/cea1adc1
Audio file: https://media.transistor.fm/cea1adc1/6f6f8225.mp3
Processing state: not_requested
JSON: https://stenobird.com/v1/public/podcasts/daily-paper-cast-7079649/episodes/towards-streaming-synchronized-spatial-audio-generation-via-autoregressive-diffusion-transformer
Duration seconds: 1576

## Resource

🤗 Upvotes: 28 | eess.AS, cs.MM, cs.SD Authors: Ke Lei, Yu Zhang, Changhao Pan, Xueyi Pu, Wenxiang Guo, Ruiqi Li, Zhou Zhao Title: Towards Streaming Synchronized Spatial Audio Generation via Autoregressive Diffusion Transformer Arxiv: http://arxiv.org/abs/2605.30940v1 Abstract: Real-time and accurate spatial audio generation is pivotal for delivering an immersive experience. However, existing spatial audio synthesis technologies are often encumbered by a tradeoff between generation quality and high inference latency, as well as difficulty in capturing precise spatial information from multimodal inputs. To address these challenges, we propose SwanSphere, a unified streaming framework for high-fidelity spatial audio generation from panoramic videos and text prompts. SwanSphere mainly makes the following contributions: 1) We introduce a causal autoregressive diffusion transformer architecture that enables streaming high-quality spatial audio generation. 2) We design a Spatial Video-Audio Contrastive (SVAC) learning strategy to align the video encoder with the acoustic domain, and further employ a multi-objective online direct preference optimization (ODPO) scheme, resulting in strong spatial perception and robust multimodal spatial audio synthesis. 3) To alleviate the current scarcity of spatial audio datasets, we also develop an automated annotation pipeline for generating detailed spatial captions. Experimental results demonstrate that SwanSphere achieves superior performance in both video-to-spatial and text-to-spatial audio generation tasks. Demos can be found at: https://swanaigc.github.io.

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/daily-paper-cast-7079649/episodes/towards-streaming-synchronized-spatial-audio-generation-via-autoregressive-diffusion-transformer/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/daily-paper-cast-7079649/towards-streaming-synchronized-spatial-audio-generation-via-autoregressive-diffusion-transformer.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.