AI video with sound vs voiceover plus lip sync: which Sume route
Use a video model's native audio for ambient sound, and TTS plus lip sync for a talking face. Sume's docs say video models do not lip-sync a later voiceover.

It depends on whether a face speaks. For B-roll, product motion and ambient sound, use a video model's own audio: on Sume, Gemini Omni Flash 1.1 has native synced audio always on, and the API rejects generate_audio: false. For a person speaking on camera, generate the voice with TTS first and then run a lip sync model on a posed still; Sume's docs state that video models do not lip-sync to generated TTS or to a later voiceover.
From the Video Router docs and the models index on origin/main b28f3b0, read 2026-10-13.
| Shot | Route on Sume | Audio comes from |
|---|---|---|
| Product B-roll with sound | POST /v1/video-router/generate with gemini-omni-flash-1.1 | Native audio, always on |
| Silent B-roll plus a music bed | Video Router, then Music Router and a timeline | sume/music-auto (Lyria 3.5 today) |
| A person speaking | TTS, then Fabric 1.0 (default) or H3 Max lip sync | The TTS file |
| Existing clip, new voice | Detach, new TTS, lip sync on a still | TTS file; see the lip sync window |
What does native audio cost?
For Omni, credits scale with the output seconds and the resolution (3 to 10 seconds, 360p to 4K, 16:9 or 9:16). The router has no bitrate_mode and no reference_audio_urls. Read capabilities from GET /v1/video-router/models because each model has its own envelope.
How do I add a music bed?
Music Router generates a track from a prompt. There is no duration field; Sume rejects duration and duration_seconds, so write the length in the prompt. Put exclusions in the positive prompt, for example Instrumental, no vocals. Every Music Router model uses the same flat credits per generation.
curl -X POST https://api.sume.com/v1/music-router/generate \
-H "Authorization: Bearer $SUME_API_KEY" \
-H "Content-Type: application/json" \
-H "Idempotency-Key: bed-001" \
-d '{
"model": "sume/music-auto",
"prompt": "Warm lo-fi, 84 BPM, C minor. A 20-second track. Instrumental, no vocals."
}'Sources
Related posts
More in Use cases
- Best AI video model for a consistent character: reference rows
For one character across clips, use a Sume row with reference images: Wan 3.0 (10), Omni (10), H3 and H3 Max (9). Kling 3 takes none. Read 2026-10-13.
- Best AI video model for lip-synced dialogue clips on Sume
For speech that matches the mouth, Sume offers Omni (native synced audio), H3 Max Lip Sync (audio 5-14.8 s, 10 MB max), or an avatar route. Read 2026-10-13.
- Best AI video model for product videos: pick the row by input
For a product video, pick the Sume row by the photos you have: first frame, end frame or reference images. Limits for seven rows, read 2026-10-13.
- Best AI video model for seamless loops: the end-frame rows
For a looping clip, use a Sume row that takes both a first and an end frame: Seedance, Wan 3.0, Kling 3, MiniMax H3 or Omni. Rows without one, read 2026-10-13.
Written by Sume