Omni edit plus a reference image returns 400: send one or the other

Sume rejects video_url together with image or reference fields. Choose edit or reference-to-video on gemini-omni-flash-1.1, and see each field list.

4 min readSume
All posts

Sume's validator returns 400 when a request carries both video_url and any frame or reference field: use either video_url (edit) or frame/reference fields, not both. If you wanted to edit a clip and also show the model the replacement object, put the object in the prompt, or run a reference-to-video call to make a new clip instead.

Two modes, two field sets

gemini-omni-flash-1.1 request shapes (read 2026-10-03)
ModeSendDo not send
Editprompt, video_url, optional resolutionimage_url, end_image_url, reference_*_urls, aspect_ratio
Reference to videoprompt, reference_image_urls (up to 10) and/or reference_video_urls (up to 3, each up to 3 s)video_url
Image to videoprompt, image_url, optional end_image_urlvideo_url

A workaround that stays inside the rules

Describe the replacement in the edit prompt, as in the docs example: replace the bottle with an apple and keep everything else the same. If a photo is essential, generate a new clip with the photo as a reference and accept that it is a new clip, not your original footage. In reference mode the docs address media as <IMAGE_REF_0> and <VIDEO_REF_0>, zero-based in list order.

Omni takes no reference_audio_urls.

Sources

Related posts

More in Developers

All Developers posts

Written by Sume