Google Play AI content policy: the in-app report button

Yes. Google Play's AI-Generated Content policy says apps that generate content using AI must contain in-app user reporting or flagging features, so users can report offensive content to developers without needing to exit the app. Image or video generated from text, image or voice prompts counts as AI-generated content.

From the Google Play policy page, read 2026-10-01. The requirement sits in your app, not in the generation API behind it; this post covers what to wire up when that API is Sume.

What does the policy require?

Apps must comply with existing developer policies, including preventing generation of restricted content such as content that facilitates the exploitation or abuse of children, and content that enables deceptive behavior. The page adds that developers should use user reports to inform content filtering and moderation.

What do I need to store to act on a report?

A report is only useful if it points to a specific output. Sume's runs docs say to log the request_id, and that media URLs are durable media.sume.com HTTPS URLs that "do not expire" and are public to anyone holding the URL. Save the job id, the output URL and the user id in your own database when you show a result, so a flag from the app maps to one record.

Which features need extra care?

Anything involving real people's faces. Avatar Face Swap 1.0 is a Beta endpoint, and video_url must be a fetchable public HTTPS video URL. An app that lets users submit arbitrary source videos should treat reports on those outputs as a priority. See face swap versus avatar talking video for the choice.

Does a public URL change the moderation story?

It can. Because a durable URL is public, removing an item from your app does not remove the file from media.sume.com. The docs suggest proxying or copying media when you need per-customer access control, which gives you a place to enforce takedowns.

What should I do before submitting the app?

Add a report action on every generated result screen that works in place, store the job record behind each result, and decide who reviews reports. Check the live policy page when you submit. This is not legal advice.