https://techcrunch.com/2023/10/25/google-plays-policy-update-cracks-down-on-offensive-ai-apps-disruptive-notifications/

Google is taking aim at potentially problematic generative AI apps with a new policy, to be enforced starting early next year, that will require developers of Android applications published on its Play Store to offer the ability to report or flag offensive AI-generated content. The new policy will insist that flagging and reporting can be done in-app and developers should use the report to inform their own approaches to filtering and moderation, the company says.

The change to the policy follows an explosion of AI-generated apps, some of which where users tricked the apps into creating NSFW imagery, as with Lensa last year. Others, meanwhile, have more subtle issues. For instance, an app that went viral this summer for AI headshots, Remini, was found to be greatly enhancing the size of some women’s breasts or cleavage, and thinning them. Then there were the more recent issues with Microsoft’s and Meta’s AI tools, where people found ways to bypass the guardrails to make images like Sonic the Hedgehog pregnant or fictional characters doing 9/11.