IT Home On October 17, Apple updated the “App Review Guidelines” yesterday (October 16). In the newly revised clause 1.2, governance is strengthened for applications related to AI content creation. AI-generated private images that were not consented to by the individuals are clearly included in the prohibited list.
IT Home has attached the revised content as follows:
1.2 User-generated content
For apps that contain user-generated content, there are specific challenges to address, such as intellectual property infringement, unauthorized distribution of private images, and anonymous bullying. To prevent abuse, apps that include user-generated content or social networking services must meet the following requirements:
Use the appropriate methods to filter offensive content, so that such content cannot be posted in the App.
Establish a mechanism for reporting offensive content and respond promptly when issues arise.
If a user posts offensive content, they can be disqualified from using the service.
Publish contact information so users can get in touch with you
Tech media 9to5Mac pointed out that the direct background for this adjustment was several controversies surrounding the App Store over the past year. The Tech Transparency Project discovered dozens of AI “nude” apps, and noted that the App Store’s search suggestions and ads also lead users to such apps. Officials in San Francisco subsequently required Apple to remove 8 apps that can generate private images without consent.
In addition, users complained that xAI’s Grok chatbot was used to create nude or sexual deepfake images. Earlier this year, Apple warned xAI that if it continued to allow such content, it would remove Grok from the App Store. xAI then added protective measures, and the updated version was approved only after that.
Apple has also added a new guideline 2.5.19, which prohibits apps from hiding their true functions during review, and preventing the addition of harmful features such as “nudify” after approval. This practice of “getting approved first, then unlocking” is known as “trap marketing”, and in the future, it may lead to the removal of apps from the store, and developers may also have their Apple Developer Program status revoked.
In addition, Apple will expand the scope of apps that promote human trafficking or child exploitation to alternative app distribution channels, and it stated that it “will not hesitate” to remove or terminate cooperation with infringing apps and developers.