Android System SafetyCore: Nude photo warner lands on smartphones

Internet forums are full of questions about the “Android System SafetyCore” app, which has apparently recently been silently reinstalled on many smartphones. The all-clear first: the app is not malware. However, not everyone may want to keep it.

In the Google Play Store, the manufacturer explains the function of Android System SafetyCore. The company writes: “SafetyCore is a Google system service for devices with Android 9 and newer versions. It provides the underlying technology for features like the upcoming content alerts in Google Messages that help users protect themselves when they receive potentially unwanted content.” Google adds: “While the distribution of SafetyCore started last year, the Sensitive Content Warning feature in Google Messages will be rolled out gradually in 2025.”

Sensitive content: Google Messages warns against nude images

Google also emphasizes: “Processing for the Sensitive Content Warning feature is done on the device, and all images or specific results and warnings remain private to users.” A post in Google's security blog from last October has gone somewhat under the radar. In it, the company explains the planned security improvements in Google's Messages app.

The developers write there that they have made “security a top priority” and have programmed “powerful, on-device, AI-based filters and advanced security” to protect users from two billion suspicious messages per month. Google mentions, for example, protection against scam messages about parcel deliveries or job offers, “intelligent warnings” about potentially dangerous links and blocking options for messages from unknown international senders.

In fourth place comes the function that is causing discussion: “Sensitive content warnings” allow control over whether someone wants to see or send nude images. The company explains: “'Sensitive Content Warnings' is an optional feature that blurs content that may contain nudity before it is displayed. The feature notifies users with a 'speed bump' and offers options to find help or view the content. If the feature is enabled, it will also display this warning when an image showing nudity is sent or forwarded to reduce the risk of accidentally sending nude images.” The “speed bump” appears to refer to a vibration alert.

The function runs on the devices and serves to protect privacy, Google explains further. It does not attack end-to-end encryption. “'Sensitive content alerts' do not allow Google to access the content of the images, nor does Google learn that nudity has been detected,” the developers write.

Apple users have been aware of the controversial function for years. In mid-2023, the company expanded the function, which was first introduced in the iMessage messaging app, to other parts of the operating system and videos.

(dmk)