From 2022, on Google’s Account Locking Practices ⇥ nytimes.com

In August 2022, Kashmir Hill reported for the New York Times on two fathers who had, in separate cases, captured photos of their toddlers’ genitals for medical documentation on Android phones, and subsequently had their Google accounts locked. Both accounts were erroneously flagged for containing child sexual abuse materials, a heinous accusation that both fought — unsuccessfully, as of the article’s publication.

I wrote about what I learned from that article and a different incident affecting a Gmail account belonging to Talking Points Memo. But I never linked to a followup article from December of the same year, which I stumbled across earlier today as I was looking into Paris Buttfield-Addison’s Apple account woes, now apparently resolved.

Hill:

In recent months The Times, reporting on the power that technology companies wield over the most intimate parts of their users’ lives, brought to Google’s attention several instances when its previous review process appeared to have gone awry.

In two separate cases, fathers took photos of their naked toddlers to facilitate medical treatment. An algorithm automatically flagged the images, and then human moderators deemed them in violation of Google’s rules. The police determined that the fathers had committed no crime, but the company still deleted their accounts.

I do not know if either of these accounts were restored. I have asked Hill on Bluesky and I hope to hear back. (Update: Hill says neither parent recovered their account, though one was able to retrieve some account data that was turned over to police.)

Hill:

It took four months for the mother in Colorado, who asked that her name not be used to protect her son’s privacy, to get her account back. Google reinstated it after The Times brought the case to the company’s attention.

This is well after Google says all the account data should have been deleted, which raises more questions.