Child safety org flags new CSAM with AI trained on real child sex abuse images
arstechnica.com
AI will make it harder to spread CSAM online, child safety org says.

Today, a prominent child safety organization, Thorn, in partnership with a leading cloud-based AI solutions provider, Hive, announced the release of an AI model designed to flag unknown CSAM at upload. It’s the earliest AI technology striving to expose unreported CSAM at scale.

  • floofloof@lemmy.caEnglish
    0·
    5 days ago

    This seems like a potential actual good use of AI. Can’t have been much fun to train it though.

    And is there any risk of people turning these kinds of models around and using them to generate images?

    • Jimbabwe@lemmy.worldEnglish
      0·
      5 days ago

      If AI was reliable, maybe. MAYBE. But guess what? It turns out that “advanced autocomplete” does a shitty job of most things, and I bet false positives will be numerous.