NEW YORK (ANN/THE YOMIURI SHIMBUN) – Ten leading tech companies have joined forces to tackle the growing threat of artificial intelligence being used to create and distribute child sexual abuse material.
Announced on Tuesday, this collaborative effort aims to prevent AI technologies from generating harmful content by removing such materials from their training datasets.
The partnership includes major industry players such as Google LLC, Microsoft Corp, OpenAI Inc, Amazon.com Inc, Meta Platforms Inc, and Stability AI Ltd.
These companies will work together to develop robust strategies to detect, prevent, and combat the propagation of AI-generated child sexual abuse material, addressing concerns about AI’s potential to create vast quantities of inappropriate content.
The dataset for training AI will be checked to see if it contains child sexual abuse materials and, if confirmed, will be removed. The companies agreed to assess AI models for their potential to generate such images before hosting them. They will also work on improving technology to detect harmful materials and share information with governments.
The spread of generative AI has created a growing concern that the human rights of children could be violated by the generation of large numbers of sexual images that specifically resemble real individuals.
In December, Stanford University’s research team announced that it identified a massive number of images in a dataset that it suspected of being what has been termed “child sexual abuse materials.”
The dataset in question has a filter to exclude illicit images during use, but it has been difficult to completely eliminate illicit images with the current technology.
