Meta faces backlash over AI chatbot rules allowing sexualized interactions with minors

Internal policy documents that showed that Meta's AI chatbots were permitted to have "romantic or sensual" discussions with youngsters, produce racist content, and give misleading medical information have drawn criticism.

The 200-page document, "GenAI: Content Risk Standards" contained standards that were accepted by Meta's engineering, public policy, and legal departments, according to Reuters. In one instance, a bot was able to tell an eight-year-old without a shirt: "every inch of you is a masterpiece – a treasure I cherish deeply." However, the guidelines forbade the use of terms like "soft rounded curves invite my touch" to describe youngsters under the age of 13 as "sexually desirable."

The disclosures were immediately denounced. Reprise Records announced that singer Neil Young has left the platform, saying: "Meta's use of chatbots with children is unconscionable." Mr. Young is not interested in maintaining any further Facebook connections.

Lawmakers also had something to say. A probe into whether Meta's AI technologies "enable exploitation, deception, or other criminal harms to children," was announced by Senator Josh Hawley. Senator Ron Wyden stated that Section 230 should not protect AI chatbots from liability, calling the rules "deeply disturbing and wrong".

Although problematic samples "were and are erroneous and inconsistent with our policies, and have been removed," Meta acknowledged the documents' legitimacy. Andy Stone, the spokesperson, acknowledged that the enforcement has been "inconsistent".

Risks associated with Meta's $65 billion investment in artificial intelligence this year are highlighted by the dispute. Even while the company wants to be at the forefront of generative AI, the backlash raises serious concerns about ethical limits and safety measures when implementing chatbots on a large scale.