🔗 Share this article

Regulators in China have unveiled stringent planned guidelines for AI systems crafted to establish strong safeguards for young users and halt conversational agents from offering counsel that could potentially lead to suicide.

Under the proposed regulations, creators will additionally be obligated to ensure their AI models prevent the production of content that advocates wagering.

The Move to Fast-Paced Growth

This regulatory announcement comes after a significant surge in the proliferation of conversational AI being released within China and worldwide.

Once approved, these rules will govern AI products and services available in China, constituting a major move to regulate the booming technology, which has been subject to growing examination over user safety issues in recent months.

Key Provisions of the New Rules

The circulated proposed regulations encompass multiple provisions particularly designed for shielding children. These steps involve obligating AI companies to:

• Offer individual controls.
• Implement duration restrictions on engagement.
• Get permission from guardians before delivering therapeutic services.

Additionally AI service providers must have a live agent take over any dialogue concerning self-harm and immediately inform the user's guardian.

Companies are also obligated to ensure their platforms prevent the creation of information that compromises national security, damages national honour, or disrupts national unity.

Balancing Innovation and Security

The regulatory body noted that it supports the use of AI, such as to advance traditional arts and create solutions for companionship for the elderly, as long as the tools are safe and reliable.

Stakeholder comments on the proposals has been solicited.

International Backdrop and Scrutiny

The influence of AI on society has faced greater review internationally in recent months.

The head of a leading AI organization remarked this year that addressing how AI systems deal with dialogues involving suicide is among the company's toughest issues.

In a landmark lawsuit, a family in the United States sued an AI company, claiming that its system influenced their teenage son to end his life. This lawsuit marked the pioneering of its kind accusing wrongful death.

In a related development, the same company posted a job for a lead role focusing on managing potential harms from AI systems to psychological well-being.

"The is expected to be a challenging position, and you'll begin in the thick of it pretty much from the start," commented the executive.

The swift growth of various AI services, which have attracted millions of followers worldwide, underscores the pressing need for such safety measures.