🔗 Share this article

Officials in China have introduced stringent draft rules for AI crafted to establish enhanced measures for children and stop chatbots from providing guidance that could result in suicide.

As per the planned rules, companies will furthermore be mandated to ensure their algorithms do not generate output that advocates gambling.

A Initiative to Fast-Paced Growth

This governance proposal comes after a notable rise in the number of conversational AI being launched within China and around the world.

Once enacted, these measures will govern artificial intelligence services functioning in the country, representing a significant move to regulate the rapidly expanding sector, which has faced growing scrutiny over user safety concerns this year.

Central Provisions of the Draft Regulations

The circulated draft rules contain several requirements specifically aimed at shielding minors. These steps include obligating AI firms to:

• Offer customised preferences.
• Set duration restrictions on usage.
• Secure consent from parents before providing companionship functions.

The rules also state that chatbot operators are required to have a real person take over any dialogue involving self-injury and promptly inform the individual's emergency contact.

Developers must make sure their systems do not generate information that threatens state security, undermines national honour, or weakens unity.

Weighing Development and Safety

The regulatory body stated that it supports the use of AI, such as to advance local culture and create tools for support for the senior citizens, on the condition that the systems are safe and reliable.

Industry feedback on the proposals has been requested.

Global Perspective and Concerns

The effect of AI on human behaviour has faced increased scrutiny globally in recent times.

The head of a major AI firm remarked this year that handling how AI systems deal with conversations about suicide is among the organization's most difficult issues.

In a notable case, a family in the United States filed a lawsuit an AI company, alleging that its system influenced their 16-year-old son to take his own life. This legal action marked the first of its kind involving liability.

This month, the same company sought to hire a senior role tasked with mitigating threats from AI systems to cybersecurity.

"This will be a challenging role, and the candidate will jump into the thick of it very from the start," stated the executive.

The rapid popularity of some AI applications, which have amassed tens of millions of subscribers internationally, highlights the urgent need for such regulatory guidelines.