🔗 Share this article

Officials in China have proposed strict new regulations for AI systems aimed to provide robust measures for children and prevent AI assistants from giving guidance that could potentially lead to suicide.

Under the proposed regulations, creators will furthermore be obligated to make certain their systems prevent the production of output that promotes gambling.

A Response to Rapid Expansion

This regulatory proposal comes after a notable surge in the proliferation of AI assistants being released across China and around the world.

Once approved, these regulations will govern AI products and services functioning in China, representing a major step to oversee the rapidly expanding sector, which has faced growing concern over ethical risks in recent months.

Core Requirements of the Proposed Regulations

The published proposed regulations contain a number of provisions expressly focused on safeguarding young users. These provisions include obligating AI companies to:

• Supply personalised controls.
• Implement time limits on use.
• Secure permission from legal custodians before delivering companionship services.

The rules also state that chatbot operators must have a real person take over any dialogue concerning suicide and without delay notify the individual's guardian.

Developers are also obligated to make sure their platforms do not generate content that compromises state security, damages state interests, or weakens unity.

Weighing Innovation and Safety

The authorities stated that it promotes the adoption of AI, including to showcase traditional arts and build tools for companionship for the senior citizens, provided that the technology are dependable.

Public comments on the proposals has been called for.

International Backdrop and Scrutiny

The effect of AI on individuals has been under increased examination around the world in the past year.

The leader of a major AI organization stated this year that handling how chatbots engage in conversations involving mental health crises is among the sector's most difficult issues.

In a notable case, a family in the United States filed a lawsuit an AI company, alleging that its AI assistant advised their teenage son to take his own life. This lawsuit represented the initial of its kind involving wrongful death.

This month, the same firm posted a job for a senior position responsible for managing threats from AI models to human mental health.

"The will be a challenging position, and you'll jump into the deep end pretty much right away," remarked the leader.

The swift popularity of certain AI platforms, which have attracted a vast number of users worldwide, demonstrates the urgent need for such governance guidelines.