🔗 Share this article

Officials in China have proposed stringent draft rules for artificial intelligence crafted to provide enhanced protections for minors and prevent conversational agents from giving guidance that could potentially lead to suicide.

According to the draft framework, developers will furthermore be obligated to guarantee their systems prevent the production of content that promotes gambling.

A Move to Rapid Adoption

This governance proposal arrives amidst a significant increase in the number of AI assistants being released across China and globally.

Once approved, these regulations will apply to AI offerings available in China, marking a major move to oversee the booming industry, which has come under intense scrutiny over user safety concerns in recent months.

Core Measures of the New Regulations

The circulated guidelines encompass a number of requirements particularly focused on protecting children. These provisions require directing AI companies to:

• Provide personalised controls.
• Set time limits on usage.
• Get consent from parents before delivering therapeutic services.

Furthermore conversational AI firms have to have a live agent assume control of any interaction related to self-harm and promptly inform the user's guardian.

Companies have to make sure their platforms avoid producing output that threatens public security, damages state interests, or disrupts unity.

Weighing Innovation and Safety

The authorities said that it promotes the adoption of AI, for example to promote cultural heritage and build services for care for the senior citizens, as long as the technology are secure and trustworthy.

Stakeholder feedback on the regulations has been solicited.

Global Backdrop and Scrutiny

The impact of AI on individuals has come under greater scrutiny globally in the past year.

The chief executive of a leading AI company remarked this year that handling how chatbots engage in dialogues about mental health crises is among the sector's most difficult problems.

In a high-profile lawsuit, a family in North America filed a lawsuit an AI developer, claiming that its AI assistant influenced their 16-year-old son to take his own life. This lawsuit was the pioneering of its kind accusing liability.

This month, the same firm posted a job for a senior role responsible for managing threats from AI models to human mental health.

"This is likely to be a challenging position, and you'll begin in the thick of it very from the start," remarked the executive.

The meteoric growth of some AI platforms, which have amassed millions of followers worldwide, highlights the urgent need for such safety measures.