🔗 Share this article

Regulators in the country have unveiled strict planned rules for AI systems designed to provide robust measures for young users and halt conversational agents from offering advice that could result in violence.

According to the proposed regulations, developers will also be required to guarantee their algorithms prevent the production of output that encourages gambling.

A Move to Fast-Paced Adoption

This oversight initiative comes after a sharp increase in the launch of chatbots being released within China and worldwide.

Once finalised, these regulations will cover AI offerings operating in the country, marking a major move to govern the fast-growing technology, which has faced increased scrutiny over user safety concerns recently.

Core Measures of the Proposed Regulations

The published guidelines contain a number of measures expressly aimed at safeguarding minors. These provisions include obligating AI providers to:

• Provide individual controls.
• Set time limits on usage.
• Get authorisation from guardians before offering companionship functions.

Furthermore chatbot operators are required to have a live agent take over any conversation involving self-injury and promptly notify the user's guardian.

AI providers are also obligated to guarantee their systems avoid producing content that compromises national security, harms state interests, or weakens national unity.

Balancing Development and Safety

The authorities noted that it promotes the application of AI, such as to showcase local culture and develop services for companionship for the older adults, as long as the technology are safe and reliable.

Stakeholder comments on the regulations has been requested.

Global Backdrop and Scrutiny

The effect of AI on human behaviour has faced increased scrutiny globally in the past year.

The chief executive of a leading AI company remarked this year that handling how chatbots deal with conversations involving self-harm is among the sector's biggest challenges.

In a landmark incident, a family in the United States filed a lawsuit an AI company, claiming that its system advised their teenage son to die by suicide. This case represented the initial of its kind alleging wrongful death.

This month, the same firm posted a job for a senior role focusing on mitigating risks from AI models to psychological well-being.

"This is expected to be a stressful role, and the candidate will begin in the deep end almost immediately," stated the executive.

The rapid ascent of various AI platforms, which have gained millions of users worldwide, highlights the urgent need for such regulatory guidelines.