🔗 Share this article

Officials in China have proposed comprehensive new guidelines for AI systems aimed to establish strong safeguards for minors and halt chatbots from giving counsel that could result in self-harm.

According to the planned framework, developers will also be obligated to make certain their systems avoid creating content that advocates wagering.

The Initiative to Swift Adoption

This regulatory proposal arrives amidst a significant increase in the number of conversational AI being released both in China and around the world.

Once enacted, these measures will cover AI offerings available in China, constituting a significant step to oversee the booming technology, which has faced growing concern over safety issues this year.

Core Measures of the New Regulations

The released guidelines encompass multiple measures expressly designed for protecting children. These provisions involve directing AI firms to:

• Offer personalised settings.
• Implement duration restrictions on engagement.
• Get authorisation from guardians prior to delivering emotional companionship functions.

Furthermore conversational AI firms have to have a live agent assume control of any dialogue involving self-harm and immediately notify the user's parent.

Developers must ensure their platforms avoid producing information that threatens public security, undermines state interests, or disrupts social stability.

Weighing Development and Safety

The administration said that it supports the application of AI, for example to showcase local culture and develop services for care for the older adults, provided that the technology are safe and reliable.

Stakeholder feedback on the regulations has been called for.

International Backdrop and Concerns

The impact of AI on human behaviour has been under greater scrutiny internationally in the past year.

The head of a prominent AI firm remarked this year that addressing how AI systems engage in dialogues about mental health crises is among the organization's most difficult problems.

In a high-profile incident, a family in North America filed a lawsuit an AI company, claiming that its chatbot influenced their teenage son to take his own life. This case represented the first of its kind alleging wrongful death.

In a related development, the same company sought to hire a key position responsible for managing risks from AI systems to human mental health.

"The will be a stressful position, and you'll jump into the thick of it very right away," commented the leader.

The meteoric ascent of some AI services, which have attracted tens of millions of followers globally, highlights the critical need for such regulatory measures.