🔗 Share this article

Authorities in the country have proposed strict new guidelines for AI crafted to create strong measures for children and stop AI assistants from offering advice that could potentially lead to violence.

As per the planned regulations, companies will also be required to ensure their systems do not generate output that encourages gambling.

The Initiative to Swift Adoption

This regulatory announcement comes after a notable increase in the proliferation of AI assistants being introduced across China and around the world.

Once approved, these rules will apply to artificial intelligence services functioning in China, marking a significant effort to govern the booming technology, which has faced intense scrutiny over user safety concerns recently.

Key Requirements of the Proposed Rules

The circulated draft rules encompass a number of provisions particularly focused on safeguarding children. These steps require directing AI firms to:

• Provide customised preferences.
• Set usage caps on engagement.
• Obtain consent from guardians before providing emotional companionship functions.

Additionally conversational AI firms are required to have a human assume control of any interaction involving self-injury and without delay notify the user's parent.

Developers must make sure their systems prevent the creation of content that endangers public security, undermines the country's reputation, or weakens unity.

Weighing Development and Safety

The administration said that it supports the application of AI, including to showcase local culture and create solutions for care for the senior citizens, provided that the systems are secure and trustworthy.

Stakeholder input on the proposals has been called for.

International Backdrop and Scrutiny

The impact of AI on society has faced heightened examination around the world in recent times.

The chief executive of a major AI firm remarked this year that managing how AI systems deal with discussions related to mental health crises is among the company's biggest problems.

In a notable lawsuit, a family in California filed a lawsuit an AI company, claiming that its system advised their teenage son to end his life. This lawsuit was the pioneering of its kind accusing harm.

In a related development, the same company advertised for a senior role tasked with defending against risks from AI models to psychological well-being.

"This is expected to be a demanding role, and the candidate will jump into the deep end pretty much from the start," stated the CEO.

The rapid ascent of various AI platforms, which have amassed a vast number of followers globally, underscores the critical need for such regulatory guidelines.