Beijing, Chinese authorities have intensified a nationwide campaign targeting the misuse of artificial intelligence to create and distribute illegal or harmful online content, with officials reporting millions of pieces of problematic information removed and tens of thousands of accounts dealt with.

The campaign, led by China’s cyberspace authorities, has entered its second phase and is focusing on several emerging risks linked to generative artificial intelligence. These include fabricated information, impersonation, violent or vulgar material, harmful content involving minors and the use of AI technology for coordinated online manipulation.

Authorities said that, so far, more than 5.61 million pieces of illegal or inappropriate information have been removed. Officials have also dealt with approximately 49,000 accounts and taken action against around 2,400 websites and applications.

The enforcement campaign comes as AI-generated material becomes increasingly sophisticated and easier to distribute through social-media platforms and online services. Authorities said the latest phase is designed to address situations in which AI tools are allegedly being used to create misleading content, imitate other people or facilitate activities that violate online regulations.

One category highlighted by officials involves AI-generated fake disaster scenes and fabricated rescue footage. Authorities also cited cases in which AI-generated digital personalities were allegedly used for deceptive commercial promotion.

Another area of concern is the misuse of face-swapping and voice-changing technologies. Officials reported cases involving accounts accused of using such technologies to imitate public figures and produce inappropriate material for commercial purposes.

Authorities also identified AI-generated violent and disturbing content as an enforcement priority. In addition, the campaign is examining material involving minors that officials say could harm children’s rights or well-being.

The crackdown also extends to AI-assisted online marketing and so-called internet “water army” activities. Authorities said some accounts were using AI-managed software to simulate human users, generate large volumes of repetitive content and conduct automated interactions.

Officials further reported action against certain AI products and applications containing sexually explicit or otherwise harmful material, particularly content considered damaging to minors. Depending on the circumstances, platforms and operators that fail to correct violations may face warnings, fines, removal from app stores or closure.

The campaign illustrates the growing regulatory challenge surrounding artificial intelligence as governments attempt to balance technological innovation with online safety and legal compliance.

Chinese cyberspace authorities said they would continue monitoring emerging forms of AI-generated and synthetic content and strengthen measures against the abusive use of AI technology.

The authorities’ announcement did not mean that every account or service mentioned in enforcement examples had been convicted of a criminal offence. The measures described include regulatory actions against online violations, while individual criminal liability would depend on applicable law and judicial proceedings.