China faces a growing challenge as artificial intelligence-generated videos spread misinformation during natural disasters, complicating emergency responses and fueling public anxiety. As Typhoon Noul made landfall over the weekend, authorities are grappling with the threat of AI-produced content that distorts reality and undermines efforts to manage the crisis. These videos, often featuring fabricated scenes of devastation, have circulated widely on social media, prompting concerns among officials and experts alike. Fake videos depicting dead bodies floating in floodwaters, exaggerated portrayals of flooding in unaffected regions, and misleading accounts of emergency response efforts have flooded online platforms. In some cases, these videos have led to panic buying of emergency supplies due to false claims about power outages. Other instances involve the manipulation of real events, such as the release of snakes from a breeding farm in Hengzhou, Guangxi, in early July, by creating false imagery of crocodiles escaping into rivers. Such content exacerbates the chaos of mass evacuations and rescue operations, making it harder for authorities to maintain order and trust. Authorities are increasingly aware of the risks posed by AI tools that allow individuals to generate convincing yet entirely false content with minimal effort. According to Huang Zhihua, deputy chief of the Zhejiang Police Department’s online public security unit, many content creators exploit disaster news to attract followers, leveraging sensationalism for increased engagement. He noted that these individuals deliberately fabricate information to draw attention, often without regard for the potential harm their actions may cause. Recent enforcement actions have targeted those responsible for producing and distributing such content, with penalties ranging from detention pending criminal charges to financial fines. Despite these measures, experts warn that the scale and speed of AI-driven misinformation could soon reach unprecedented levels. Professor Chen Bin, from the Central Party School of the Communist Party, emphasized that AI significantly reduces the technical barriers to generating false information, enabling even non-experts to produce high-quality, realistic content with ease. This capability, he argued, poses a serious threat to public safety and trust. Motivations behind the creation of such content vary, according to Professor Gao Fuping of the East China University of Political Science and Law. Some individuals engage in these activities for amusement, while others seek to generate traffic for personal gain or intentionally incite panic or social unrest. He pointed out that many users believe the anonymity and lack of regulation in the online space make them immune to consequences, further encouraging the proliferation of harmful content. To combat this issue, Professor Xu Xiaoke from Beijing Normal University suggested that verifying the geographical context and timestamps of AI-generated content could help distinguish genuine information from falsehoods. However, he cautioned that current detection technologies lag behind the capabilities of AI generation, resulting in an ongoing struggle between the two. This imbalance means that technological solutions alone may not be sufficient to address the problem effectively. Meanwhile, the Chinese government continues to invest heavily in AI, positioning itself as a global leader in the field. Since 2017, when it declared AI as a key driver of national progress, substantial funding has flowed into AI-related industries, fostering intense domestic competition. With over 6,000 AI firms operating within the country, the government has prioritized innovation and control, aiming to harness AI for both economic growth and strategic advantage. Yet, this rapid expansion raises questions about how best to balance technological advancement with public safety and ethical responsibility.
★
Keep the news honest.
ObjectiveNews is reader-funded and ad-free — we show you the bias instead of hiding it. Support independent journalism for €4/month.
Become a Supporter