China's AI Risks Prompt National Security Concerns
While AI researchers in the United States express concerns about the potential for superintelligence to threaten humanity, Chinese policymakers have historically focused on more immediate risks such as deepfakes and child safety. However, the alarming capabilities of advanced AI models are prompting a shift in perspective, with the head of China's spy agency warning that these technologies could pose significant national security threats.
Recent revelations about the vulnerability of China's mega-app WeChat have underscored these concerns. A small team of programmers in California demonstrated how AI could be used to create a cyberattack worm capable of compromising millions of WeChat accounts. Kevin Xu, founder of the U.S.-based technology hedge fund Interconnected Capital, noted that there are more similarities than differences in AI safety issues between China and the United States. He pointed out that while these issues may not gain public attention in China, they remain a top concern for the Chinese government.
The cybersecurity implications of AI agents operating without human oversight rank high on the list of worries for Chinese authorities. As the topic gains global attention, there is increasing pressure on leaders like President Xi Jinping and U.S. President Donald Trump to address AI-related threats during their upcoming discussions, despite their competitive relationship in the field.
Experts believe that both nations are developing a more realistic understanding of these risks, which may create a sense of urgency to collaborate on safety evaluations for AI models. However, the fierce competition between the two powers could hinder such cooperation. Trump has expressed a desire to maintain U.S. leadership in AI, while concerns persist in China that national security may be used as a pretext to limit its technological development.
Global Reactions to AI Safety Concerns
A stark warning about the existential threat posed by self-improving AI systems was recently issued by a researcher who resigned from the U.S. startup Anthropic, fueling a global debate on how to govern this technology. China is already taking steps to regulate AI use, including prohibiting the creation of AI-generated avatars without consent.
Chinese AI policy tends to focus on current, tangible harms to society, viewing AI as a general-purpose technology akin to electricity or automobiles—beneficial yet manageable through regulation. Brian Tse, CEO of the Beijing-based consultancy Concordia AI, noted that recent advancements in AI capabilities and high-profile incidents have elevated the technology's priority on the government's agenda.
Approved for Dissemination
On the streets of Shanghai, public sentiment reflects a mix of concern and pragmatism regarding AI. Some residents view the recent cyberattack worm incident as an opportunity to identify vulnerabilities and improve cybersecurity measures. There is also widespread support for stringent regulations, with many believing that businesses would not impose necessary restrictions on themselves.
As concerns grow about the potential for advanced AI models to crack complex passwords, experts warn that both China and the U.S. could find themselves vulnerable if critical security codes are compromised. The ongoing discussions about AI's future are set to dominate international talks, highlighting the urgent need for a coordinated approach to address the technology's potential dangers.