AI Race Intensifies as Scientists Warn of Unsafe Development Pacing

Less than two weeks remain before President Donald Trump welcomes Chinese President Xi Jinping to Washington for talks set for September 24. Artificial intelligence will take center stage in the discussions, and Trump insists America must keep its lead over China. Yet this rivalry has gained a darker edge. Some of the scientists building these systems now say they are moving faster than humanity can safely manage them.

Jacob Coxon, a researcher who held posts at both OpenAI and Anthropic, quit his job at Anthropic last week to issue a stark warning. He told WIRED that the fierce competition among top labs is pushing forward ever more powerful models before researchers figure out how to keep them under reliable human control. Colleagues describe the next year or two as "crunch time for humanity."

Days later, Anthropic CEO Dario Amodei pushed further with an essay titled "We Must Pace the Frontier." He argued that the industry needs to deliberately slow down its improvement of AI model capabilities so safety measures can catch up. "We must slow the pace at which we improve the capabilities of AI models," Amodei wrote in his piece. He proposed embedding independent evaluators inside frontier labs, coordinating safety standards among democratic nations, and eventually creating international arrangements for the most dangerous capabilities. He did not call for stopping AI development entirely.

What started as a warning from Anthropic quickly turned into a rare agreement between rivals. OpenAI's Sam Altman backed Amodei's push for independent evaluators. Elon Musk replied simply, "Dario is right." Google DeepMind's Demis Hassabis supported the same direction, while Microsoft CEO Satya Nadella warned that superintelligence which does not help humanity or stays out of human control is not worth pursuing.

None of this proves AI will destroy us tomorrow, and some alarm deserves skepticism. Anthropic is reportedly preparing an initial public offering that could value the company at nearly $2 trillion. That raises a fair question: Is part of this rhetoric also advertising the extraordinary power and potential financial value of its technology? Nvidia CEO Jensen Huang has accused parts of the industry of stoking cybersecurity fears while they prepare products to address them. The incentives deserve close scrutiny. But Altman's decision to delay OpenAI's IPO until 2027 due to safety concerns cuts against the claim that this is merely financial theater.

The first question of the AI Cold War was who would build the most powerful systems. The harder question is whether either side can remain in control of what it builds. But America cannot look at these warnings in a vacuum. China changes the calculation entirely. In earlier Fox News columns, I have warned against regulating America into technological defeat by copying Beijing's surveillance model or treating this as merely a race between chatbots. As I argue in my book, "The New AI Cold War," the competition spans chips, energy, data centers, cyber operations, military power, scientific discovery and global influence.

Treasury Secretary Scott Bessent captured the strategic bind bluntly: "We can't pause. You can't, because the Chinese won't pause." Trump has now stated this competing imperative just as plainly. Asked Sunday whether AI development should slow, Trump dismissed the warnings as exaggerated, saying unnamed critics were hyping things that won't happen. "We're leading China in AI," he said. "Whoever wins AI wins." He said Washington could still add guardrails.

Bessent's concern is understandable; the administration is pursuing both speed and safeguards at the same time. Trump's Genesis Mission links federal scientific data and supercomputing to AI research across more than 15 agencies. The world watches closely as these decisions shape our future.

His June national security directive pushes for faster artificial intelligence adoption while demanding that systems stay "robust, steerable, controllable" and answerable to humans. A separate executive order sets up voluntary pre-release cybersecurity checks for federal evaluation of frontier models before they hit the public.

Congress still has no comprehensive law on the books, yet the fight over how to handle this technology is becoming stark. House Speaker Mike Johnson, R-La., knocked down an emergency moratorium proposal. He warned that if legislators rush into regulation, China will close the gap and surge ahead. Former White House AI advisor David Sacks pushed a sharper free-market angle: labs wanting to slow down can do so on their own. They should not use Washington to force smaller rivals to put on the same brakes.

Representative Ted Lieu argues that AI is already too powerful. He says we need a kill switch before disaster strikes. Other lawmakers are floating ideas ranging from bans on superintelligence to narrower rules requiring developers to test and disclose catastrophic risks. The federal government broadly agrees something consequential is happening. It does not agree on what to do about it.

Then there is China. On Sept. 8, U.S. cyber and law enforcement officials accused Chinese AI companies, including DeepSeek, Moonshot AI, and Alibaba, of distilling American AI technology "at an industrial scale." Beijing rejected the accusations and called distillation a common industry technique. That dispute exposes the danger of unilateral American restraint. Washington can regulate its own laboratories, but it cannot order Beijing to accept identical limits.

Beijing made that point explicit this week. Responding Monday to Amodei's proposal, China's Foreign Ministry denounced what it called fearmongering and warned that confrontation would disrupt global AI governance. The United States wants China to cooperate on slowing the most dangerous capabilities while restricting access to chips and model capabilities that could close the gap.

Amodei himself recognizes this: Slowing democratic AI development beyond the American lead could let Chinese Communist Party-linked projects move ahead and create new dangers. Yet an unrestricted race creates a different danger. Every laboratory races because its rivals race. Every nation accelerates because it fears falling behind. That is the classic security dilemma I have warned about in "The New AI Cold War." Actions one side takes to increase its security can drive the other side to accelerate, leaving both less secure.

The Sept. 24 summit arrives at that moment. Reuters reported preparations for U.S.-China AI safety discussions covering AI-directed cyberattacks and incident information-sharing, though the White House said no separate meeting had been formally scheduled. The choices range from racing ahead to stopping outright. Between them lie more practical options: safety requirements triggered by dangerous capabilities, independent evaluations, and narrow agreements governing catastrophic uses.

And any agreement faces a brutal problem: verification. Nuclear arms control dealt with warheads, missiles, and enrichment plants that leave physical signatures. Frontier AI resides largely in software, model weights, and computing infrastructure. Amodei acknowledges that limited agreements on clearly dangerous applications may be more realistic than a comprehensive pause, while more ambitious restrictions become progressively harder to verify.

That is the defining paradox of the new AI Cold War. America cannot afford to let China dominate artificial intelligence, but competition does not make technological risk disappear. Trump says whoever wins AI wins.

Industry titans like Sam Altman, Elon Musk, and Gabriel La Spina Amodei are sounding the alarm. They warn that crossing the finish line means nothing if you cannot steer the engine once it runs hot. Beijing takes a different stance entirely. It claims to want AI cooperation but rejects any American plan aimed at keeping U.S. tech dominance intact.

This puts Donald Trump and Xi Jinping in a tougher spot than just racing for first place. The initial Cold War debate was simple: who builds the most powerful machine? Now the real fight is about control. Can either side keep its creations in check? When Xi arrives in Washington on September 24, this shifts from an engineering challenge to a core national strategy issue.