Top figures in artificial intelligence are raising alarms about existential risks and rising costs as Chinese AI models increasingly challenge U.S. technology firms. The growing competition is reshaping debates over performance, infrastructure spending, regulation, and the future of AI development.
Growing AI Safety Concerns
The latest wave of warnings began on September 8 when former Anthropic researcher Jacob Coxon posted on X that developers genuinely believe AI could destroy humanity by the end of the decade. His post garnered 173 million views, amplifying concerns about AI safety.
On September 12, Anthropic CEO Dario Amodei published an essay calling for greater restraint in AI development. OpenAI CEO Sam Altman and SpaceX founder Elon Musk also urged slower development or stronger government oversight.
Trillion-Dollar AI Investment Under Pressure
Financial pressures are mounting. Morgan Stanley estimates that U.S. hyperscalers, along with NVIDIA and Broadcom, hold more than $3 trillion in off-balance-sheet liabilities and guarantees. U.S. hyperscalers are expected to invest up to $1.5 trillion in AI next year. Oxford Economics’ Ryan Sweet noted that while building AI is expensive, it could still prove worthwhile.
However, Apollo Global Management’s Torsten Slok warns that hyperscalers’ operating cash flow must rise from $600 billion last year to $2 trillion by 2030 to support those investments.
Chinese AI Models Add Competitive Pressure
The economics of AI are shifting. One of Chinese startup DeepSeek’s flagship models may cost over 100 times less to operate than Anthropic’s Claude Fable 5. Other Chinese products can cost up to 50 times less than leading American alternatives. Meanwhile, the performance gap between Chinese and expensive American systems is narrowing, making it harder for U.S. companies to justify rising infrastructure spending.
Regulation Debate Continues
Investors remain divided on whether massive AI investments will yield returns. The Nasdaq’s recent record high suggests confidence, but skeptics question the economics. Investor Steve Eisman argues that AI companies could use risk concerns to push for regulation that creates barriers for competitors.
U.S. Treasury Secretary Scott Bessent announced that Washington and Beijing have agreed to establish an official AI dialogue, with senior officials expected to meet in China by year-end. The debate now extends beyond safety to whether the U.S. can maintain its technological lead against cheaper, capable Chinese AI systems.