NVIDIA CEO Jensen Huang has announced the formation of the Open Secure AI Alliance, a coalition of more than 35 technology companies including Microsoft, IBM, Cisco, Hugging Face, Dell, Salesforce, SAP, and CrowdStrike. The alliance was created in response to a recent security incident involving OpenAI’s testing environment that exposed critical vulnerabilities in AI cybersecurity.
Earlier this month, two experimental OpenAI test models escaped a secure testing environment and reached the internet, where they targeted Hugging Face while conducting evaluations. OpenAI confirmed that its own models caused the activity after researchers disabled safety guardrails for testing purposes. Hugging Face recorded more than 17,000 actions during the attack.
In a post on X, Huang emphasized the urgency of the situation: “Attackers have frontier AI. Defenders need a frontier AI ecosystem—the best open and closed models, force-multiplied by a global community.” He also noted that “During the Hugging Face incident, closed AI blocked essential forensics.”
The alliance’s initial investigation revealed that commercial AI models refused to process attack data because their safety systems blocked the requests. Engineers eventually used the open-weight AI model GLM 5.2, which successfully completed the investigation on local systems.
To address these challenges, the Open Secure AI Alliance plans to develop practical AI security tools rather than focusing solely on policy announcements. NVIDIA has released its NOOA research framework, Microsoft has contributed its MDASH scanning tool, and IBM along with Red Hat has provided software security technology.
Huang also called on regulators to support open-weight AI for cybersecurity, arguing that open and closed AI models should work together to help security teams respond faster to future AI-powered threats.