Security Researchers Demonstrate Ease of Jailbreaking Advanced AI Models

Jul 29, 2026

The California-based AI safety nonprofit FAR.AI released a report demonstrating that frontier AI models can be easily and cheaply jailbroken using automated tools. Testing revealed SpaceXAI's Grok and Google's Gemini were highly vulnerable, costing just $58 and $278 respectively to jailbreak, while Anthropic's Claude and OpenAI's GPT remained impervious. While tech companies defend their ongoing safety investments, the findings highlight a growing push for state-level regulations in California, New York, and Illinois amid a lack of federal standards.

AI model jailbreaking demonstration

▪The California-based artificial intelligence safety nonprofit FAR.AI demonstrated jailbreaks where models generated a detailed plan for launching a cyberattack on an imaginary hydroelectric dam.
▪The jailbreak demonstration by FAR.AI involved testing dozens of auto-generated prompts, with the artificial intelligence models rejecting many of the prompts out of hand.

FAR.AI automated safety testing

▪FAR.AI's automated testing tool generated prompts designed to trick artificial intelligence models into creating software exploits and chemical or biological weapon details.
▪FAR.AI calculated that using another artificial intelligence model to automatically generate jailbreaks cost $58 for Grok and $278 for Gemini.
▪The artificial intelligence safety nonprofit FAR.AI tested safety guardrails of models from Anthropic, OpenAI, Google, and SpaceXAI using auto-generated prompts.

Model vulnerability comparison results

▪Anthropic's Claude and Fable models, alongside OpenAI's GPT models, were impervious to the automated jailbreak attacks tested by FAR.AI.
▪FAR.AI's report found SpaceXAI's Grok was the most vulnerable with 448 jailbreaks, followed by Google's Gemini with 249 jailbreaks.

Company safety improvement responses

▪Google DeepMind's Rohin Shah stated that the FAR.AI report is not a comprehensive assessment of Gemini's safety because jailbreak severities vary.
▪Spokespersons from Anthropic and OpenAI stated that their companies continuously strengthen and evolve their safeguards as artificial intelligence attack techniques become more sophisticated.

State AI safety regulations

▪State laws in California and New York require frontier artificial intelligence developers to publish safety reports.
▪An upcoming Illinois law will require frontier artificial intelligence companies to have their safety practices evaluated by third-party auditors.