Geo News
Community curated by people like you
LatestAICryptoHealthWorld AffairsUS Politics
S
00

Security Researchers Demonstrate Ease of Jailbreaking Advanced AI Models

Jul 29, 2026

The California-based AI safety nonprofit FAR.AI released a report demonstrating that frontier AI models can be easily and cheaply jailbroken using automated tools. Testing revealed SpaceXAI's Grok and Google's Gemini were highly vulnerable, costing just $58 and $278 respectively to jailbreak, while Anthropic's Claude and OpenAI's GPT remained impervious. While tech companies defend their ongoing safety investments, the findings highlight a growing push for state-level regulations in California, New York, and Illinois amid a lack of federal standards.

AI model jailbreaking demonstration

  • ▪The California-based artificial intelligence safety nonprofit FAR.AI demonstrated jailbreaks where models generated a detailed plan for launching a cyberattack on an imaginary hydroelectric dam
  • ▪The jailbreak demonstration by FAR.AI involved testing dozens of auto-generated prompts, with the artificial intelligence models rejecting many of the prompts out of hand

FAR.AI automated safety testing

  • ▪FAR.AI's automated testing tool generated prompts designed to trick artificial intelligence models into creating software exploits and chemical or biological weapon details
  • ▪FAR.AI calculated that using another artificial intelligence model to automatically generate jailbreaks cost $58 for Grok and $278 for Gemini
  • ▪The artificial intelligence safety nonprofit FAR.AI tested safety guardrails of models from Anthropic, OpenAI, Google, and SpaceXAI using auto-generated prompts

Model vulnerability comparison results

  • ▪Anthropic's Claude and Fable models, alongside OpenAI's GPT models, were impervious to the automated jailbreak attacks tested by FAR.AI
  • ▪FAR.AI's report found SpaceXAI's Grok was the most vulnerable with 448 jailbreaks, followed by Google's Gemini with 249 jailbreaks

Company safety improvement responses

  • ▪Google DeepMind's Rohin Shah stated that the FAR.AI report is not a comprehensive assessment of Gemini's safety because jailbreak severities vary
  • ▪Spokespersons from Anthropic and OpenAI stated that their companies continuously strengthen and evolve their safeguards as artificial intelligence attack techniques become more sophisticated

State AI safety regulations

  • ▪State laws in California and New York require frontier artificial intelligence developers to publish safety reports
  • ▪An upcoming Illinois law will require frontier artificial intelligence companies to have their safety practices evaluated by third-party auditors

1 source

Wired
It’s Frighteningly Easy to Jailbreak Some Frontier AI Models
View source article

Story comments

Loading comments…

Topics

AI securityPrompt securityRed teamingAI safety & social impactJailbreaking & prompt injection