Geo News
Community curated by people like you
LatestAICryptoHealthWorld AffairsUS Politics

Web search stories

Oct 30, 2026

Google, Anthropic, Microsoft and OpenAI back new AI crawling opt-out standard

Major AI companies announced plans to support an upcoming standard that will allow websites to apply their AI training preferences across multiple AI companies, instead of setting them individually.

Oct 30, 2026·2 sources
00

Top claims

  • ▪Website operators historically used text files titled robots.txt to manage how search engine web crawlers interact with web properties
  • ▪OpenAI plans to offer granular controls enabling web publishers to opt out of artificial intelligence grounding requests
  • ▪The robots.txt AI crawling setting proposed by Kevin Kelley of Anthropic will not apply to artificial intelligence models that perform exclusively non-generative tasks

People involved

Kevin Kelly

Subtopics

AI and copyright1AI governance1AI Industry1AI training data1Generative AI1

Related timelines

Crypto hacks

100 stories

Iran War

209 stories

Russia-Ukraine war

136 stories

Trump administration

161 stories

AI Data Center Gold Rush

111 stories