Community curated by people like you

Allen Institute for AI stories

Oct 2, 2026

Ai2 releases OlmoCore 3 training framework for mixture-of-experts models

Allen Institute for AI released OlmoCore 3, an open development framework for large mixture-of-experts language models that delivers 2.7x throughput gains.

Oct 2, 2026·2 sources

00

Top claims

▪Publicly documenting unresolved training failures is necessary for scientific progress in AI
▪OlmoCore 3 reached a peak throughput of 858 TFLOPS per GPU during a 1.2-trillion-parameter configuration benchmark using 512 NVIDIA B300 GPUs under artificial random routing
▪The Allen Institute for AI documented 'token gerrymandering,' a failure mode where the auxiliary loss metric for routing balance improves while the actual distribution of work across experts degrades

Subtopics

AI foundation models1 Compute, chips & AI infrastructure1 Mixture of experts (MoE)1 Open model deployment tools1 Open-source AI1

Related timelines

Iran War

Russia-Ukraine war

AI Data Center Gold Rush

Congress

Crypto hacks