Community curated by people like you

Multilingual models stories

Oct 4, 2026

Aleph Alpha releases Kolibri 78B open-weight German-English model

Aleph Alpha released Kolibri, a 78.1B parameter mixture-of-experts model for German and English with only 3.46B active parameters, as an open-weight release.

Oct 4, 2026·2 sources

00

Top claims

▪Aleph Alpha designed the Kolibri language model for sovereign deployment in regulated sectors, specifically targeting public administration, industry, and aerospace or aviation
▪Kolibri's architecture features 50 transformer blocks with a model width of 2,560, utilizing 384 routed experts and 1 shared expert
▪Kolibri uses a hybrid attention mechanism with 40 sliding-window attention blocks and 10 full-attention blocks to keep the model's one-million-token context window computationally affordable

Subtopics

AI foundation models1 Mixture of experts (MoE)1 Open weights vs closed models1 Open-source AI1

Related timelines

AI Data Center Gold Rush

Congress

Trump administration

US midterm elections

Iran War