May 24, 2026
NVIDIA Releases Gated DeltaNet-2 Linear Attention Architecture
NVIDIA AI released Gated DeltaNet-2, a linear attention layer that decouples erase and write operations in the delta rule, addressing memory editing challenges in fixed-size recurrent states without scrambling existing associations.
1 source
00