Alex Open Research Wiki

Tag: linear-attention

6 items with this tag.

  • Jun 30, 2026

    Gated DeltaNet-2

    • entity
    • linear-attention
    • recurrent-state
    • state-space-models
    • long-context
  • Jun 30, 2026

    Gated DeltaNet

    • entity
    • linear-attention
    • recurrent-state
    • state-space-models
    • long-context
    • hybrid-models
  • Jun 30, 2026

    Gated DeltaNet-2: Decoupling Erase and Write in Linear Attention

    • linear-attention
    • recurrent-state
    • state-space-models
    • long-context
    • inference-efficiency
  • Jun 30, 2026

    Gated Delta Networks: Improving Mamba2 with Delta Rule

    • linear-attention
    • recurrent-state
    • state-space-models
    • long-context
    • inference-efficiency
    • hybrid-models
  • Jun 19, 2026

    LT2

    • entity
    • looped-transformers
    • linear-attention
    • sparse-attention
    • long-context
  • Jun 19, 2026

    LT2: Linear-Time Looped Transformers

    • looped-transformers
    • linear-attention
    • sparse-attention
    • long-context
    • parameter-efficiency

Created with Quartz v4.5.2 © 2026