Alex Open Research Wiki

Tag: language-models

11 items with this tag.

  • Jun 26, 2026

    Olmo Hybrid

    • model
    • hybrid-models
    • recurrent-models
    • transformers
    • language-models
  • Jun 23, 2026

    ><former / Variable-Width Transformers

    • language-models
    • efficient-transformers
    • variable-width
    • kv-cache
  • Jun 23, 2026

    Variable-Width Transformers

    • language-models
    • efficient-transformers
    • variable-width
    • compute-allocation
    • kv-cache
    • representation-collapse
  • Jun 12, 2026

    Attention and Compression is all you need for Controllably Efficient Language Models

    • language-models
    • context-compression
    • long-context
    • efficient-transformers
    • kv-cache
  • Jun 12, 2026

    End-to-End Context Compression at Scale

    • language-models
    • context-compression
    • long-context
    • soft-tokens
    • kv-cache
    • agents
  • May 31, 2026

    Byte-Level Language Models

    • bytes
    • language-models
  • May 29, 2026

    The Dragon Hatchling: The Missing Link between the Transformer and Models of the Brain

    • sequence-models
    • state-space-models
    • fast-weights
    • recurrent-memory
    • interpretability
    • language-models
    • world-models
  • May 27, 2026

    Language Models Need Sleep

    • language-models
    • long-context
    • recurrent-depth
    • state-space-models
    • fast-weights
    • dynamic-compute
  • May 22, 2026

    Mixture-of-Depths Attention

    • transformers
    • depth-attention
    • dynamic-compute
    • efficiency
    • language-models
  • May 18, 2026

    Bolmo: Byteifying The Next Generation Of Language Models

    • bytes
    • tokenizer-transfer
    • language-models
  • May 14, 2026

    Bolmo

    • entity
    • language-models

Created with Quartz v4.5.2 © 2026