Alex Open Research Wiki

Tag: attention

3 items with this tag.

  • Jun 30, 2026

    Oryx

    • entity
    • hybrid-models
    • long-context
    • recurrent-state
    • attention
    • fixed-flops
  • Jun 30, 2026

    Multi-Mixer Models: Flexible Sequence Modeling with Shared Representations

    • hybrid-models
    • long-context
    • recurrent-state
    • attention
    • inference-efficiency
    • fixed-flops
  • May 18, 2026

    WavSpA: Wavelet Space Attention for Boosting Transformers' Long Sequence Learning Ability

    • transformers
    • attention
    • wavelets
    • long-sequence-modeling

Created with Quartz v4.5.2 © 2026