Universal Transformers Need Memory

Summary

Universal Transformers Need Memory tracks the study of memory tokens and ACT behavior in Universal Transformer recursive reasoning.

Role In The Wiki

Use this page as the object card for the model or method. The source page carries the evidence details, limitations, and agenda mapping.

Relation To Foundation TSFM Agenda

Use the source-level agenda mapping in universal-transformers-need-memory-2026 rather than duplicating verdict rows here. At the entity level, this page should stay as the object card; source pages carry slot-level evidence, limitations, and missing pieces.

Evidence

• Universal Transformers Need Memory: Depth-State Trade-offs in Adaptive Recursive Reasoning

Official Artifacts

• Official code: che-shr-cat/utm-jax

Related Pages

• Universal Transformer
• Hyperloop Transformers
• Hierarchical Reasoning Model
• Tiny Recursive Model
• Universal Reasoning Model
• Recurrent Memory Transformer
• Titans
• Looped Transformers And Test-Time Memory
• Efficient Recurrent Sequence Models
• Time-Series Scaling And Efficiency