Universal Transformer

Summary

Universal Transformer tracks the root object for recurrent-depth Transformer architectures that repeatedly apply shared Transformer parameters to refine token states.

Role In The Wiki

Use this page as the object card for the model or method. The source page carries the evidence details, limitations, and agenda mapping.

Relation To Foundation TSFM Agenda

Use the source-level agenda mapping in universal-transformers-2018 rather than duplicating verdict rows here. At the entity level, this page should stay as the object card; source pages carry slot-level evidence, limitations, and missing pieces.

Evidence

• Universal Transformers

Official Artifacts

• Official code: tensorflow/tensor2tensor

Related Pages

• Looped Transformers And Test-Time Memory
• Efficient Recurrent Sequence Models
• Time-Series Scaling And Efficiency
• Universal Transformers Need Memory
• Recurrent Memory Transformer
• Titans