FoNE
Summary
FoNE is a Fourier Number Embedding method that represents a number as a single token using digit-aligned sine/cosine components.
Role In The Wiki
FoNE anchors the Fourier-feature route for scalar numeric embeddings. It is especially relevant when comparing smooth periodic number representations with bit-level and point-wise time-series value embeddings.
Evidence
- FoNE: Precise Single-Token Number Embeddings Via Fourier Features
- Pre-trained Large Language Models Use Fourier Features To Compute Addition