BitTokens

Summary

BitTokens is a single-token number encoding method that adds an IEEE 754 bit-vector representation to a dedicated learned number token.

Role In The Wiki

BitTokens is the bit-level counterpoint to Fourier number embeddings. It emphasizes exactness, wide numeric range, and arithmetic-friendly representation over smooth periodic scalar geometry.

Evidence