Lab · representations

Position encoding matrix

Turn scalar positions into paired sine/cosine coordinates at geometric wavelengths.

Interactive experiment

A position becomes a vector

How do fast and slow sinusoidal coordinates tile position space?

Blue cells are positive and amber cells negative; opacity gives magnitude. The outlined row is shown numerically, so the matrix does not rely on colour alone.

Read the full positional-encoding essay →