Essay 02

Aliasing is everywhere

See why different continuous signals can become identical after sampling—and why ML engineers should care.

Updated 14 August 2026 · Sampling · Machine learning · Signals

Sampling does not merely make a signal discrete. It makes frequencies separated by integer multiples of the sampling rate observationally identical.

The ambiguity in the dots

For a sinusoid sampled at rate fₛ, the samples of frequencies f and f + m fₛ coincide for every integer m. Restricting a real sinusoid to the interval from zero to fₛ/2 chooses one representative from each equivalence class. That boundary is the Nyquist frequency.

f_alias = | ((f + fₛ/2) mod fₛ) − fₛ/2 |

Interactive experiment

Frequency folding

When does a sampled sinusoid become indistinguishable from a slower one?

Blue is the source, dashed amber is the apparent sinusoid, and circles are samples shared by both. The display covers two seconds.

Why folding appears

Increase a tone towards Nyquist and its samples trace a faster oscillation. Cross the boundary and the same dots can be joined by a waveform whose frequency decreases. The sampled data cannot decide which continuous path was present. Reconstruction requires an assumption that the input was band-limited before sampling.

Anti-aliasing happens before decimation

A low-pass filter removes content that the lower rate cannot represent; then decimation discards samples. Reversing those operations is too late because high and low frequencies have already become inseparable. Real filters have transition bands, so engineering a sample-rate conversion also means choosing acceptable pass-band loss and stop-band leakage.

The machine-learning connection

Image resize, temporal subsampling, pooling and strided convolution all reduce a discrete grid. If appreciable content lies above the new grid's Nyquist limits, it folds. A learned model may exploit or partially compensate for these artefacts, and nonlinearities can create new frequencies, so a neural network is not simply a textbook linear sampler. Still, inspectable low-pass filtering before stride is a useful design hypothesis—not a guarantee of better task performance.

Two dimensions complicate the picture

An image has a two-dimensional spectrum. Fine stripes can become coarse moiré patterns when pixel centres sample them; diagonal structure can fold in both axes. Camera optics, sensor pixels, demosaicing and resizing all participate in the effective prefilter. “The image resolution” is therefore not one isolated sampling event.

Practical implications