Concepts

Autoregressive models

3 min readintermediateUpdated 28 Sept 2026
1 · In one line

An autoregressive model factorizes a sequence probability into conditional probabilities.

1 · What it is

GPT-2 expresses a sequence probability as a product of conditional probabilities.

PixelRNN predicts image pixels sequentially along two spatial dimensions. WaveNet is fully probabilistic and autoregressive.

XLNet maximizes expected likelihood over permutations of the factorization order.

2 · Why it exists

A joint sequence can be turned into a chain of smaller prediction problems.

Ordered dependencePixelRNN predicts image pixels sequentially across two spatial dimensions.
Exact likelihoodAutoregressive language models make likelihoods and sampling straightforward to compute.
Many mediaWaveNet conditions each audio sample on the samples before it.
3 · How it works

Follow one sequence through three conditional predictions.

A sequence probability is represented as a product of conditional probabilities.
  1. 1 · orderChoose an order for the elements in the sequence.
  2. 2 · conditionModel the next element from the elements that precede it.
  3. 3 · factorWrite one conditional probability for each element in the chosen order.
  4. 4 · multiplyRepresent the joint sequence probability as the product of those conditional probabilities.

XLNet considers permutations of the factorization order.

4 · Where it's used
WhoWhat they askWhat it works with
Language-model researcher“What distribution should the decoder learn at each text position?”Conditional probabilities over the next token
Audio researcher“What should determine the next waveform sample?”The audio samples already generated
Image researcher“How can an image be treated as an ordered prediction task?”Earlier pixels in the chosen scan order
Evaluation engineer“What probability does the model assign to this observed sequence?”The product of its conditional probabilities
5 · What it solves, and what it doesn't
solves
  • A joint sequence probability can be factorized into conditional probabilities.
  • PixelRNN applies sequential prediction to image pixels.
  • Autoregressive language models support direct likelihood calculation and sampling.
doesn't solve
  • GPT-3 samples can lose coherence over sufficiently long passages.
6 · Go deeper

Sources used

This explainer is written in original language. The links below support its factual claims.

  1. paperLanguage Models are Unsupervised Multitask Learners, OpenAI · read 28 Sept 2026
  2. paperPixel Recurrent Neural Networks, van den Oord, Kalchbrenner and Kavukcuoglu · read 28 Sept 2026
  3. paperWaveNet: A Generative Model for Raw Audio, van den Oord and colleagues · read 28 Sept 2026
  4. paperLanguage Models are Few-Shot Learners, Brown and colleagues · read 28 Sept 2026
  5. paperXLNet: Generalized Autoregressive Pretraining for Language Understanding, Yang and colleagues · read 28 Sept 2026