Masked language modeling

Masked language modeling trains a model to guess words hidden in a sentence from the words around them; it is the training task used by BERT.

Also known as MLM.