Concepts

Frequency and presence penalties

Reference entryInference and serving
Reference entryFrequency and presence penalties

Frequency and presence penalties are generation settings that make a model less likely to repeat tokens it has already used.

Where it sits