Concepts

FP8

Reference entryTraining and efficiency
Reference entryFP8

FP8 refers to eight-bit floating-point formats that reduce memory and increase accelerator throughput, while requiring careful scaling to manage limited precision and range.

Where it sits