Concepts
Scaling laws
Reference entryScaling laws
Scaling laws are empirical relationships describing how model performance changes predictably with factors such as parameter count, training data, and computation.
Where it sits
Scaling laws are empirical relationships describing how model performance changes predictably with factors such as parameter count, training data, and computation.