Concepts
Model parallelism
Reference entryModel parallelism
Model parallelism divides a model's computation or parameters across multiple devices when one device cannot efficiently hold or run it.
Where it sits
Model parallelism divides a model's computation or parameters across multiple devices when one device cannot efficiently hold or run it.