Open source

DeepSpeed

Reference entryML libraries
Reference entryDeepSpeed

DeepSpeed is Microsoft's open-source library for training and running very large models across many GPUs, known for its ZeRO memory-saving technique.

Also known as ZeRO.

Where it sits