Open source
bitsandbytes
Reference entrybitsandbytes
bitsandbytes is an open-source library for 8-bit and 4-bit quantization, used to load and fine-tune large models with less GPU memory.
Where it sits
bitsandbytes is an open-source library for 8-bit and 4-bit quantization, used to load and fine-tune large models with less GPU memory.