Text Generation Inference

Text Generation Inference (TGI) is Hugging Face's open-source toolkit for deploying and serving large language models behind an API, with batching and streaming built in.

Also known as TGI.