Open source

MLC LLM

Reference entryRun models locally

Reference entryMLC LLM

MLC LLM compiles and deploys language models across GPUs, CPUs, browsers and mobile devices using machine-learning compilation techniques.