Open source

llamafile

Reference entryRun models locally
Reference entryllamafile

llamafile packages model weights and a portable inference runtime into executable files intended to run across common operating systems.

Where it sits