llamafile Single-File LLM Distribution and Runner by Mozilla

llamafile by Mozilla bundles open-source LLMs into a single portable executable that runs locally on macOS, Windows, Linux, and BSD with zero installation. It combines llama.cpp inference with Cosmopolitan Libc to collapse model weights, server, and runtime into one file.

agentskillexchange Updated 28 repo stars

File contents

llamafile Single-File LLM Distribution and Runner by Mozilla

llamafile by Mozilla bundles open-source LLMs into a single portable executable that runs locally on macOS, Windows, Linux, and BSD with zero installation. It combines llama.cpp inference with Cosmopolitan Libc to collapse model weights, server, and runtime into one file.

Installation

Basic usage or getting-started notes:

Source

agentskillexchange/skills/tree/main/skills/llamafile-single-file-llm-runner-mozilla commit c439074b49

Frequently asked questions

npx skillmds@latest add agentskillexchange/llamafile-single-file-llm-distribution-and-runner-by-mozilla