Omlx Plugin
LLM inference server with continuous batching and SSD caching for Apple Silicon
Commands
omlx _ _— Passthrough to omlx CLI
Installation
pip install omlx
Examples
omlx --help
omlx --version
Use this skill when the user wants to use llm inference server with continuous batching and ssd caching for apple silicon.
npx skillmds@latest add javimosch/omlx LLM inference server with continuous batching and SSD caching for Apple Silicon
omlx _ _ — Passthrough to omlx CLIpip install omlx
omlx --help
omlx --version
javimosch/supercli/tree/main/plugins/omlx/skills/quickstart commit 1c4f88d495