Omlx

Use this skill when the user wants to use llm inference server with continuous batching and ssd caching for apple silicon.

javimosch 1c4f88d 404 B Updated

File contents

Omlx Plugin

LLM inference server with continuous batching and SSD caching for Apple Silicon

Commands

  • omlx _ _ — Passthrough to omlx CLI

Installation

pip install omlx

Examples

omlx --help
omlx --version

javimosch/supercli/tree/main/plugins/omlx/skills/quickstart commit 1c4f88d495

Frequently asked questions

npx skillmds@latest add javimosch/omlx