Omlx

Use this skill when the user wants to use llm inference server with continuous batching and ssd caching for apple silicon.

javimosch Updated 57 repo stars

File contents

Omlx Plugin

LLM inference server with continuous batching and SSD caching for Apple Silicon

Commands

  • omlx _ _ — Passthrough to omlx CLI

Installation

pip install omlx

Examples

omlx --help
omlx --version

javimosch/supercli commit 1c4f88d495

Frequently asked questions

npx get-skill add javimosch/omlx