LLM Backends

Discover, audit and use local LLM servers, or configure portable task-specific inference profiles for a user's machines and existing memory. Use for local models, LM Studio, Ollama, hardware-aware setup, local inference benchmarks or native speculative profiles. Not for training draft models or treating two chat APIs as speculative decoding.

zedarvates Updated 2 repo stars
Botte Secrète

File contents

zedarvates/botte-secrete commit 05f18d361c

Frequently asked questions

npx get-skill add zedarvates/llm-backends