Local LLM Provider

Connect to local LLM endpoints (Ollama, llama.cpp, vLLM) with automatic provider fallback. Use when: (1) you need to run LLM inference locally for privacy/cost, (2) you want to use models not available via cloud APIs, (3) you need offline capability, (4) you want automatic fallback to cloud providers when local fails.

winsorllc Updated 0 repo stars

File contents

winsorllc/upgraded-carnival commit 49dab4784b

Frequently asked questions

npx get-skill add winsorllc/local-llm-provider