How do I install the Local LLM Ops skill?

Run npx skillmds@latest add tomevault-io/local-llm-ops in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.

Is Local LLM Ops safe to use?

This skill has not completed SkillMD's automated safety review yet. Independent scanners report: SkillSpector: CAUTION, Skill Scanner: PASS. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.

Which AI agents work with Local LLM Ops?

This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.

Is Local LLM Ops free to use?

Yes. Installing skills from SkillMD is free, and the skill stays under its author's original license.

Who published Local LLM Ops?

tomevault-io (@tomevault-io) published this skill. Their other Agent Skills are listed on their SkillMD profile.

Local LLM Ops by tomevault-io — Agent Skill

Name: Local LLM Ops
Author: tomevault-io

File contents

Local LLM Ops (Ollama)

Overview

Your localLLM repo provides a full local LLM toolchain on Apple Silicon: setup scripts, a rich CLI chat launcher, benchmarks, and diagnostics. The operational path is: install Ollama, ensure the service is running, initialize the venv, pull models, then launch chat or benchmarks.

Quick Start

./setup_chatbot.sh
./chatllm

If no models are present:

ollama pull mistral

Setup Checklist

Install Ollama: brew install ollama
Start the service: brew services start ollama
Run setup: ./setup_chatbot.sh
Verify service: curl http://localhost:11434/api/version

Chat Launchers

./chatllm (primary launcher)
./chat or ./chat.py (alternate launchers)
Aliases: ./install_aliases.sh then llm, llm-code, llm-fast

Task modes:

./chat -t coding -m codellama:70b
./chat -t creative -m llama3.1:70b
./chat -t analytical

Benchmark Workflow

Benchmarks are scripted in scripts/run_benchmarks.sh:

./scripts/run_benchmarks.sh

This runs bench_ollama.py with:

benchmarks/prompts.yaml
benchmarks/models.yaml
Multiple runs and max token limits

Diagnostics

Run the built-in diagnostic script when setup fails:

./diagnose.sh

Common fixes:

Re-run ./setup_chatbot.sh
Ensure ollama is in PATH
Pull at least one model: ollama pull mistral

Operational Notes

Virtualenv lives in .venv
Chat configs and sessions live under ~/.localllm/
Ollama API runs at http://localhost:11434

Related Skills

toolchains/universal/infrastructure/docker

Converted and distributed by TomeVault — claim your Tome and manage your conversions.

---name: local-llm-opsdescription: Local LLM operations with Ollama on Apple Silicon, including setup, model pulls, chat launchers, benchmarks, and diagnostics. Use when this capability is needed.---# Local LLM Ops (Ollama)## OverviewYour `localLLM` repo provides a full local LLM toolchain on Apple Silicon: setup scripts, a rich CLI chat launcher, benchmarks, and diagnostics. The operational path is: install Ollama, ensure the service is running, initialize the venv, pull models, then launch chat or benchmarks.## Quick Start```bash./setup_chatbot.sh./chatllm```If no models are present:```bashollama pull mistral```## Setup Checklist1. Install Ollama: `brew install ollama`2. Start the service: `brew services start ollama`3. Run setup: `./setup_chatbot.sh`4. Verify service: `curl http://localhost:11434/api/version`## Chat Launchers- `./chatllm` (primary launcher)- `./chat` or `./chat.py` (alternate launchers)- Aliases: `./install_aliases.sh` then `llm`, `llm-code`, `llm-fast`Task modes:```bash./chat -t coding -m codellama:70b./chat -t creative -m llama3.1:70b./chat -t analytical```## Benchmark WorkflowBenchmarks are scripted in `scripts/run_benchmarks.sh`:```bash./scripts/run_benchmarks.sh```This runs `bench_ollama.py` with:- `benchmarks/prompts.yaml`- `benchmarks/models.yaml`- Multiple runs and max token limits## DiagnosticsRun the built-in diagnostic script when setup fails:```bash./diagnose.sh```Common fixes:- Re-run `./setup_chatbot.sh`- Ensure `ollama` is in PATH- Pull at least one model: `ollama pull mistral`## Operational Notes- Virtualenv lives in `.venv`- Chat configs and sessions live under `~/.localllm/`- Ollama API runs at `http://localhost:11434`## Related Skills- `toolchains/universal/infrastructure/docker`---> Converted and distributed by [TomeVault](https://tomevault.io/claim/bobmatnyc) — claim your Tome and manage your conversions.

Frequently asked questions

Local LLM Ops