Results for “local-llm”
55 skills
bobmatnyc Local LLM Ops
Local LLM operations with Ollama on Apple Silicon, including setup, model pulls, chat launchers, benchmarks, and diagnostics.
71 · bundle
diegosouzapw Qmd
Indexes and searches local Markdown notes and docs with BM25 keyword search, vector semantic search, and local LLM reranking, all running offline without API keys.
54 · bundle
zero-yx Kiro Local Account Importer
Imports local Kiro CLI accounts into StaticFlow/llm-access by reading SQLite auth files and calling the local admin API, with proxy assignment and validation.
0 · bundle
ziri22 Agent Ollama V2
Expert en Ollama avancé (local LLMs, models, REST API, hardware, multi-modal, DZ deployment)
6
omega-bred Asc Localize Metadata
Automates translating and syncing App Store metadata (description, keywords, what's new, subtitle) to multiple locales using LLM translation and the asc CLI.
7
openagentinternet Metabot LLM Wiki
Embedded runtime for generated local Wiki skills. It manages local registries, raw document ingestion, incremental indexes, cited queries, static wiki builds, ZIP bundles, large-file upload, and optional on-chain snapshot publication.
6 · bundle
More results
ssrjkk Ollama
Runs large language models locally with Ollama, including model management, custom Modelfiles, and API integration. Use for private, offline LLM inference.
2 · bundle
lord1egypt Qmd
Search local knowledge bases, notes, docs, and meeting transcripts with hybrid retrieval combining BM25, vector search, and LLM reranking, all running on-device.
2
k-dense-ai Autoskill
Analyze recent screen activity via a local screenpipe daemon, detect repeated research workflows, and draft new skills or composition recipes for uncovered patterns.
30.2k · bundle
orchestra-research Nemo Evaluator Sdk
Evaluates LLMs across 100+ benchmarks from 18+ harnesses (MMLU, HumanEval, GSM8K, safety, VLM) with multi-backend execution on local Docker, Slurm HPC, or cloud platforms.
10.4k · bundle
fukukei23 Proxy Doctor
glm-rate-proxy（localhost:8787・CC CLIのGLM/MiniMaxバックエンドプロキシ）の診断・修復スキル。 プロキシが止まる・エラーが出る・MiniMaxフォールバック失敗等を診断し対処法を案内（ソース自動書き換えなし・確認後実行）。 「/proxy-doctor」「プロキシ直して」「GLMが使えない」「フォールバック失敗」「LLMエラー系（CLIが動かない・4xx/429多発）」等で発火。
0
qcmuu Ollama
---
0
huggingface Huggingface Community Evals
Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware, with backend selection between vLLM, Transformers, and accelerate.
10.8k · bundle
ziri22 Agent Llama Cpp V2
Expert en inference llama.cpp avancé (GGUF, quantization, local models, HTTP server, hardware)
6
brycewang-stanford Auto Review Loop LLM
Autonomous research review loop using any OpenAI-compatible LLM API. Configure via llm-chat MCP server or environment variables. Trigger with "auto review loop llm" or "llm review".
1k
oyi77 LLM Deployment
Deploy and serve LLMs in production with vLLM, Ollama, TGI, and llama.cpp, including quantization and GPU optimization.
10
danstrem2 Qmd
Local search/indexing CLI (BM25 + vectors + rerank) with MCP mode.
2 · bundle
kbarbel640-del Qmd
Indexes local files and searches them with BM25, vector, and hybrid queries, plus MCP mode.
1 · bundle
demerzels-lab Mnemon
Provides a persistent memory CLI for LLM agents, installed via npx.
10 · bundle
orchestra-research Serving Llms Vllm
Deploy and serve LLMs with high throughput using vLLM's PagedAttention and continuous batching. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism for production inference.
10.4k · bundle
johnalbertini14-glitch Mnemon
Persistent memory CLI for LLM agents. Store facts, recall past knowledge, link related memories, manage lifecycle.
1 · bundle
qcmuu Serving Llms Vllm
Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.
0 · bundle
tianhao909 Serving Llms Vllm
Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.
1 · bundle
qcmuu Langsmith Observability
LLM observability platform for tracing, evaluation, and monitoring. Use when debugging LLM applications, evaluating model outputs against datasets, monitoring production systems, or building systematic testing pipelines for AI applications.
0 · bundle
aniruddhaadak80 Serving Llms Vllm
vLLM: high-throughput LLM serving, OpenAI API, quantization.
0 · bundle
google-gemma Gemma Trainer
Fine-tune Gemma models locally using QLoRA, Unsloth, or TRL for SFT, DPO, and reward modeling, with dataset preparation and conversion to GGUF or LiteRT-LM.
· bundle
0xharryriddle LLM Council
Orchestrate a configurable, multi-member CLI planning council (Codex, Claude Code, Gemini, OpenCode, or custom) to produce independent implementation plans, anonymize and randomize them, then judge and merge into one final plan. Use when you need a robust, bias-resistant planning workflow, structured JSON outputs, retries, and failure handling across multiple CLI agents.
3 · bundle
lucaspmarie-a11y Free LLM
Query free LLM APIs from OpenRouter, Groq, Cerebras, Google AI, and Mistral, with commands to compare models and check status.
5
q2805187159 Serving Llms Vllm
Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.
3 · bundle
yanacuti1121 Litellm
Call 100+ LLMs through a single OpenAI-compatible interface with LiteLLM — use completion/acompletion/embedding with any provider (Anthropic, OpenAI, Google, Groq, Ollama, etc.), run a proxy server for team rate-limiting and cost tracking, load-balance across providers.
2
nvidia Jetson LLM Benchmark
Benchmark Jetson LLM/VLM serving performance across vLLM, llama.cpp, and Ollama with structured JSON output.
2.2k · bundle
nvidia Jetson LLM Serve
Serve LLMs and VLMs on NVIDIA Jetson devices using vLLM or SGLang with optimized Docker containers and quantization presets.
2.2k · bundle
huggingface Huggingface Local Models
Search the Hugging Face Hub for llama.cpp-compatible GGUF models, select the right quantization, and run them locally with llama-cli or llama-server.
10.8k · bundle
antigravity Langfuse
Provides expertise in Langfuse for LLM observability, including tracing, prompt management, evaluation, and integration with LangChain, LlamaIndex, and OpenAI.
42.4k
ichichuang Serving Llms Vllm
Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.
0 · bundle
levalencia LLM CLI
Process textual and multimedia files with various LLM providers using the llm CLI. Supports both non-interactive and interactive modes with model selection, config persistence, and file input handling.
3 · bundle