# Infra Advisor

> Audit the local cluster's hardware/software/MCP setup and recommend changes that cut token cost — GPU upgrades, Hailo NPU for vision, moving the inference node to Linux, running Qdrant locally, wiring MCP — with an ASCII cluster diagram. Also provides an auto one-pass audit (directives + infra + code duplication + skills) on the project. Use when the user asks how to reduce token/usage cost via hardware/infra, wants cluster setup tips, an ASCII diagram of their setup, or a quick all-in-one audit.

- Skill: `zedarvates/infra-advisor` (Agent Skill, multi-file: 7 files)
- Install (CLI): `npx skillmds@latest add zedarvates/infra-advisor`
- Raw SKILL.md: https://api.skillmd.com/api/skills/zedarvates/infra-advisor/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: DevOps & Infra
- Author: zedarvates (https://skillmd.com/u/zedarvates)
- Updated: 2026-09-17
- Page: https://skillmd.com/skills/zedarvates/infra-advisor

---


# infra_advisor — cut token cost beyond the code

Most audits only look at code. This looks at the **machine and the local cluster**
and recommends concrete hardware/software/infra changes that move work off paid
cloud models — then bundles a fast one-pass audit of the project.

## Commands

```bash
# Cluster tips + ASCII diagram
python -m skills.infra_advisor.cli tips
python -m skills.infra_advisor.cli tips --subnet --json

# One-pass audit on the project where Botte Secrète is installed
python -m skills.infra_advisor.cli auto .
python -m skills.infra_advisor.cli auto /path/to/project --json
```

## Infra tips (rules, prioritized P0→P3)

- **Install a local LLM** (LM Studio/Ollama) if none — the foundation for any saving.
- **Add/upgrade a GPU** (≥12-16 GB VRAM) → run a 7-14B coder locally.
- **Add a Hailo-8 / 8L / 10 NPU** → vision (detection/OCR/PDF) at ~0 tokens via `media_loader`.
- **Move the always-on inference node to Linux/WSL2** → no forced Windows reboots/updates
  killing the endpoint; more free VRAM/RAM.
- **Run Qdrant locally** → unlock the semantic response cache (-60% repeats).
- **Dedicate the strongest host** as a shared inference node for all projects.
- **Wire the MCP server** (`bootstrap`) so the agent actually uses the local tools.

Each tip carries `why` and an `impact` (expected token/cost effect). An ASCII
cluster diagram is rendered by default (`--json` for machine-readable).

## Auto audit

`auto` combines the cheap, reliable passes into one report:
**directives** health (`directives_audit`) · **infra** tips + diagram · **duplicate
function bodies** across files (stdlib AST, free) · **skill catalog** size · plus
pointers to deeper passes (full `mousquetaires`/fallow pipeline, `skill_project_optimizer`,
`understand-anything`, `botte` terminal compression).

Exposed via [[llm_mcp]] as `infra_tips` and `auto_audit`. Related: [[bootstrap]],
[[llm_backends]], [[directives_audit]], [[skill_finder]].