# Verify CLI

> Run smoke tests against the mpak CLI to verify all commands work correctly before publishing a new release.

- Skill: `nimblebraininc/verify-cli` (Agent Skill)
- Install (CLI): `npx skillmds@latest add nimblebraininc/verify-cli`
- Raw SKILL.md: https://api.skillmd.com/api/skills/nimblebraininc/verify-cli/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Coding & Dev Tools
- Author: NimbleBrainInc (https://skillmd.com/u/nimblebraininc)
- Updated: 2026-09-17
- Page: https://skillmd.com/skills/nimblebraininc/verify-cli

---


# Verify CLI

Run a comprehensive set of smoke tests against the mpak CLI to catch regressions before publishing. This skill builds the CLI, then exercises every command category against the live production registry.

## Prerequisites

Before running tests, ensure the working directory is the mpak monorepo root (`apps/mpak`). Build the CLI and SDK fresh:

```
pnpm --filter @nimblebrain/mpak-sdk build && pnpm --filter @nimblebrain/mpak build
```

All test commands below should be run from `packages/cli/` using `node dist/index.js`.

## Test Procedure

Run each test group below. For every command:
1. Execute the command
2. Verify the exit code is 0 (unless testing error cases)
3. Verify the output matches the expected pattern described
4. Record PASS or FAIL with details

If any test fails, stop and report the failure with full output before continuing.

### 1. Version and Help

| # | Command | Expected |
|---|---------|----------|
| 1.1 | `node dist/index.js --version` | Prints a valid semver version (not "unknown") |
| 1.2 | `node dist/index.js --help` | Shows usage with commands: search, run, bundle, config, completion |
| 1.3 | `node dist/index.js bundle --help` | Shows subcommands: search, show, pull, run |

### 2. Search

| # | Command | Expected |
|---|---------|----------|
| 2.1 | `node dist/index.js search "mcp"` | Prints "Found N result(s)" and a "Bundles (N):" section with a single table |
| 2.2 | `node dist/index.js search "mcp" --json` | Valid JSON with a `results` array and a `totals` object (`{ "bundles": N }`) |
| 2.3 | `node dist/index.js search "mcp" --limit 2` | Shows at most 2 results |
| 2.4 | `node dist/index.js search "xyznonexistent999"` | Prints "No results found" message |

Verify that the Bundles table has columns: NAME, VERSION, TRUST, DESCRIPTION.

### 3. Bundle Commands

Use `@nimblebraininc/echo` as the test bundle (known to exist with trust level L0).

| # | Command | Expected |
|---|---------|----------|
| 3.1 | `node dist/index.js bundle search "echo"` | Returns at least 1 result including `@nimblebraininc/echo` |
| 3.2 | `node dist/index.js bundle show @nimblebraininc/echo` | Shows name, version, type, trust level (L0), provenance, statistics, versions, platforms |
| 3.3 | `node dist/index.js bundle show @nimblebraininc/echo --json` | Valid JSON with `name`, `latest_version`, `certification_level` fields |
| 3.4 | `node dist/index.js bundle pull @nimblebraininc/echo -o /tmp/mpak-test-echo.mcpb` | Downloads file to /tmp/mpak-test-echo.mcpb, file exists and is non-empty |
| 3.5 | `node dist/index.js bundle show @nimblebraininc/doesnotexist` | Exits with error containing "not found" (case-insensitive) |

After test 3.4, clean up: `rm -f /tmp/mpak-test-echo.mcpb`

### 4. Config Commands

These test the local config manager at `~/.mpak/config.json`.

| # | Command | Expected |
|---|---------|----------|
| 4.1 | `node dist/index.js config set @test/smoke-test smoke_key=smoke_value` | Succeeds with confirmation message |
| 4.2 | `node dist/index.js config get @test/smoke-test` | Shows `smoke_key` with masked value |
| 4.3 | `node dist/index.js config get @test/smoke-test --json` | Valid JSON containing `smoke_key` |
| 4.4 | `node dist/index.js config list` | Lists `@test/smoke-test` in output |
| 4.5 | `node dist/index.js config clear @test/smoke-test smoke_key` | Succeeds with confirmation |
| 4.6 | `node dist/index.js config clear @test/smoke-test` | Succeeds, clears entire package config |
| 4.7 | `node dist/index.js config get @test/smoke-test` | Shows no configuration or empty result |

### 5. Error Handling

| # | Command | Expected |
|---|---------|----------|
| 5.1 | `node dist/index.js search` | Exits with non-zero code, shows error or help about missing argument |
| 5.2 | `node dist/index.js bundle invalid` | Shows help or error about unknown command |

## Reporting

After all tests complete, print a summary table:

```
## CLI Smoke Test Results

| Group              | Passed | Failed | Total |
|--------------------|--------|--------|-------|
| Version & Help     | N      | N      | 3     |
| Search             | N      | N      | 4     |
| Bundle Commands    | N      | N      | 5     |
| Config Commands    | N      | N      | 7     |
| Error Handling     | N      | N      | 2     |
|--------------------|--------|--------|-------|
| TOTAL              | N      | N      | 21    |

Overall: PASS / FAIL
```

If any test failed, list each failure with its test number, command, expected result, and actual output.

The CLI is ready to publish only if all 21 tests pass.