# Cloud Provider Regression Test

> Connectivity, chat, JSON & streaming regression tests for all enabled cloud LLM providers

- Skill: `sharpai/cloud-provider-regression-test` (Agent Skill, multi-file: 3 files)
- Install (CLI): `npx skillmds@latest add sharpai/cloud-provider-regression-test`
- Raw SKILL.md: https://api.skillmd.com/api/skills/sharpai/cloud-provider-regression-test/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: DevOps & Infra
- Author: sharpai (https://skillmd.com/u/sharpai)
- Updated: 2026-09-17
- Page: https://skillmd.com/skills/sharpai/cloud-provider-regression-test

---


# Cloud Provider Regression Test

Tests every enabled cloud provider for connectivity, chat completion, JSON output, and SSE streaming.
Reads keys from `~/.aegis-ai/llm-config.json`.

## Standalone

```bash
node scripts/run-regression.cjs                    # all providers
node scripts/run-regression.cjs --provider glm,xai # specific
node scripts/run-regression.cjs --verbose           # full responses
```

## Protocol

```jsonl
{"event":"ready","providers":8}
{"event":"test_result","suite":"GLM","test":"chat","status":"pass","timeMs":1930}
{"event":"complete","passed":14,"failed":1,"total":15,"timeMs":38000}
```

## Tests Per Provider

| Test | Verifies |
|------|----------|
| Chat | Connectivity, auth, URL construction, param compat |
| JSON | Structured output (JSON instruction following) |
| Stream | SSE streaming, chunks received |

Results saved to `~/.aegis-ai/regression-tests/`.