sharpai Cloud Provider Regression Test
Tests every enabled cloud provider for connectivity, chat completion, JSON output, and SSE streaming.
Reads keys from ~/.aegis-ai/llm-config.json.
Standalone
node scripts/run-regression.cjs # all providers
node scripts/run-regression.cjs --provider glm,xai # specific
node scripts/run-regression.cjs --verbose # full responses
Protocol
{"event":"ready","providers":8}
{"event":"test_result","suite":"GLM","test":"chat","status":"pass","timeMs":1930}
{"event":"complete","passed":14,"failed":1,"total":15,"timeMs":38000}
Tests Per Provider
| Test | Verifies |
|---|---|
| Chat | Connectivity, auth, URL construction, param compat |
| JSON | Structured output (JSON instruction following) |
| Stream | SSE streaming, chunks received |
Results saved to ~/.aegis-ai/regression-tests/.