Cloud Provider Regression Test

Connectivity, chat, JSON & streaming regression tests for all enabled cloud LLM providers

sharpai Updated 3.1k repo stars

File contents

Cloud Provider Regression Test

Tests every enabled cloud provider for connectivity, chat completion, JSON output, and SSE streaming. Reads keys from ~/.aegis-ai/llm-config.json.

Standalone

node scripts/run-regression.cjs                    # all providers
node scripts/run-regression.cjs --provider glm,xai # specific
node scripts/run-regression.cjs --verbose           # full responses

Protocol

{"event":"ready","providers":8}
{"event":"test_result","suite":"GLM","test":"chat","status":"pass","timeMs":1930}
{"event":"complete","passed":14,"failed":1,"total":15,"timeMs":38000}

Tests Per Provider

Test Verifies
Chat Connectivity, auth, URL construction, param compat
JSON Structured output (JSON instruction following)
Stream SSE streaming, chunks received

Results saved to ~/.aegis-ai/regression-tests/.

sharpai/deepcamera commit fa6e006cab

Frequently asked questions

npx get-skill add sharpai/cloud-provider-regression-test