agentskillexchange Run AI browser regression checks with Playwright and multi-model verification through Passmark
Execute natural-language browser regression tests with Playwright, caching, auto-healing, and multi-model assertion verification.
Prerequisites
Node.js, Playwright, passmark package, browser test project, model provider keys or AI gateway
Installation
Use the upstream install or setup path that matches your environment:
- npm init playwright@latest passmark-project # select the default options and set language to TypeScript
- npm install passmark
- Make sure you install dotenv by running npm install dotenv.
- npx playwright test example.spec.ts --project chromium
Requirements and caveats from upstream:
- // if the gateway is authenticated) in your .env file. Cloudflare also requires
- gateway: "none", // CUA requires direct OpenAI access
Basic usage or getting-started notes:
bash
cd passmark-project
We need at least one model from Anthropic and one from Google to use Passmark's multi-model consensus features. Set the required environment variables in .env:
Extracted from upstream docs: https://raw.githubusercontent.com/bug0inc/passmark/HEAD/README.md