Lisa Nightly Improve Tests

Nightly direct-execution skill…

codyswanngt Updated

File contents

Nightly Test Quality Improvement

The caller provides:

  • Mode: "nightly" or "general"
  • Changed files (nightly mode only): list of source files changed in the last 24 hours

Nightly Mode

  1. For each changed source file, find its corresponding test file(s)
  2. Analyze those test files for: missing edge cases, weak assertions (toBeTruthy instead of specific values), missing error path coverage, tests that test implementation rather than behavior
  3. Improve the test files with the most impactful changes
  4. Run the full test suite to verify all tests pass
  5. Commit changes with conventional commit messages
  6. Create a PR with gh pr create summarizing what was improved and why

General Mode

  1. Scan the test files to find weak, brittle, or poorly-written tests
  2. Look for: missing edge cases, weak assertions (toBeTruthy instead of specific values), missing error path coverage, tests that test implementation rather than behavior
  3. Improve 3-5 test files with the most impactful changes
  4. Run the full test suite to verify all tests pass
  5. Commit changes with conventional commit messages
  6. Create a PR with gh pr create summarizing what was improved and why

codyswanngt/lisa/tree/main/plugins/lisa/.codex-plugin/skills/lisa-nightly-improve-tests commit 985defd746

Frequently asked questions

npx skillmds@latest add codyswanngt/lisa-nightly-improve-tests