How do I install the Test Maintenance skill?

Run npx skillmds@latest add katalon-labs/test-maintenance in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.

Is Test Maintenance safe to use?

This skill has not completed SkillMD's automated safety review yet. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.

Which AI agents work with Test Maintenance?

This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.

Is Test Maintenance free to use?

Yes. Installing skills from SkillMD is free, and the skill stays under its author's original license.

Who published Test Maintenance?

katalon-labs (@katalon-labs) published this skill. Their other Agent Skills are listed on their SkillMD profile.

Test Maintenance by katalon-labs — Agent Skill

Name: Test Maintenance
Author: katalon-labs

Test Maintenance

Maintain and evolve a Katalon True Platform/TestOps regression suite as the application changes. Use when you need to detect which tests broke or became flaky from stability and result history, diagnose whether a case needs repair vs regeneration, repair test assets (update, move, reorganize cases), refresh coverage after application or requirement changes, and feed the resulting gap list back into planning. Closes the lifecycle loop. For classifying a specific run's failures use analyze-failures; for authoring brand-new cases use create-test-cases. Written for the automation tester repairing a suite that has started lying, and the test lead who has to keep it trustworthy.

katalon-labs 463ba7d 2 files · 5.8 KB Updated Sep 17, 2026

File contents

Katalon Test Maintenance

Use this skill for the maintenance stage: keep the regression suite healthy over time and feed learning back to the plan. It consumes failure/stability signals and produces repairs plus a refreshed coverage gap list.

Availability Boundary

Available via MCP: change/impact signals (fetch_test_stability_data, find_test_results, read_execution), and case-level repair (update_test_case, move_test_case, duplicate_test_case).
Not directly available: Self-healing tests, Time Capsule, Studio Tracer, object refactoring, and StudioAssist Agent-mode edits are Studio-desktop features. TrueTest regeneration from live journeys is a TrueTest surface. Narrate these; MCP repairs are case-level content edits, not object/script self-healing.

Maintenance Workflow

+---------------------+     +----------------------+     +----------------------+
| Detect change impact| --> | Diagnose: repair vs  | --> | Repair case assets   |
| stability + history |     | regenerate vs retire |     | update/move/dup      |
+---------------------+     +----------------------+     +----------------------+
                                                                   |
                                                                   v
                                                         +----------------------+
                                                         | Validate + feed back |
                                                         | to plan (gap list)   |
                                                         +----------------------+

Steps and tool rules

Detect impact. fetch_test_stability_data for flakiness trend; find_test_results + read_execution for what changed across recent runs. Build the list of broken / flaky / degraded cases.
Diagnose each. Decide per case:
- Repair — the case is salvageable: fix data, steps, or expected result via update_test_case; reorganize via move_test_case; branch a variant via duplicate_test_case.
- Regenerate — behavior changed enough that the case should be re-derived (TrueTest regeneration / re-author) -> hand to create-test-cases; narrate the TrueTest boundary.
- Retire — behavior removed: unlink/retire (prefer update/flag over unreliable delete_test_case); get approval.
Repair (MCP-legal edits only). Pass all intended updates in one update_test_case call. Do not claim to have self-healed locators/objects — that is Studio.
Validate. Re-run through execute-test and confirm via find_test_results / read_execution.
Feed back. Emit the refreshed coverage gap list to test-plan so maintenance closes the loop instead of dead-ending.

Prompt recipes

Which regression cases became flaky this month, and which should we repair vs regenerate?
Repair the login suite after the new auth flow: update the affected cases and tell me what still needs re-authoring.
After this release's UI change, refresh coverage and give me the gap list for next sprint.

Hand-offs

Classify a specific failed run first -> analyze-failures.
Re-author changed behavior -> create-test-cases.
Confirm repairs -> execute-test then test-review.
Refreshed gaps -> test-plan.

Read references/maintenance-loop.md before repairing. Consult the orchestrator's references/unavailable-capabilities.md for the Studio/TrueTest boundary.

---name: test-maintenancedescription: Maintain and evolve a Katalon True Platform/TestOps regression suite as the application changes. Use when you need to detect which tests broke or became flaky from stability and result history, diagnose whether a case needs repair vs regeneration, repair test assets (update, move, reorganize cases), refresh coverage after application or requirement changes, and feed the resulting gap list back into planning. Closes the lifecycle loop. For classifying a specific run's failures use analyze-failures; for authoring brand-new cases use create-test-cases. Written for the automation tester repairing a suite that has started lying, and the test lead who has to keep it trustworthy.---# Katalon Test MaintenanceUse this skill for the **maintenance** stage: keep the regression suite healthy over time and feed learning back to the plan. It consumes failure/stability signals and produces repairs plus a refreshed coverage gap list.## Availability Boundary- **Available via MCP:** change/impact signals (`fetch_test_stability_data`, `find_test_results`, `read_execution`), and case-level repair (`update_test_case`, `move_test_case`, `duplicate_test_case`).- **Not directly available:** Self-healing tests, Time Capsule, Studio Tracer, object refactoring, and StudioAssist Agent-mode edits are **Studio-desktop** features. TrueTest regeneration from live journeys is a **TrueTest** surface. Narrate these; MCP repairs are case-level content edits, not object/script self-healing.## Maintenance Workflow```text+---------------------+ +----------------------+ +----------------------+| Detect change impact| --> | Diagnose: repair vs | --> | Repair case assets || stability + history | | regenerate vs retire | | update/move/dup |+---------------------+ +----------------------+ +----------------------+ | v +----------------------+ | Validate + feed back | | to plan (gap list) | +----------------------+```## Steps and tool rules1. **Detect impact.** `fetch_test_stability_data` for flakiness trend; `find_test_results` + `read_execution` for what changed across recent runs. Build the list of broken / flaky / degraded cases.2. **Diagnose each.** Decide per case: - **Repair** — the case is salvageable: fix data, steps, or expected result via `update_test_case`; reorganize via `move_test_case`; branch a variant via `duplicate_test_case`. - **Regenerate** — behavior changed enough that the case should be re-derived (TrueTest regeneration / re-author) -> hand to `create-test-cases`; narrate the TrueTest boundary. - **Retire** — behavior removed: unlink/retire (prefer update/flag over unreliable `delete_test_case`); get approval.3. **Repair (MCP-legal edits only).** Pass all intended updates in one `update_test_case` call. Do not claim to have self-healed locators/objects — that is Studio.4. **Validate.** Re-run through `execute-test` and confirm via `find_test_results` / `read_execution`.5. **Feed back.** Emit the refreshed coverage gap list to `test-plan` so maintenance closes the loop instead of dead-ending.## Prompt recipes- `Which regression cases became flaky this month, and which should we repair vs regenerate?`- `Repair the login suite after the new auth flow: update the affected cases and tell me what still needs re-authoring.`- `After this release's UI change, refresh coverage and give me the gap list for next sprint.`## Hand-offs- Classify a specific failed run first -> `analyze-failures`.- Re-author changed behavior -> `create-test-cases`.- Confirm repairs -> `execute-test` then `test-review`.- Refreshed gaps -> `test-plan`.Read `references/maintenance-loop.md` before repairing. Consult the orchestrator's `references/unavailable-capabilities.md` for the Studio/TrueTest boundary.

Frequently asked questions