Verify Catalog

Catalog Verification Skill

Verify that all URLs in the Pega Dev Components catalog (index.json) are valid and asset files match expected sizes.

Overview

The verification process:

1. Parses the catalog (index.json) to extract all binary URLs
2. Starts a local HTTP server on port 8000
3. Tests each URL with HTTP HEAD requests
4. Validates that content-length matches actual local file sizes
5. Reports pass/fail status for all components and versions

Prerequisites

• Working directory: pega-dev-components repo
• Python 3.6+
• All assets present in assets/components/ directory
• Port 8000 available (or specify alternate port)

Workflows

Verify All Catalog URLs

Trigger: "verify catalog", "validate urls", "check assets", "verify catalog integrity"

# Start HTTP server in background
cd /home/sartm/code/component-catalog/pega-dev-components
python3 -m http.server 8000 &
SERVER_PID=$!

# Run verification
python3 scripts/verify_catalog.py http://localhost:8000

# Kill server when done
kill $SERVER_PID

What happens:

• Reads index.json and extracts all binary entries
• Converts GitHub Pages URLs (https://pegasystems.github.io/pega-dev-components/assets/...) to localhost URLs (http://localhost:8000/assets/...)
• For each URL:
  1. Checks if local file exists
  2. Sends HEAD request and verifies HTTP 200 response
  3. Compares content-length header with actual file size
  4. Reports PASS if all checks succeed, FAIL otherwise
• Generates summary table and details report
• Returns exit code 0 if all pass, 1 if any fail

Verify with Custom Port

python3 scripts/verify_catalog.py http://localhost:9000

Quick Verification (Check Local Files Only)

To verify without starting a server:

# Just check that all files referenced in index.json exist locally
python3 -c "
import json
from pathlib import Path

with open('index.json') as f:
    data = json.load(f)

missing = []
for pkg in data['packages']:
    for v in pkg['versions']:
        for b in v.get('binaries', []):
            url = b['url']
            path = url.split('/pega-dev-components/')[-1]
            if not Path(path).exists():
                missing.append(path)

if missing:
    print('Missing files:')
    for m in missing:
        print(f'  - {m}')
else:
    print('✓ All files exist locally')
"

Verification Script Details

Location: scripts/verify_catalog.py

Features:

• Pure Python (no external dependencies)
• Uses standard library urllib for HTTP requests
• Converts GitHub Pages paths to localhost paths automatically
• Reports file sizes in human-readable format (B, KB, MB, GB)
• Color-coded output: ✓ for pass, ✗ for fail
• Detailed failure reporting with specific errors

Exit Codes:

• 0 – All URLs verified successfully
• 1 – One or more URLs failed verification

URL Path Conversion

The script automatically converts deployment URLs to localhost:

The /pega-dev-components/ segment is removed because the HTTP server serves from the repo root.

Supported Components

Verification covers all components in index.json:

• Platform Blueprint Component (multiple versions across platforms 23.1.0–26.1.0)
• AI Authoring Rules (multiple versions across platforms 24.1.0–26.1.0)
• CDH Blueprint Import Module (version 0.0.1 for platform 26.1.0)

Troubleshooting

Integration with Release Process

The verification script is ideal for:

• Post-release validation – Confirm all new URLs work after publishing
• Pre-deployment testing – Validate catalog before merging to main
• Asset integrity checks – Ensure files weren't corrupted during transfer
• CI/CD pipelines – Automated quality gates for releases

Base directory

This skill operates in the pega-dev-components repo.

Relative paths (e.g., scripts/verify_catalog.py) are relative to the repo root.