Profile My skills Saved Collections Edit profile Submit a skill

Scrape And Load

Run the Wookieepedia scraper, convert data, load into SQLite, and verify with migration and full tests.

sap-samples 1ab36e6 1.2 KB Updated
Coding & Dev Tools

File contents

Run the full data pipeline sequentially from the cap/ directory.

Steps

  1. Scrape Star Wars data

    cd cap && npm run scrape

    Uses committed cache by default (fast). If the user requests --bypass-cache, ask for explicit confirmation first, then run npm run scrape:bypass-cache instead.

  2. Build CDS artifacts

    cd cap && npm run build

  3. Load fixture data into SQLite

    cd cap && npm run load_sqlite

  4. Run migration tests

    cd cap && npm run test:migration

    Verifies data conversion logic and report generation.

  5. Run full test suite

    cd cap && npm test

Rules

  • Stop on failure. If any step fails, report the error and do not continue.
  • Cache-first by default. Never bypass the scraper cache without user confirmation — fresh fetches hit Wookieepedia and take significantly longer.
  • Report results. Summarize each step's outcome: scrape stats, build status, load counts, and test pass/fail/skip.

sap-samples/cloud-cap-hana-swapi/tree/main/.claude/skills/scrape-and-load commit 1ab36e6083

Browse category

Frequently asked questions

npx skillmds@latest add sap-samples/scrape-and-load