# Scrape Add Page Object

> Add an empty web-poet page object to a Scrapy project

- Skill: `zytedata/scrape-add-page-object` (Agent Skill, multi-file: 2 files)
- Install (CLI): `npx skillmds@latest add zytedata/scrape-add-page-object`
- Raw SKILL.md: https://api.skillmd.com/api/skills/zytedata/scrape-add-page-object/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Coding & Dev Tools
- Author: zytedata (https://skillmd.com/u/zytedata)
- Updated: 2026-09-17
- Page: https://skillmd.com/skills/zytedata/scrape-add-page-object

---


You are adding an empty web-poet page object to a Scrapy project.

Read `${CLAUDE_SKILL_DIR}/../scrape/references/python-environments.md`.

## Input

The raw argument string is `$ARGUMENTS`. Split it into up to 6 whitespace-separated positional arguments:

1. **file_path**: path to the .py file to create or append to (e.g. `books_project/pages/books_toscrape_com.py`)
2. **class_name**: page object class name (e.g. `ProductPage`)
3. **domain**: domain for `@handle_urls` (e.g. `books.toscrape.com`)
4. **base_class**: base class import path (e.g. `web_poet.WebPage`)
5. **item_class**: item class import path (e.g. `books_project.items.ProductItem`)
6. **fields**: optional, comma-separated field names (e.g. `name,price,rating`)

## Process

Run from the **project root** (the directory containing `pyproject.toml`) so the item
class is importable for auto-detecting required fields:

```bash
uv run --project . --with libcst ${CLAUDE_SKILL_DIR}/scripts/add_page_object.py \
    FILE_PATH CLASS_NAME DOMAIN BASE_CLASS ITEM_CLASS
```

Required fields (those with no default in the item class) are detected automatically
via itemadapter and get `@field` stubs. If all fields have defaults the class body is
`pass`. Pass `--fields name,price` to override auto-detection.

The script uses libcst for correct AST manipulation:
- Creates the file if it doesn't exist
- Appends to existing files with proper import merging
- Multiple page objects can share a module (e.g., `ProductPage` and `CategoryPage`)

Common base classes:
- `web_poet.WebPage` — for pages using HTTP responses (most common)