iOS Simulator Skill
Build, test, and automate iOS applications using accessibility-driven navigation and structured data instead of pixel coordinates.
Quick Start
# 1. Check environment
bash scripts/sim_health_check.sh
# 2. Launch app
python scripts/app_launcher.py --launch com.example.app
# 3. Map screen to see elements
python scripts/screen_mapper.py
# 4. Tap button
python scripts/navigator.py --find-text "Login" --tap
# 5. Enter text
python scripts/navigator.py --find-type TextField --enter-text "user@example.com"
All scripts support --help for detailed options and --json for machine-readable output.
Navigation Strategy
Always prefer the accessibility tree over screenshots for navigation. The accessibility tree gives you element types, labels, frames, and tap targets — structured data that's cheaper and more reliable than image analysis.
Use this priority:
screen_mapper.py → structured element list (5-7 lines, ~10 tokens)
navigator.py --find-text/--find-type/--find-id → semantic interaction
- Screenshots → only for visual verification, bug reports, or visual diff
Screenshots cost 1,600–6,300 tokens depending on size. The accessibility tree costs 10–50 tokens in default mode.
22 Production Scripts
Build & Development (2 scripts)
build_and_test.py - Build Xcode projects, run tests, parse results with progressive disclosure
- Build with live result streaming
- Parse errors and warnings from xcresult bundles
- Retrieve detailed build logs on demand
- Options:
--project, --scheme, --clean, --test, --verbose, --json
log_monitor.py - Real-time log monitoring with intelligent filtering
- Stream logs or capture by duration
- Filter by severity (error/warning/info/debug)
- Deduplicate repeated messages
- Options:
--app, --severity, --follow, --duration, --output, --json
Navigation & Interaction (5 scripts)
screen_mapper.py - Analyze current screen and list interactive elements
- Element type breakdown
- Interactive button list
- Text field status
- Options:
--verbose, --hints, --json
navigator.py - Find and interact with elements semantically
- Find by text (fuzzy matching)
- Find by element type
- Find by accessibility ID
- Enter text or tap elements
- Options:
--find-text, --find-type, --find-id, --tap, --enter-text, --json
gesture.py - Perform swipes, scrolls, pinches, and complex gestures
- Directional swipes (up/down/left/right)
- Multi-swipe scrolling
- Pinch zoom
- Long press
- Pull to refresh
- Options:
--swipe, --scroll, --pinch, --long-press, --refresh, --json
keyboard.py - Text input and hardware button control
- Type text (fast or slow)
- Special keys (return, delete, tab, space, arrows)
- Hardware buttons (home, lock, volume, screenshot)
- Key combinations
- Options:
--type, --key, --button, --slow, --clear, --dismiss, --json
app_launcher.py - App lifecycle management
- Launch apps by bundle ID
- Terminate apps
- Install/uninstall from .app bundles
- Deep link navigation
- List installed apps
- Check app state
- Options:
--launch, --terminate, --install, --uninstall, --open-url, --list, --state, --json
Testing & Analysis (6 scripts)
accessibility_audit.py - Check WCAG compliance on current screen
- Critical issues (missing labels, empty buttons, no alt text)
- Warnings (missing hints, small touch targets)
- Info (missing IDs, deep nesting)
- Options:
--verbose, --output, --json
visual_diff.py - Compare two screenshots for visual changes
- Pixel-by-pixel comparison
- Threshold-based pass/fail
- Generate diff images
- Options:
--threshold, --output, --details, --json
test_recorder.py - Automatically document test execution
- Capture screenshots and accessibility trees per step
- Generate markdown reports with timing data
- Options:
--test-name, --output, --verbose, --json
app_state_capture.py - Create comprehensive debugging snapshots
- Screenshot, UI hierarchy, app logs, device info
- Markdown summary for bug reports
- Options:
--app-bundle-id, --output, --log-lines, --json
sim_health_check.sh - Verify environment is properly configured
- Check macOS, Xcode, simctl, IDB, Python
- List available and booted simulators
- Verify Python packages (Pillow)
model_inspector.py - Inspect Core Data and SwiftData models from project files
- Parse .xcdatamodeld packages (entities, attributes, relationships)
- Detect model versions and current active version
- Best-effort SwiftData @Model class extraction
- Raw source dump for any model on demand (
--raw ModelName)
- Options:
--project-path, --core-data-only, --swiftdata-only, --show-versions, --raw, --verbose, --json
Advanced Testing & Permissions (4 scripts)
clipboard.py - Manage simulator clipboard for paste testing
- Copy text to clipboard
- Test paste flows without manual entry
- Options:
--copy, --test-name, --expected, --json
status_bar.py - Override simulator status bar appearance
- Presets: clean (9:41, 100% battery), testing (11:11, 50%), low-battery (20%), airplane (offline)
- Custom time, network, battery, WiFi settings
- Options:
--preset, --time, --data-network, --battery-level, --clear, --json
push_notification.py - Send simulated push notifications
- Simple mode (title + body + badge)
- Custom JSON payloads
- Test notification handling and deep links
- Options:
--bundle-id, --title, --body, --badge, --payload, --json
privacy_manager.py - Grant, revoke, and reset app permissions
- 13 supported services (camera, microphone, location, contacts, photos, calendar, health, etc.)
- Batch operations (comma-separated services)
- Audit trail with test scenario tracking
- Options:
--bundle-id, --grant, --revoke, --reset, --list, --json
Device Lifecycle Management (5 scripts)
simctl_boot.py - Boot simulators with optional readiness verification
- Boot by UDID or device name
- Wait for device ready with timeout
- Batch boot operations (--all, --type)
- Performance timing
- Options:
--udid, --name, --wait-ready, --timeout, --all, --type, --json
simctl_shutdown.py - Gracefully shutdown simulators
- Shutdown by UDID or device name
- Optional verification of shutdown completion
- Batch shutdown operations
- Options:
--udid, --name, --verify, --timeout, --all, --type, --json
simctl_create.py - Create simulators dynamically
- Create by device type and iOS version
- List available device types and runtimes
- Custom device naming
- Returns UDID for CI/CD integration
- Options:
--device, --runtime, --name, --list-devices, --list-runtimes, --json
simctl_delete.py - Permanently delete simulators
- Delete by UDID or device name
- Safety confirmation by default (skip with --yes)
- Batch delete operations
- Smart deletion (--old N to keep N per device type)
- Options:
--udid, --name, --yes, --all, --type, --old, --json
simctl_erase.py - Factory reset simulators without deletion
- Preserve device UUID (faster than delete+create)
- Erase all, by type, or booted simulators
- Optional verification
- Options:
--udid, --name, --verify, --timeout, --all, --type, --booted, --json
Common Patterns
Auto-UDID Detection: Most scripts auto-detect the booted simulator if --udid is not provided.
Device Name Resolution: Use device names (e.g., "iPhone 16 Pro") instead of UDIDs - scripts resolve automatically.
Batch Operations: Many scripts support --all for all simulators or --type iPhone for device type filtering.
Output Formats: Default is concise human-readable output. Use --json for machine-readable output in CI/CD.
Help: All scripts support --help for detailed options and examples.
Screenshot Sizing: Screenshots are resized to save tokens. Presets: full (3-4 tiles, ~5K tokens), half (1 tile, ~1.6K tokens, default), quarter (1 tile, ~800 tokens, less detail). Use quarter for quick visual checks, half for readable UI, full only when pixel-level detail matters. Scripts that capture screenshots (app_state_capture.py, test_recorder.py) default to half.
Typical Workflow
- Verify environment:
bash scripts/sim_health_check.sh
- Launch app:
python scripts/app_launcher.py --launch com.example.app
- Analyze screen:
python scripts/screen_mapper.py
- Interact:
python scripts/navigator.py --find-text "Button" --tap
- Verify:
python scripts/accessibility_audit.py
- Debug if needed:
python scripts/app_state_capture.py --app-bundle-id com.example.app
Requirements
- macOS 12+
- Xcode Command Line Tools
- Python 3
- IDB (optional, for interactive features)
Documentation
- SKILL.md (this file) - Script reference and quick start
- README.md - Installation and examples
- CLAUDE.md - Architecture and implementation details
- references/ - Deep documentation on specific topics
- examples/ - Complete automation workflows
Key Design Principles
Semantic Navigation: Find elements by meaning (text, type, ID) not pixel coordinates. Survives UI changes.
Token Efficiency: Concise default output (3-5 lines) with optional verbose and JSON modes for detailed results.
Accessibility-First: Built on standard accessibility APIs for reliability and compatibility.
Zero Configuration: Works immediately on any macOS with Xcode. No setup required.
Structured Data: Scripts output JSON or formatted text, not raw logs. Easy to parse and integrate.
Auto-Learning: Build system remembers your device preference. Configuration stored per-project.
Use these scripts directly or let Claude Code invoke them automatically when your request matches the skill description.
1---2name: ios-simulator-skill3description: 22 production-ready scripts for iOS app testing, building, and automation. Provides semantic UI navigation, build automation, accessibility testing, and simulator lifecycle management. Optimized for AI agents with minimal token output.4---56# iOS Simulator Skill78Build, test, and automate iOS applications using accessibility-driven navigation and structured data instead of pixel coordinates.910## Quick Start1112```bash13# 1. Check environment14bash scripts/sim_health_check.sh1516# 2. Launch app17python scripts/app_launcher.py --launch com.example.app1819# 3. Map screen to see elements20python scripts/screen_mapper.py2122# 4. Tap button23python scripts/navigator.py --find-text "Login" --tap2425# 5. Enter text26python scripts/navigator.py --find-type TextField --enter-text "user@example.com"27```2829All scripts support `--help` for detailed options and `--json` for machine-readable output.3031## Navigation Strategy3233**Always prefer the accessibility tree over screenshots for navigation.** The accessibility tree gives you element types, labels, frames, and tap targets — structured data that's cheaper and more reliable than image analysis.3435Use this priority:361. `screen_mapper.py` → structured element list (5-7 lines, ~10 tokens)372. `navigator.py --find-text/--find-type/--find-id` → semantic interaction383. Screenshots → only for visual verification, bug reports, or visual diff3940Screenshots cost 1,600–6,300 tokens depending on size. The accessibility tree costs 10–50 tokens in default mode.4142## 22 Production Scripts4344### Build & Development (2 scripts)45461. **build_and_test.py** - Build Xcode projects, run tests, parse results with progressive disclosure47 - Build with live result streaming48 - Parse errors and warnings from xcresult bundles49 - Retrieve detailed build logs on demand50 - Options: `--project`, `--scheme`, `--clean`, `--test`, `--verbose`, `--json`51522. **log_monitor.py** - Real-time log monitoring with intelligent filtering53 - Stream logs or capture by duration54 - Filter by severity (error/warning/info/debug)55 - Deduplicate repeated messages56 - Options: `--app`, `--severity`, `--follow`, `--duration`, `--output`, `--json`5758### Navigation & Interaction (5 scripts)59603. **screen_mapper.py** - Analyze current screen and list interactive elements61 - Element type breakdown62 - Interactive button list63 - Text field status64 - Options: `--verbose`, `--hints`, `--json`65664. **navigator.py** - Find and interact with elements semantically67 - Find by text (fuzzy matching)68 - Find by element type69 - Find by accessibility ID70 - Enter text or tap elements71 - Options: `--find-text`, `--find-type`, `--find-id`, `--tap`, `--enter-text`, `--json`72735. **gesture.py** - Perform swipes, scrolls, pinches, and complex gestures74 - Directional swipes (up/down/left/right)75 - Multi-swipe scrolling76 - Pinch zoom77 - Long press78 - Pull to refresh79 - Options: `--swipe`, `--scroll`, `--pinch`, `--long-press`, `--refresh`, `--json`80816. **keyboard.py** - Text input and hardware button control82 - Type text (fast or slow)83 - Special keys (return, delete, tab, space, arrows)84 - Hardware buttons (home, lock, volume, screenshot)85 - Key combinations86 - Options: `--type`, `--key`, `--button`, `--slow`, `--clear`, `--dismiss`, `--json`87887. **app_launcher.py** - App lifecycle management89 - Launch apps by bundle ID90 - Terminate apps91 - Install/uninstall from .app bundles92 - Deep link navigation93 - List installed apps94 - Check app state95 - Options: `--launch`, `--terminate`, `--install`, `--uninstall`, `--open-url`, `--list`, `--state`, `--json`9697### Testing & Analysis (6 scripts)98998. **accessibility_audit.py** - Check WCAG compliance on current screen100 - Critical issues (missing labels, empty buttons, no alt text)101 - Warnings (missing hints, small touch targets)102 - Info (missing IDs, deep nesting)103 - Options: `--verbose`, `--output`, `--json`1041059. **visual_diff.py** - Compare two screenshots for visual changes106 - Pixel-by-pixel comparison107 - Threshold-based pass/fail108 - Generate diff images109 - Options: `--threshold`, `--output`, `--details`, `--json`11011110. **test_recorder.py** - Automatically document test execution112 - Capture screenshots and accessibility trees per step113 - Generate markdown reports with timing data114 - Options: `--test-name`, `--output`, `--verbose`, `--json`11511611. **app_state_capture.py** - Create comprehensive debugging snapshots117 - Screenshot, UI hierarchy, app logs, device info118 - Markdown summary for bug reports119 - Options: `--app-bundle-id`, `--output`, `--log-lines`, `--json`12012112. **sim_health_check.sh** - Verify environment is properly configured122 - Check macOS, Xcode, simctl, IDB, Python123 - List available and booted simulators124 - Verify Python packages (Pillow)12512613. **model_inspector.py** - Inspect Core Data and SwiftData models from project files127 - Parse .xcdatamodeld packages (entities, attributes, relationships)128 - Detect model versions and current active version129 - Best-effort SwiftData @Model class extraction130 - Raw source dump for any model on demand (`--raw ModelName`)131 - Options: `--project-path`, `--core-data-only`, `--swiftdata-only`, `--show-versions`, `--raw`, `--verbose`, `--json`132133### Advanced Testing & Permissions (4 scripts)13413514. **clipboard.py** - Manage simulator clipboard for paste testing136 - Copy text to clipboard137 - Test paste flows without manual entry138 - Options: `--copy`, `--test-name`, `--expected`, `--json`13914015. **status_bar.py** - Override simulator status bar appearance141 - Presets: clean (9:41, 100% battery), testing (11:11, 50%), low-battery (20%), airplane (offline)142 - Custom time, network, battery, WiFi settings143 - Options: `--preset`, `--time`, `--data-network`, `--battery-level`, `--clear`, `--json`14414516. **push_notification.py** - Send simulated push notifications146 - Simple mode (title + body + badge)147 - Custom JSON payloads148 - Test notification handling and deep links149 - Options: `--bundle-id`, `--title`, `--body`, `--badge`, `--payload`, `--json`15015117. **privacy_manager.py** - Grant, revoke, and reset app permissions152 - 13 supported services (camera, microphone, location, contacts, photos, calendar, health, etc.)153 - Batch operations (comma-separated services)154 - Audit trail with test scenario tracking155 - Options: `--bundle-id`, `--grant`, `--revoke`, `--reset`, `--list`, `--json`156157### Device Lifecycle Management (5 scripts)15815918. **simctl_boot.py** - Boot simulators with optional readiness verification160 - Boot by UDID or device name161 - Wait for device ready with timeout162 - Batch boot operations (--all, --type)163 - Performance timing164 - Options: `--udid`, `--name`, `--wait-ready`, `--timeout`, `--all`, `--type`, `--json`16516619. **simctl_shutdown.py** - Gracefully shutdown simulators167 - Shutdown by UDID or device name168 - Optional verification of shutdown completion169 - Batch shutdown operations170 - Options: `--udid`, `--name`, `--verify`, `--timeout`, `--all`, `--type`, `--json`17117220. **simctl_create.py** - Create simulators dynamically173 - Create by device type and iOS version174 - List available device types and runtimes175 - Custom device naming176 - Returns UDID for CI/CD integration177 - Options: `--device`, `--runtime`, `--name`, `--list-devices`, `--list-runtimes`, `--json`17817921. **simctl_delete.py** - Permanently delete simulators180 - Delete by UDID or device name181 - Safety confirmation by default (skip with --yes)182 - Batch delete operations183 - Smart deletion (--old N to keep N per device type)184 - Options: `--udid`, `--name`, `--yes`, `--all`, `--type`, `--old`, `--json`18518622. **simctl_erase.py** - Factory reset simulators without deletion187 - Preserve device UUID (faster than delete+create)188 - Erase all, by type, or booted simulators189 - Optional verification190 - Options: `--udid`, `--name`, `--verify`, `--timeout`, `--all`, `--type`, `--booted`, `--json`191192## Common Patterns193194**Auto-UDID Detection**: Most scripts auto-detect the booted simulator if --udid is not provided.195196**Device Name Resolution**: Use device names (e.g., "iPhone 16 Pro") instead of UDIDs - scripts resolve automatically.197198**Batch Operations**: Many scripts support `--all` for all simulators or `--type iPhone` for device type filtering.199200**Output Formats**: Default is concise human-readable output. Use `--json` for machine-readable output in CI/CD.201202**Help**: All scripts support `--help` for detailed options and examples.203204**Screenshot Sizing**: Screenshots are resized to save tokens. Presets: `full` (3-4 tiles, ~5K tokens), `half` (1 tile, ~1.6K tokens, default), `quarter` (1 tile, ~800 tokens, less detail). Use `quarter` for quick visual checks, `half` for readable UI, `full` only when pixel-level detail matters. Scripts that capture screenshots (`app_state_capture.py`, `test_recorder.py`) default to `half`.205206## Typical Workflow2072081. Verify environment: `bash scripts/sim_health_check.sh`2092. Launch app: `python scripts/app_launcher.py --launch com.example.app`2103. Analyze screen: `python scripts/screen_mapper.py`2114. Interact: `python scripts/navigator.py --find-text "Button" --tap`2125. Verify: `python scripts/accessibility_audit.py`2136. Debug if needed: `python scripts/app_state_capture.py --app-bundle-id com.example.app`214215## Requirements216217- macOS 12+218- Xcode Command Line Tools219- Python 3220- IDB (optional, for interactive features)221222## Documentation223224- **SKILL.md** (this file) - Script reference and quick start225- **README.md** - Installation and examples226- **CLAUDE.md** - Architecture and implementation details227- **references/** - Deep documentation on specific topics228- **examples/** - Complete automation workflows229230## Key Design Principles231232**Semantic Navigation**: Find elements by meaning (text, type, ID) not pixel coordinates. Survives UI changes.233234**Token Efficiency**: Concise default output (3-5 lines) with optional verbose and JSON modes for detailed results.235236**Accessibility-First**: Built on standard accessibility APIs for reliability and compatibility.237238**Zero Configuration**: Works immediately on any macOS with Xcode. No setup required.239240**Structured Data**: Scripts output JSON or formatted text, not raw logs. Easy to parse and integrate.241242**Auto-Learning**: Build system remembers your device preference. Configuration stored per-project.243244---245246Use these scripts directly or let Claude Code invoke them automatically when your request matches the skill description.