surf-cli Codebase
Architecture
cli.cjs --socket:/tmp/surf.sock--> host.cjs --native-msg--> service-worker/index.ts --CDP/chrome-APIs--> browser
Add CLI Command
- Add to
TOOLS in native/cli.cjs:158 (args, opts, examples)
- Add handler in src/service-worker/index.ts:50
handleMessage() switch
- CDP op? → add method src/cdp/controller.ts:60
- DOM interaction? → add handler src/content/accessibility-tree.ts:99
Add CDP Operation
- Add method to
CDPController class src/cdp/controller.ts:60
- Use
this.send(tabId, "Domain.method", params)
- Handle events in
handleCDPEvent() if needed
Core Files
src/service-worker/index.ts (~2500L) - Central msg router, CDP ops, screenshot cache, tab registry
- Msg types: EXECUTE_CLICK, EXECUTE_TYPE, READ_PAGE, EXECUTE_SCREENSHOT
- Screenshot cache: generateScreenshotId(), cacheScreenshot(), getScreenshot()
- Tab names: tabNameRegistry Map<name,tabId>
src/cdp/controller.ts (~1000L) - CDP wrapper, CDPController class
- Mouse: click(), rightClick(), doubleClick(), hover(), drag()
- Keyboard: type(), pressKey(), pressKeyChord()
- Screenshots: captureScreenshot(), captureRegion()
- Network/Console: enableNetworkTracking(), getNetworkRequests(), getResponseBody(), subscribeToNetwork(), enableConsoleTracking(), getConsoleMessages()
- Emulation: emulateNetwork(), emulateCPU(), emulateGeolocation()
src/content/accessibility-tree.ts (~1900L) - Content script, generates a11y tree YAML, element interactions
- Handlers: GENERATE_ACCESSIBILITY_TREE, CLICK_ELEMENT, FORM_INPUT, GET_ELEMENT_COORDINATES, WAIT_FOR_ELEMENT, WAIT_FOR_URL
- Element refs: e1, e2... in window.__piRefs for stable references
native/cli.cjs (~2100L) - CLI parser, socket client
- TOOLS: command defs with args/opts
- ALIASES: shortcut→command map
- AUTO_SCREENSHOT_TOOLS: commands that auto-capture
- parseArgs(), sendRequest()
native/host.cjs (~2100L) - Socket server, AI integration
- handleToolRequest(): main dispatcher
- mapToolToMessage(): tool→extension msg converter
- queueAiRequest(): AI request serialization
- AI clients: chatgptClient, geminiClient, perplexityClient
src/native/port-manager.ts - Extension↔native messaging, auto-reconnect, request/response tracking
Message Flow
- CLI:
surf click e5
- cli.cjs parses → socket → host.cjs
- host.cjs routes to EXECUTE_CLICK msg
- Native msg → service-worker/index.ts
- Service worker: CDP (cdp/controller.ts) or content script (chrome.tabs.sendMessage)
- Response flows back to CLI
Debug
- Extension logs: chrome://extensions → Service Worker → Console
- Host logs: /tmp/surf-host.log
- CLI raw output:
--json flag
Test
npm run build # Build ext
npm test # Run tests
npm run test:coverage # Coverage
Element Refs
A11y tree assigns e1, e2... during READ_PAGE. Stored window.__piRefs. Reset each read command.
Network Capture
- CDP captures via Network.* events cdp/controller.ts:73
- Storage: /tmp/surf/requests.jsonl
- Formatters: native/formatters/network.cjs:259
Build/Install
npm run dev # Watch mode
npm run build # Prod → dist/
# Load dist/ as unpacked ext
surf install <ext-id> # Register native host
Gotchas
- CDP attach: 100-500ms first time/tab
- chrome:// pages restricted
- Content script needs page refresh on existing tabs
- Screenshots auto-resize 1200px unless --full
1---2name: surf-codebase3description: Navigate and modify surf-cli codebase - Chrome extension + native host for AI browser automation. Use for surf-cli code work, architecture questions, implementing browser control/CDP/accessibility/network features.4---56# surf-cli Codebase78## Architecture9```10cli.cjs --socket:/tmp/surf.sock--> host.cjs --native-msg--> service-worker/index.ts --CDP/chrome-APIs--> browser11```1213## Add CLI Command14151. Add to `TOOLS` in native/cli.cjs:158 (args, opts, examples)162. Add handler in src/service-worker/index.ts:50 `handleMessage()` switch173. CDP op? → add method src/cdp/controller.ts:60184. DOM interaction? → add handler src/content/accessibility-tree.ts:991920## Add CDP Operation21221. Add method to `CDPController` class src/cdp/controller.ts:60232. Use `this.send(tabId, "Domain.method", params)`243. Handle events in `handleCDPEvent()` if needed2526## Core Files2728**src/service-worker/index.ts** (~2500L) - Central msg router, CDP ops, screenshot cache, tab registry29- Msg types: EXECUTE_CLICK, EXECUTE_TYPE, READ_PAGE, EXECUTE_SCREENSHOT30- Screenshot cache: generateScreenshotId(), cacheScreenshot(), getScreenshot()31- Tab names: tabNameRegistry Map<name,tabId>3233**src/cdp/controller.ts** (~1000L) - CDP wrapper, CDPController class34- Mouse: click(), rightClick(), doubleClick(), hover(), drag()35- Keyboard: type(), pressKey(), pressKeyChord()36- Screenshots: captureScreenshot(), captureRegion()37- Network/Console: enableNetworkTracking(), getNetworkRequests(), getResponseBody(), subscribeToNetwork(), enableConsoleTracking(), getConsoleMessages()38- Emulation: emulateNetwork(), emulateCPU(), emulateGeolocation()3940**src/content/accessibility-tree.ts** (~1900L) - Content script, generates a11y tree YAML, element interactions41- Handlers: GENERATE_ACCESSIBILITY_TREE, CLICK_ELEMENT, FORM_INPUT, GET_ELEMENT_COORDINATES, WAIT_FOR_ELEMENT, WAIT_FOR_URL42- Element refs: e1, e2... in window.__piRefs for stable references4344**native/cli.cjs** (~2100L) - CLI parser, socket client45- TOOLS: command defs with args/opts46- ALIASES: shortcut→command map47- AUTO_SCREENSHOT_TOOLS: commands that auto-capture48- parseArgs(), sendRequest()4950**native/host.cjs** (~2100L) - Socket server, AI integration51- handleToolRequest(): main dispatcher52- mapToolToMessage(): tool→extension msg converter53- queueAiRequest(): AI request serialization54- AI clients: chatgptClient, geminiClient, perplexityClient5556**src/native/port-manager.ts** - Extension↔native messaging, auto-reconnect, request/response tracking5758## Message Flow59601. CLI: `surf click e5`612. cli.cjs parses → socket → host.cjs623. host.cjs routes to EXECUTE_CLICK msg634. Native msg → service-worker/index.ts645. Service worker: CDP (cdp/controller.ts) or content script (chrome.tabs.sendMessage)656. Response flows back to CLI6667## Debug6869- Extension logs: chrome://extensions → Service Worker → Console70- Host logs: /tmp/surf-host.log71- CLI raw output: `--json` flag7273## Test7475```bash76npm run build # Build ext77npm test # Run tests78npm run test:coverage # Coverage79```8081## Element Refs8283A11y tree assigns e1, e2... during READ_PAGE. Stored window.__piRefs. Reset each `read` command.8485## Network Capture8687- CDP captures via Network.* events cdp/controller.ts:7388- Storage: /tmp/surf/requests.jsonl89- Formatters: native/formatters/network.cjs:2599091## Build/Install9293```bash94npm run dev # Watch mode95npm run build # Prod → dist/96# Load dist/ as unpacked ext97surf install <ext-id> # Register native host98```99100## Gotchas101102- CDP attach: 100-500ms first time/tab103- chrome:// pages restricted104- Content script needs page refresh on existing tabs105- Screenshots auto-resize 1200px unless --full