xiangteng007 Playwright OSINT Best Practices
Stealth & Evasion
- User Agents: Always randomize or use standard highly-adopted User Agent strings when initializing Contexts.
- Headless Limitations: Avoid defaulting to Headless out-of-the-box if the target tracks WebDriver heuristics. Use
playwright-stealthwhere appropriate. - Timeouts & Delays: Introduce jitter (randomized human-like delays) between page interactions (
page.waitForTimeout(Math.random() * 2000)).
Resiliency
- Dynamic Selectors: Target resilient attributes like data-test-id or semantic text (
page.getByRole) rather than fragile CSS classes. - Interception: Block unnecessary resources (images, fonts, heavy scripts) via
route.abort()to radically speed up crawler execution. - Error Handling: Wrap all actions in try/catch blocks and ensure
page.close()andbrowser.close()are triggered in afinallyblock to prevent zombified browser instances.