Searching and Extracting Web Content with Parallel CLI
Prerequisites
parallel-climust be installed and available onPATH.- Verify authentication once per task when needed:
parallel-cli auth
Non-goals
- General file/URL-to-markdown conversion tasks.
- OCR, image description, or audio transcription.
- Unbounded browsing without a concrete search or extraction objective.
- Interactive browser automation workflows (click/fill/login/stateful navigation).
- Single-page interaction loops where the agent must act on DOM elements by node ID.
parallel-clisetup and account provisioning guidance.
Default command profiles
Search (default)
parallel-cli search "<objective>" \
--mode fast \
--max-results 5 \
--excerpt-max-chars-per-result 800 \
--excerpt-max-chars-total 6000
Search with source/recency constraints
parallel-cli search "<objective>" \
--mode fast \
--max-results 5 \
--include-domains <domain1,domain2> \
--after-date YYYY-MM-DD \
--excerpt-max-chars-per-result 800 \
--excerpt-max-chars-total 6000
Extract
Use only selected URLs (best few first), and keep excerpts small.
parallel-cli extract <url1> <url2> <url3> \
--objective "<what to pull out>" \
--excerpt-max-chars-per-result 700 \
--excerpt-max-chars-total 2100
Notes:
extract --no-excerptsalone is invalid (it errors unless full content is requested).
Refinement strategy
If results are weak or noisy, refine automatically in this order:
- Narrow query terms (more specific entities/version/date).
- Add
--include-domainsfor trusted sources. - Add
--after-datefor recency-sensitive tasks.
Failure handling
- Exit code
3(auth): report auth issue and required setup. - Exit code
4(API failure): retry once with simpler args (fewer filters/URLs). - Exit code
5(timeout): retry with reduced scope (fewer results, fewer URLs, tighter objective).
Output format to user
Return only high-signal results:
- Key findings (concise bullets)
- Source list (title + URL, optional date)
- Notable uncertainty/gaps