Computer Use Bridge
When to Use
- User says computer use or task matches this capability
- User says desktop control or task matches this capability
- User says click on screen or task matches this capability
- User says GUI automation or task matches this capability
Workflow
- Confirm desktop environment and permissions.
- Plan actions: click, type, navigate (minimal steps).
- Execute via desktop-subagent-connector with screenshots.
- Verify outcome visually; retry once on mismatch.
Integrations
desktop-subagent-connectorhitl-approver
Error Handling
| Failure | Response |
|---|---|
| Permission denied | Ask user to grant accessibility permissions. |
Gotchas
- Destructive GUI actions require hitl-approver.
Example
Input: User request matching triggers above. Output: Structured result per workflow with integrations invoked as needed.