Analyze Task

Check OSWorld tasks. Validate the evaluation function, verify that the instruction is feasible given the task setup and agent-visible files, inspect setup artifacts when needed, and produce both markdown and structured JSON reports.

amap-ml e66b2ae 3 files · 10.1 KB Updated

File contents

If only one task is issued, analyze it directly with instruction: analyze-single-task.md.

If multiple tasks are issued, use subagents to analyze them in parallel (one agent for each task) and save reports under check/<task_id>/. Do not analyze them sequentially by yourself. DO NOT tell it what to do. Just ask the subagent to analyze the task in target directory and use this skill (analyze-task) to do the analysis. Pass any user instructions to every subagent.

After the subagents finish, do nothing but report to user that the check is done and where to find the reports.

amap-ml/longhorizon-harness/tree/main/eval/OSWorldv2-harness/OSWorld-V2/.codex/skills/analyze-task commit e66b2aed00

Frequently asked questions

npx skillmds@latest add amap-ml/analyze-task