Fine Grained Widget Grounding

Use this skill when the user wants to target tiny, crowded, or easy-to-misclick GUI elements, particularly in high-resolution (4K) professional software. Trigger it for requests like “click the small wrench icon,” “find the share button in this crowded toolbar,” “use the tiny checkboxes,” or “the target is like a needle in a haystack.” This skill is for GUI tasks where the agent must overcome extreme spatial dilution through multi-stage visual refinement and recover from initial localization errors using bidirectional search logic.

dingxingdi Updated 1 repo stars

File contents

dingxingdi/paper_fast_search_backup commit 271abbec42

Frequently asked questions

npx get-skill add dingxingdi/fine-grained-widget-grounding