# Android UI

> Semantic UI hierarchy — traverse, find, click, type, and read the accessibility tree instead of raw coordinates. Use for the majority of app automation where a UI tree exists.

- Skill: `samraddhashrivastavatech/android-ui` (Agent Skill)
- Install (CLI): `npx skillmds@latest add samraddhashrivastavatech/android-ui`
- Raw SKILL.md: https://api.skillmd.com/api/skills/samraddhashrivastavatech/android-ui/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Web & Frontend
- Author: SAMRADDHASHRIVASTAVATECH (https://skillmd.com/u/samraddhashrivastavatech)
- Updated: 2026-09-22
- Page: https://skillmd.com/skills/samraddhashrivastavatech/android-ui

---


# Android semantic UI automation

Drive apps through the accessibility/UI hierarchy: locate real elements (button,
field, link, label) and act on them, so automation works without hardcoded
coordinates and survives layout changes.

## When to use

- Automating any standard Android app/dialog/page.
- Finding a control ("the login button", "field named Email").
- Clicking, typing, or reading state without coordinate guessing.

## Tools used

- `ui_tree` — dump the current window's element tree.
- `ui_find` — locate element(s) by text, content-desc, class, or id.
- `ui_click` — activate a found element.
- `ui_type` — set text into a found input field.
- `ui_read` — read visible text/state (for verification and assertions).

## Procedure

1. `ui_tree` to understand the current surface.
2. `ui_find` for the target element(s); prefer stable selectors (content-desc,
   resource-id) over raw text.
3. If the tree is stale/missing or ambiguous → `take_screenshot` and fall back
   to `android-vision`; never invent coordinates.
4. `ui_click` / `ui_type` after approval of consequential actions.
5. `ui_read` (or screenshot) afterward to verify the result — evidence required.

## Security

- Semantic targeting minimises accidental taps, but any click/type is mutative:
  confirm before consequential actions.
- Never enter credentials programmatically; hand off to the human when a
  login/password field is focused.

## Related skills

`android-vision` · `android-input` · `android-screen` · `android-apps`·
`android-control`