How do I install the Linux Gui Control skill?

Run npx skillmds@latest add kbarbel640-del/linux-gui-control in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.

Is Linux Gui Control safe to use?

This skill has not completed SkillMD's automated safety review yet. Independent scanners report: SkillSpector: PASS, Skill Scanner: PASS. Capability flags: executes scripts. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.

Which AI agents work with Linux Gui Control?

This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.

Is Linux Gui Control free to use?

Yes. Installing skills from SkillMD is free, and the skill stays under its author's original license.

Who published Linux Gui Control?

kbarbel640-del (@kbarbel640-del) published this skill. Their other Agent Skills are listed on their SkillMD profile.

Linux Gui Control by kbarbel640-del

Name: Linux Gui Control
Rating: 4.5 (4 reviews)
Author: kbarbel640-del

Linux Gui Control

Control the Linux desktop GUI using xdotool, wmctrl, and dogtail. Use when you need to interact with non-browser applications, simulate mouse/keyboard input, manage windows, or inspect the UI hierarchy of applications on X11/GNOME. Supports: (1) Clicking/typing in apps, (2) Resizing/moving windows, (3) Extracting text-based UI trees from apps (A11y), (4) Taking screenshots for visual analysis.

kbarbel640-del Updated Sep 8, 2026 1 repo stars

File contents

Linux GUI Control

This skill provides tools and procedures for automating interactions with the Linux desktop environment.

Quick Start

1. Identify Target Window

Use wmctrl to find the exact name of the window you want to control.

wmctrl -l

2. Inspect UI Hierarchy

For apps supporting accessibility (GNOME apps, Electron apps with --force-renderer-accessibility), use the inspection script to find button names without taking screenshots.

python3 scripts/inspect_ui.py "<app_name>"

3. Perform Actions

Use xdotool via the helper script for common actions.

# Activate window
./scripts/gui_action.sh activate "<window_name>"

# Click coordinates
./scripts/gui_action.sh click 500 500

# Type text
./scripts/gui_action.sh type "Hello World"

# Press a key
./scripts/gui_action.sh key "Return"

Workflows

Operating an App via Text UI

List windows with wmctrl -l.
Activate the target window.
Run scripts/inspect_ui.py to get the list of buttons and inputs.
Use xdotool key Tab and Return to navigate, or click if coordinates are known.
If text-based inspection fails, fallback to taking a screenshot and using vision.

Forcing Accessibility in Electron Apps

Many modern apps (VS Code, Discord, Cider, Chrome) need a flag to expose their UI tree:

pkill <app>
nohup <app> --force-renderer-accessibility > /dev/null 2>&1 &

Tool Reference

wmctrl: Window management (list, activate, move, resize).
xdotool: Input simulation (click, type, key, mousemove).
dogtail: UI tree extraction via AT-SPI (Accessibility bus).
scrot: Lightweight screenshot tool.

---name: linux-gui-controldescription: Control the Linux desktop GUI using xdotool, wmctrl, and dogtail. Use when you need to interact with non-browser applications, simulate mouse/keyboard input, manage windows, or inspect the UI hierarchy of applications on X11/GNOME. Supports: (1) Clicking/typing in apps, (2) Resizing/moving windows, (3) Extracting text-based UI trees from apps (A11y), (4) Taking screenshots for visual analysis.---# Linux GUI ControlThis skill provides tools and procedures for automating interactions with the Linux desktop environment.## Quick Start### 1. Identify Target WindowUse `wmctrl` to find the exact name of the window you want to control.```bashwmctrl -l```### 2. Inspect UI HierarchyFor apps supporting accessibility (GNOME apps, Electron apps with `--force-renderer-accessibility`), use the inspection script to find button names without taking screenshots.```bashpython3 scripts/inspect_ui.py "<app_name>"```### 3. Perform ActionsUse `xdotool` via the helper script for common actions.```bash# Activate window./scripts/gui_action.sh activate "<window_name>"# Click coordinates./scripts/gui_action.sh click 500 500# Type text./scripts/gui_action.sh type "Hello World"# Press a key./scripts/gui_action.sh key "Return"```## Workflows### Operating an App via Text UI1. List windows with `wmctrl -l`.2. Activate the target window.3. Run `scripts/inspect_ui.py` to get the list of buttons and inputs.4. Use `xdotool key Tab` and `Return` to navigate, or `click` if coordinates are known.5. If text-based inspection fails, fallback to taking a screenshot and using vision.### Forcing Accessibility in Electron AppsMany modern apps (VS Code, Discord, Cider, Chrome) need a flag to expose their UI tree:```bashpkill <app>nohup <app> --force-renderer-accessibility > /dev/null 2>&1 &```## Tool Reference- **wmctrl**: Window management (list, activate, move, resize).- **xdotool**: Input simulation (click, type, key, mousemove).- **dogtail**: UI tree extraction via AT-SPI (Accessibility bus).- **scrot**: Lightweight screenshot tool.

Frequently asked questions