How do I install the Multi Modal Input skill?

Run npx skillmds@latest add wanghaisheng/multi-modal-input in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.

Is Multi Modal Input safe to use?

This skill has not completed SkillMD's automated safety review yet. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.

Which AI agents work with Multi Modal Input?

This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.

Is Multi Modal Input free to use?

Yes. Installing skills from SkillMD is free, and the skill stays under its author's original license.

Who published Multi Modal Input?

wanghaisheng (@wanghaisheng) published this skill. Their other Agent Skills are listed on their SkillMD profile.

Multi Modal Input by wanghaisheng — Agent Skill

Name: Multi Modal Input
Author: wanghaisheng

Multi Modal Input

Design interfaces that offer multiple input methods so users can choose what works for their abilities and context. Use when designing any interactive system where users provide input — forms, search, editors, creative tools, communication interfaces. Triggers on: multi-modal, input methods, alternative input, how people interact, mouse alternative, touch alternative, input flexibility, switch access, eye tracking, head pointer.

wanghaisheng 63b2dcd 2.8 KB Updated Sep 17, 2026

File contents

Multi-Modal Input Design

Design systems where users can accomplish any task through whichever input method works for them — keyboard, mouse, touch, voice, switch, eye tracking, or any combination.

Core Principle

Never assume how someone will interact with your interface. Offer choices. Let the user decide.

The Input Spectrum

People interact with technology through many methods, often combining several at once:

Keyboard — physical, on-screen, or switch-activated
Mouse / trackpad — standard pointer devices
Touch — fingers, stylus, or assistive touch
Voice — speech commands, dictation
Switch devices — single or dual switches scanning through options
Eye tracking — gaze-based selection
Head pointers — head movement controlling a cursor
Sip-and-puff — breath-controlled switches

Design Patterns

Input Equivalence

Every action must be possible through at least keyboard AND pointer (mouse/touch)
Voice input should be available as a third option where practical
Never lock a feature to a single input method
Test: can someone complete this task using ONLY keyboard? ONLY touch? ONLY voice?

Flexible Text Entry

Support physical keyboard, on-screen keyboard, voice dictation, and paste from clipboard
Auto-complete and suggestions reduce typing burden
Don't disable paste in form fields (password managers, assistive tools depend on this)
Allow scanning and OCR for filling in reference numbers or codes

Selection Without Precision

Radio buttons and checkboxes: make the label clickable, not just the control
Dropdowns: allow type-ahead search for long lists
Date pickers: always offer a text field alternative alongside the calendar widget
Colour pickers: provide text input for hex/RGB values

Complex Interactions

Drag-and-drop: always provide button-based reordering
Drawing/annotation: offer text description as alternative
Map interactions: provide address search alongside map selection
Gestures (swipe, pinch): always provide button equivalents

Assessment Questions

Can every task be completed through keyboard alone?
Can every task be completed through pointer alone?
Are there complex interactions (drag, gesture, drawing) that lack simpler alternatives?
Is paste enabled in all text fields?
Do all form controls have clickable labels?

---name: multi-modal-inputdescription: Design interfaces that offer multiple input methods so users can choose what works for their abilities and context. Use when designing any interactive system where users provide input — forms, search, editors, creative tools, communication interfaces. Triggers on: multi-modal, input methods, alternative input, how people interact, mouse alternative, touch alternative, input flexibility, switch access, eye tracking, head pointer.---# Multi-Modal Input DesignDesign systems where users can accomplish any task through whicheverinput method works for them — keyboard, mouse, touch, voice, switch,eye tracking, or any combination.## Core PrincipleNever assume how someone will interact with your interface. Offerchoices. Let the user decide.## The Input SpectrumPeople interact with technology through many methods, often combiningseveral at once:- **Keyboard** — physical, on-screen, or switch-activated- **Mouse / trackpad** — standard pointer devices- **Touch** — fingers, stylus, or assistive touch- **Voice** — speech commands, dictation- **Switch devices** — single or dual switches scanning through options- **Eye tracking** — gaze-based selection- **Head pointers** — head movement controlling a cursor- **Sip-and-puff** — breath-controlled switches## Design Patterns### Input Equivalence- Every action must be possible through at least keyboard AND pointer (mouse/touch)- Voice input should be available as a third option where practical- Never lock a feature to a single input method- Test: can someone complete this task using ONLY keyboard? ONLY touch? ONLY voice?### Flexible Text Entry- Support physical keyboard, on-screen keyboard, voice dictation, and paste from clipboard- Auto-complete and suggestions reduce typing burden- Don't disable paste in form fields (password managers, assistive tools depend on this)- Allow scanning and OCR for filling in reference numbers or codes### Selection Without Precision- Radio buttons and checkboxes: make the label clickable, not just the control- Dropdowns: allow type-ahead search for long lists- Date pickers: always offer a text field alternative alongside the calendar widget- Colour pickers: provide text input for hex/RGB values### Complex Interactions- Drag-and-drop: always provide button-based reordering- Drawing/annotation: offer text description as alternative- Map interactions: provide address search alongside map selection- Gestures (swipe, pinch): always provide button equivalents## Assessment Questions1. Can every task be completed through keyboard alone?2. Can every task be completed through pointer alone?3. Are there complex interactions (drag, gesture, drawing) that lack simpler alternatives?4. Is paste enabled in all text fields?5. Do all form controls have clickable labels?

Frequently asked questions