Meta XR SDK
Bridges three surfaces of Meta's VR/AR ecosystem: WebXR web development,
Quest-native Android spatial apps, and AI-assisted agentic workflows via the
hzdb CLI and MCP tools. This guide is the quick path; the full catalog —
toolkit APIs, parameter tables, sample apps, repos, platform matrix — lives in
references/ecosystem.md.
When to Use
- WebXR immersive experiences for the Quest browser (Three.js, React Three Fiber)
- Mixed reality — passthrough, plane/mesh detection, spatial anchors
- Hand tracking and controller input for VR/AR
- Quest-native spatial apps via Meta Spatial SDK (Android/Kotlin)
- Porting 2D Android apps to Quest spatial environments
- Performance profiling with Perfetto; store-submission (VRC) checks
- Device management (deploy, screenshot, log, shell) via hzdb CLI
- Desktop WebXR emulation for headset-free development
When Not To Use
- General 3D modelling/rendering without VR →
blender
- Unreal Engine 5 editor automation →
unreal-engine
- Full game-studio orchestration →
game-dev
- Pure WASM compute graphics without XR →
wasm-js
- 3D Gaussian Splatting →
lichtfeld-studio
- Generic non-Meta WebXR — this skill is Meta-ecosystem-specific
Quick Path
WebXR + React (recommended here):
npm create vite@latest my-xr-app -- --template react-ts
cd my-xr-app
npm install three @react-three/fiber @react-three/xr ratk iwer @iwer/devui
Device management via hzdb:
npx @meta-quest/hzdb mcp server # MCP server for AI-assisted management
npx @meta-quest/hzdb device list
npx @meta-quest/hzdb app install ./my-app.apk
npx @meta-quest/hzdb perf trace start --duration 10
Mixed reality (passthrough + scene understanding): request MR features via
ARButton, then drive plane/mesh/anchor callbacks with RATK's
RealityAccelerator. Full example in
references/ecosystem.md.
The Ecosystem (pointers)
Load references/ecosystem.md for detail on:
- WebXR toolkits — IWER (emulation), RATK (MR utilities), @react-three/xr,
with API surfaces and runnable examples
- Native spatial — Meta Spatial SDK (ECS, physics, samples), Horizon
Platform SDK (17 API packages)
- hzdb CLI + MCP server — 40+ tools across Device/App/Capture/Perf/Files/
Docs/Shell/Logs/ADB
- Unity MCP Extensions — 10 tools for VR/MR rig, interaction, teleport
- Agentic VR skills — Meta's 13
@meta-quest/agentic-tools skills
- npm packages, GitHub repos, platform matrix, WebXR performance targets,
related skills, external docs
1---2name: meta-xr-sdk3description: Build VR/AR apps for Meta Quest (2/3/3S/Pro) — WebXR in the browser and Quest-native spatial apps. Use when building immersive WebXR with Three.js or React Three Fiber, mixed reality with passthrough, hand tracking, spatial anchors, plane/mesh detection, porting 2D apps to Quest, profiling or managing a Quest device, or emulating WebXR without a headset. Meta-ecosystem specific; not for generic non-Meta WebXR or plain 3D rendering.4---56# Meta XR SDK78Bridges three surfaces of Meta's VR/AR ecosystem: WebXR web development,9Quest-native Android spatial apps, and AI-assisted agentic workflows via the10hzdb CLI and MCP tools. This guide is the quick path; the full catalog —11toolkit APIs, parameter tables, sample apps, repos, platform matrix — lives in12[`references/ecosystem.md`](references/ecosystem.md).1314## When to Use1516- **WebXR immersive experiences** for the Quest browser (Three.js, React Three Fiber)17- **Mixed reality** — passthrough, plane/mesh detection, spatial anchors18- **Hand tracking** and controller input for VR/AR19- **Quest-native spatial apps** via Meta Spatial SDK (Android/Kotlin)20- **Porting 2D Android apps** to Quest spatial environments21- **Performance profiling** with Perfetto; store-submission (VRC) checks22- **Device management** (deploy, screenshot, log, shell) via hzdb CLI23- **Desktop WebXR emulation** for headset-free development2425## When Not To Use2627- General 3D modelling/rendering without VR → `blender`28- Unreal Engine 5 editor automation → `unreal-engine`29- Full game-studio orchestration → `game-dev`30- Pure WASM compute graphics without XR → `wasm-js`31- 3D Gaussian Splatting → `lichtfeld-studio`32- Generic non-Meta WebXR — this skill is Meta-ecosystem-specific3334## Quick Path3536**WebXR + React (recommended here):**37```bash38npm create vite@latest my-xr-app -- --template react-ts39cd my-xr-app40npm install three @react-three/fiber @react-three/xr ratk iwer @iwer/devui41```4243**Device management via hzdb:**44```bash45npx @meta-quest/hzdb mcp server # MCP server for AI-assisted management46npx @meta-quest/hzdb device list47npx @meta-quest/hzdb app install ./my-app.apk48npx @meta-quest/hzdb perf trace start --duration 1049```5051**Mixed reality (passthrough + scene understanding):** request MR features via52`ARButton`, then drive plane/mesh/anchor callbacks with RATK's53`RealityAccelerator`. Full example in54[`references/ecosystem.md`](references/ecosystem.md#mixed-reality-passthrough--scene-understanding).5556## The Ecosystem (pointers)5758Load [`references/ecosystem.md`](references/ecosystem.md) for detail on:5960- **WebXR toolkits** — IWER (emulation), RATK (MR utilities), @react-three/xr,61 with API surfaces and runnable examples62- **Native spatial** — Meta Spatial SDK (ECS, physics, samples), Horizon63 Platform SDK (17 API packages)64- **hzdb CLI + MCP server** — 40+ tools across Device/App/Capture/Perf/Files/65 Docs/Shell/Logs/ADB66- **Unity MCP Extensions** — 10 tools for VR/MR rig, interaction, teleport67- **Agentic VR skills** — Meta's 13 `@meta-quest/agentic-tools` skills68- **npm packages, GitHub repos, platform matrix, WebXR performance targets,69 related skills, external docs**