Minecraft Training Data Capture Tool
Enable or disable automatic capture of training samples for perception model training.
Purpose
Captures paired partial-observation inputs and ground truth derived from Minecraft world state:
- Partial Observation Grid: Current
local_gridstate (radius 10, 21×21×21 voxels) - Ground Truth Grid: Full observable grid (radius 12, 25×25×25 voxels) - optional, requires bridge endpoint
- Agent Context: Pose, movement state, inventory summary
Input
enable: Boolean - Enable (true) or disable (false) capture (default:true)sample_interval: Integer - Capture sample every N position changes (default:5)include_ground_truth: Boolean - Iftrue, fetch ground truth from bridge/ground-truthendpoint (default:false, slower)minecraft_url: String - Bridge URL for ground truth (optional, defaults toMINECRAFT_URLenv var)
Output
Returns uniform return format with:
status:"success"or"failed"value: Human-readable status messageextra.enabled: Boolean indicating if capture is enabledextra.sample_interval: Capture interval (if enabled)extra.include_ground_truth: Whether ground truth is included (if enabled)
Storage
Training samples are saved to:
- Disk:
scenarios/minecraft/training_data/sample_{timestamp_ms}.json.zst(Zstd compressed) - Memory: Last 10 samples in
executor.world_state["training_samples"]
Usage
Enable capture (partial grid only, faster):
{"type": "mc-training-capture", "enable": true, "sample_interval": 5}
Enable capture with ground truth (slower, requires bridge endpoint):
{"type": "mc-training-capture", "enable": true, "include_ground_truth": true, "sample_interval": 10}
Disable capture:
{"type": "mc-training-capture", "enable": false}
Notes
- Capture is disabled by default - must be explicitly enabled
- Samples are captured automatically on position changes (when agent moves)
- Ground truth capture requires bridge
/ground-truthendpoint (Phase 2) - Samples are compressed with Zstd if available, otherwise stored as JSON
- Directory is created automatically if it doesn't exist