# Setup Benchmark Inputs > Set up the minimal set of artifacts (tokenized DCLM corpus shard + released HuggingFace checkpoint converted to DCP) required to benchmark, profile, or regression-test a MoE model in PithTrain. Use when the user asks to "prepare benchmark inputs", "set up the benchmark workspace", "download the DCLM shard", "fetch and convert the released checkpoint", "tokenize DCLM for DeepSeek/Qwen3", or when a downstream skill (capture-nsys-profile, validate-correctness, or any short canonical run) needs its workspace pre-populated. Produce `workspace/datasets/dclm-baseline/toktxt/` and `workspace/checkpoints//torch-dcp/step-00000000`. Idempotent and safe to re-run. Use when this capability is needed. - Skill: `tomevault-io/setup-benchmark-inputs` (Agent Skill, multi-file: 2 files) - Install (CLI): `npx skillmds@latest add tomevault-io/setup-benchmark-inputs` - Raw SKILL.md: https://api.skillmd.com/api/skills/tomevault-io/setup-benchmark-inputs/raw - Safety review: pending (external: skill-scanner PASS, skillspector CAUTION) - Works with: Claude Code, Claude.ai, OpenAI Codex - Category: AI & ML - Author: tomevault-io (https://skillmd.com/u/tomevault-io) - Updated: 2026-09-17 - Page: https://skillmd.com/skills/tomevault-io/setup-benchmark-inputs --- # Setup Benchmark Inputs Setup the minimal artifacts needed to benchmark, profile, or regression-test a MoE model in PithTrain: a single DCLM corpus shard tokenized for the target model, and the released HuggingFace checkpoint converted to DCP format. Each step is idempotent (skips if its output already exists). ## Prerequisites - **Python environment**: activate `.venv` in the repo root (`source .venv/bin/activate`). ## Usage ```bash mkdir -p workspace/loggings # Single-node (DeepSeek-V2-Lite) bash .agents/skills/setup-benchmark-inputs/scripts/launch_setup.sh --model deepseek-v2-lite 2>&1 | tee workspace/loggings/setup-deepseek-v2-lite.log # Multi-node via SLURM (Qwen3-30B-A3B) srun -W 0 -o workspace/loggings/setup-qwen3-30b-a3b.log .agents/skills/setup-benchmark-inputs/scripts/launch_setup.sh --model qwen3-30b-a3b ``` --- > Source: [mlc-ai/Pith-Train](https://github.com/mlc-ai/Pith-Train) — distributed by [TomeVault](https://tomevault.io).