rohanpsingh /eval — Evaluate a Trained Checkpoint
Parse the user's request from $ARGUMENTS and run evaluation.
Command Template
uv run python run_experiment.py eval --path <PATH> [OPTIONS...]
Path Resolution
The user may provide:
- A .pt file: Use directly (
--path /tmp/.../actor_999.pt) - A run directory: Contains actor*.pt files (
--path /tmp/.../26-03-07-00-26-36_cartpole/) - A logdir: Contains timestamped run subdirectories (
--logdir /tmp/training_runs)
If no path is given, check /tmp/training_runs for the most recent run.
Use Glob to verify the path exists and resolve it before running.
Options
| Flag | Default | Description |
|---|---|---|
--ep-len |
10 | Episode length in seconds |
--seed |
None | Random seed for reproducible eval |
--out-dir |
None | Directory to save videos |
Instructions
- Resolve the model path from the user's input. If ambiguous, list available checkpoints and ask.
- Show the user which checkpoint will be evaluated (full path).
- Run the eval command. This opens an interactive MuJoCo viewer window — it is NOT a background job.
- Report the results when done.