How do I install the Wandb Eval Tables skill?

Run npx skillmds add wandb/wandb-eval-tables in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.

Is Wandb Eval Tables safe to use?

This skill has not completed SkillMD's automated safety review yet. Capability flags: executes scripts. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.

Which AI agents work with Wandb Eval Tables?

This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.

Is Wandb Eval Tables free to use?

Yes. Installing skills from SkillMD is free, and the skill stays under its author's original license.

Who published Wandb Eval Tables?

wandb (@wandb) published this skill. Their other Agent Skills are listed on their SkillMD profile.

Wandb Eval Tables by wandb — Agent Skill

Name: Wandb Eval Tables
Rating: 4.2 (5 reviews)
Author: wandb

Wandb Eval Tables

Convert W&B Table artifacts into non-destructive EvalTable previews with scan-first planning, typed input/output/score columns, bounded batches, verification, and safe removal. Use when a coding agent needs to create, inspect, compare, verify, or remove W&B EvalTable previews.

wandb 6418ec6 4 files · 132.9 KB Updated Sep 9, 2026

File contents

W&B EvalTable previews

Use the bundled helper to preview existing wandb.Table data as wandb.EvalTable data. A preview creates new runs and keys; it never overwrites the source runs or tables.

Read references/EVAL_TABLES.md before converting. It is the canonical source for EvalTable semantics, source selection, limits, column roles, verification, and removal.

Environment

Run the helper from an environment that provides a W&B SDK with wandb.EvalTable and Weave. Use uv to supply missing dependencies:

uv run --with 'wandb[workspaces]>=0.28.1' --with weave \
  python skills/wandb-eval-tables/scripts/table_artifact_to_eval_table.py --help

Credentials and default scope may come from WANDB_API_KEY, WANDB_ENTITY, and WANDB_PROJECT; otherwise pass explicit entity/project arguments. Downloads use the operating system's temporary directory, not a fixed current working directory.

Required workflow

Choose the narrowest source that matches the request: exact artifact, one run, one sweep, or a project/workspace. Do not broaden an explicitly named source.
Run scan. This is read-only preflight and is not proof of conversion.
Review eligible_summary_by_table_key, table shapes, truncations, warnings, and existing-preview metadata. Select one table key unless the user asks for a broader batch.
Classify columns only when confident. Input tuples must uniquely identify rows; score columns must be numeric or boolean; free-text labels and rationales are outputs. Leave ambiguous tables untyped.
Run preview for exactly one --table-key per invocation. Keep the target in the source project unless the user requests another writable project.
If runs were created, run verify-preview on the final created run and the exact logged key. Report success only when it returns verified: true.
Report created and skipped sources plus every truncation or failed check.

T=skills/wandb-eval-tables/scripts/table_artifact_to_eval_table.py

uv run python "$T" scan \
  --source-workspace ENTITY/PROJECT --max-runs 4

uv run python "$T" preview \
  --source-workspace ENTITY/PROJECT \
  --target-project ENTITY/PROJECT \
  --max-runs 4 \
  --table-key predictions

uv run python "$T" verify-preview \
  --run ENTITY/PROJECT/PREVIEW_RUN_ID \
  --table-key predictions_preview

Safety

scan and preview --dry-run are read-only. preview creates W&B runs, EvalTables, and Weave evaluations; run it only when the user requested a conversion.
The helper caps tables at 10,000 rows and 100 columns, warns above 1,000 rows, and refuses more than 50 eligible table artifacts for one key. Surface every cap; never imply a truncated preview is complete.
Do not bypass helper failures with ad-hoc logging. Narrow or correct helper arguments, then retry only when the change is safe.
Removal deletes both Weave evaluations and preview runs. Run delete-preview --dry-run first, verify every target is helper-created, and obtain confirmation before the irreversible invocation. Never delete source runs.

---name: wandb-eval-tablesdescription: Convert W&B Table artifacts into non-destructive EvalTable previews with scan-first planning, typed input/output/score columns, bounded batches, verification, and safe removal. Use when a coding agent needs to create, inspect, compare, verify, or remove W&B EvalTable previews.--- # W&B EvalTable previews Use the bundled helper to preview existing `wandb.Table` data as `wandb.EvalTable` data. A preview creates new runs and keys; it never overwrites the source runs or tables. Read `references/EVAL_TABLES.md` before converting. It is the canonical source for EvalTable semantics, source selection, limits, column roles, verification, and removal. ## Environment Run the helper from an environment that provides a W&B SDK with `wandb.EvalTable` and Weave. Use `uv` to supply missing dependencies: ```bash uv run --with 'wandb[workspaces]>=0.28.1' --with weave \ python skills/wandb-eval-tables/scripts/table_artifact_to_eval_table.py --help ``` Credentials and default scope may come from `WANDB_API_KEY`, `WANDB_ENTITY`, and `WANDB_PROJECT`; otherwise pass explicit entity/project arguments. Downloads use the operating system's temporary directory, not a fixed current working directory. ## Required workflow 1. Choose the narrowest source that matches the request: exact artifact, one run, one sweep, or a project/workspace. Do not broaden an explicitly named source. 2. Run `scan`. This is read-only preflight and is not proof of conversion. 3. Review `eligible_summary_by_table_key`, table shapes, truncations, warnings, and existing-preview metadata. Select one table key unless the user asks for a broader batch. 4. Classify columns only when confident. Input tuples must uniquely identify rows; score columns must be numeric or boolean; free-text labels and rationales are outputs. Leave ambiguous tables untyped. 5. Run `preview` for exactly one `--table-key` per invocation. Keep the target in the source project unless the user requests another writable project. 6. If runs were created, run `verify-preview` on the final created run and the exact logged key. Report success only when it returns `verified: true`. 7. Report created and skipped sources plus every truncation or failed check. ```bash T=skills/wandb-eval-tables/scripts/table_artifact_to_eval_table.py uv run python "$T" scan \ --source-workspace ENTITY/PROJECT --max-runs 4 uv run python "$T" preview \ --source-workspace ENTITY/PROJECT \ --target-project ENTITY/PROJECT \ --max-runs 4 \ --table-key predictions uv run python "$T" verify-preview \ --run ENTITY/PROJECT/PREVIEW_RUN_ID \ --table-key predictions_preview ``` ## Safety - `scan` and `preview --dry-run` are read-only. `preview` creates W&B runs, EvalTables, and Weave evaluations; run it only when the user requested a conversion. - The helper caps tables at 10,000 rows and 100 columns, warns above 1,000 rows, and refuses more than 50 eligible table artifacts for one key. Surface every cap; never imply a truncated preview is complete. - Do not bypass helper failures with ad-hoc logging. Narrow or correct helper arguments, then retry only when the change is safe. - Removal deletes both Weave evaluations and preview runs. Run `delete-preview --dry-run` first, verify every target is helper-created, and obtain confirmation before the irreversible invocation. Never delete source runs.

Frequently asked questions