Dataset Domain Token Counts Via Metadata Config

Use when a HuggingFace dataset task asks for token counts or filtering by a named domain and the dataset has multiple configs, only one of which contains domain and token-text columns.

ruc-nlpir Updated 23 repo stars

File contents

ruc-nlpir/flashrsi commit 34774081d0

Frequently asked questions

npx get-skill add ruc-nlpir/dataset-domain-token-counts-via-metadata-config