Nlp

Use when choosing how to tokenize text or which transformer type fits an NLP task, when a tokenizer over-fragments non-English text or inflates token cost, when picking a language metric, or when classification, NER or summarization output looks wrong and it is unclear whether the tokenizer, the architecture or the metric is at fault. Covers subword tokenizers, encoder versus decoder versus encoder-decoder choice, sentence embeddings, and the metric families. NOT retrieval or vector search (that is `embeddings-search`), NOT the RAG loop (that is `rag`), NOT prompt wording (that is `prompt-engineering`), NOT training the network (that is `finetuning`).

ericrisco Updated 610 repo stars
rsc-harness: you build the product, rsc-harness builds your agent's harness, following strict best practices instead of improvising one.

File contents

ericrisco/rsc-harness commit 5918f425f9

Frequently asked questions

npx get-skill add ericrisco/nlp