core_text operator reference
Per-operator API documentation for DataFlow's core_text family. Consult it when
you need an operator's exact constructor and run() signature, its real
row-processing behaviour, or the mistakes that break it.
Do not invoke this as a skill. There is no workflow here. The
generating-dataflow-pipeline skill reads these files when it needs an operator
beyond its six core primitives.
Layout
core_text/<category>/<operator>/
├── SKILL.md English reference: constructor, run(), execution logic,
│ mandatory rules, return-value semantics
├── SKILL_zh.md Chinese translation
└── examples/
├── good.md Best-practice pipeline usage
└── bad.md Common mistakes and how they fail
What is documented
| Category |
Path |
Operators |
| Generate |
generate/ |
PromptedGenerator, FormatStrPromptedGenerator, Text2MultiHopQAGenerator, BenchAnswerGenerator, ChunkedPromptedGenerator, EmbeddingGenerator, RandomDomainKnowledgeRowGenerator, RetrievalGenerator |
| Filter |
filter/ |
GeneralFilter, KCenterGreedyFilter, PromptedFilter |
| Refine |
refine/ |
PandasOperator, PromptedRefiner |
| Eval |
eval/ |
BenchDatasetEvaluator, BenchDatasetEvaluatorQuestion, PromptedEvaluator, Text2QASampleEvaluator, UnifiedBenchDatasetEvaluator |
How to use it
- Find the operator's directory under its category.
- Read its
SKILL.md for the authoritative signature.
- Check that operator's
bad.md example before writing code — it documents the
failure modes that come up most often.
Accuracy and scope
These are static reference docs, aligned to a specific DataFlow version
(recorded in VERSION.md in this directory). They are not a live query.
When an MCP server is available, get_operator_detail_by_name is authoritative:
it reflects the operators actually installed. Prefer it, and treat a
disagreement with these files as this reference being out of date.
Adding an operator
- Create
core_text/<category>/<operator-slug>/ containing SKILL.md, its
SKILL_zh.md translation, plus good.md and bad.md under examples/.
- Add the operator to the category table above. Add a rule to
../generating-dataflow-pipeline/SKILL.md only when it changes operator
selection policy; the planner reads this index on demand.
1---2name: core-text3description: Reference documentation for DataFlow's core_text operators — 8 generators, 3 filters, 2 refiners and 5 evaluators. Read by generating-dataflow-pipeline when a task needs an operator beyond the six core primitives. This is a reference package, not a workflow: it is consulted, never invoked directly.4---56# core_text operator reference78Per-operator API documentation for DataFlow's `core_text` family. Consult it when9you need an operator's exact constructor and `run()` signature, its real10row-processing behaviour, or the mistakes that break it.1112**Do not invoke this as a skill.** There is no workflow here. The13`generating-dataflow-pipeline` skill reads these files when it needs an operator14beyond its six core primitives.1516## Layout1718```19core_text/<category>/<operator>/20├── SKILL.md English reference: constructor, run(), execution logic,21│ mandatory rules, return-value semantics22├── SKILL_zh.md Chinese translation23└── examples/24 ├── good.md Best-practice pipeline usage25 └── bad.md Common mistakes and how they fail26```2728## What is documented2930| Category | Path | Operators |31| --- | --- | --- |32| Generate | `generate/` | `PromptedGenerator`, `FormatStrPromptedGenerator`, `Text2MultiHopQAGenerator`, `BenchAnswerGenerator`, `ChunkedPromptedGenerator`, `EmbeddingGenerator`, `RandomDomainKnowledgeRowGenerator`, `RetrievalGenerator` |33| Filter | `filter/` | `GeneralFilter`, `KCenterGreedyFilter`, `PromptedFilter` |34| Refine | `refine/` | `PandasOperator`, `PromptedRefiner` |35| Eval | `eval/` | `BenchDatasetEvaluator`, `BenchDatasetEvaluatorQuestion`, `PromptedEvaluator`, `Text2QASampleEvaluator`, `UnifiedBenchDatasetEvaluator` |3637## How to use it38391. Find the operator's directory under its category.402. Read its `SKILL.md` for the authoritative signature.413. Check that operator's `bad.md` example before writing code — it documents the42 failure modes that come up most often.4344## Accuracy and scope4546These are **static reference docs**, aligned to a specific DataFlow version47(recorded in `VERSION.md` in this directory). They are not a live query.4849When an MCP server is available, `get_operator_detail_by_name` is authoritative:50it reflects the operators actually installed. Prefer it, and treat a51disagreement with these files as this reference being out of date.5253## Adding an operator54551. Create `core_text/<category>/<operator-slug>/` containing `SKILL.md`, its56 `SKILL_zh.md` translation, plus `good.md` and `bad.md` under `examples/`.572. Add the operator to the category table above. Add a rule to58 `../generating-dataflow-pipeline/SKILL.md` only when it changes operator59 selection policy; the planner reads this index on demand.