Results for “tokenization”
22 skills
lingxling gtars
High-performance toolkit for genomic interval analysis in Rust with Python bindings. Use when working with genomic regions, BED files, coverage tracks, overlap detection, tokenization for ML models, or fragment analysis in computational genomics and machine learning applications.
253 · bundle
tianhao909 sentencepiece
Language-independent tokenizer treating text as raw Unicode. Supports BPE and Unigram algorithms. Fast (50k sentences/sec), lightweight (6MB memory), deterministic vocabulary. Used by T5, ALBERT, XLNet, mBART. Train on raw text without pre-tokenization. Use when you need multilingual support, CJK languages, or reproducible tokenization.
1 · bundle
qcmuu sentencepiece
Language-independent tokenizer treating text as raw Unicode. Supports BPE and Unigram algorithms. Fast (50k sentences/sec), lightweight (6MB memory), deterministic vocabulary. Used by T5, ALBERT, XLNet, mBART. Train on raw text without pre-tokenization. Use when you need multilingual support, CJK languages, or reproducible tokenization.
0 · bundle
k-dense-ai gtars
High-performance toolkit for genomic interval analysis in Rust with Python bindings. Use when working with genomic regions, BED files, coverage tracks, overlap detection, tokenization for ML models, or fragment analysis in computational genomics and machine learning applications.
30.2k · bundle
orchestra-research sentencepiece
Train and use SentencePiece tokenizers for multilingual NLP, supporting BPE and Unigram algorithms with raw Unicode text.
10.4k · bundle
More results
timlai666 gtars
High-performance toolkit for genomic interval analysis in Rust with Python bindings. Use when working with genomic regions, BED files, coverage tracks, overlap detection, tokenization for ML models, or fragment analysis in computational genomics and machine learning applications.
1 · bundle
srednoff888-art design-token-compiler
Use for UI/UX and design-system work when Codex should convert visual direction or existing UI into reusable design tokens.
1 · bundle
owl-listener theming-system
Design a theming architecture that supports brand variants, dark mode, and high-contrast modes with token mapping.
1.7k
bankrbot aeon-token-pick
Generates at most one token recommendation and one prediction-market pick per run, each with a falsifiable thesis, entry, sizing, and kill criterion. Returns NO_PICK when no candidate meets the bar.
1.2k · bundle
bankrbot botcoin-miner
Mine BOTCOIN tokens by solving AI-generated challenges and submitting on-chain proofs on Base.
1.2k · bundle
nickgallick token-standards
Token Standards
0
aiweline context-compression
上下文压缩省 Token。对话变长或开新任务时输出/使用 6 块压缩结构，总长 400~800 tokens。必加载。
1
trailofbits fuzzing-dictionary
Guides fuzzers with domain-specific tokens to reach deeper code paths in parsers, protocol handlers, and file format processors.
6k · bundle
owl-listener naming-convention
Establish clear naming conventions for design assets, components, and tokens to make design systems predictable and maintainable.
1.7k
tinh2 i18n
Sets up internationalization by extracting hardcoded user-facing strings to locale files, auto-detecting the framework, configuring the appropriate i18n library, handling pluralization, formatting, and RTL support.
13
levalencia gtars
High-performance toolkit for genomic interval analysis in Rust with Python bindings. Use when working with genomic regions, BED files, coverage tracks, overlap detection, tokenization for ML models, or fragment analysis in computational genomics and machine learning applications.
3 · bundle
tinh2 save-tokens
Builds a local knowledge graph of a codebase using tree-sitter and graph algorithms, then answers architecture questions by querying the graph instead of reading many files, saving tokens.
13
enuno bankr-dev-token-trading
This skill should be used when building trading bots, implementing swap functionality, or adding cross-chain bridge support. Covers same-chain swaps, cross-chain bridges, ETH/WETH conversions, and amount formats.
1
jackychenlu gtars
High-performance toolkit for genomic interval analysis in Rust with Python bindings. Use when working with genomic regions, BED files, coverage tracks, overlap detection, tokenization for ML models, or fragment analysis in computational genomics and machine learning applications.
0 · bundle
metinduraktr-44 gtars
High-performance toolkit for genomic interval analysis in Rust with Python bindings. Use when working with genomic regions, BED files, coverage tracks, overlap detection, tokenization for ML models, or fragment analysis in computational genomics and machine learning applications.
0 · bundle
chen-yu-hao gtars
High-performance toolkit for genomic interval analysis in Rust with Python bindings. Use when working with genomic regions, BED files, coverage tracks, overlap detection, tokenization for ML models, or fragment analysis in computational genomics and machine learning applications.
5 · bundle
vikingokft wc-payment-tokens
Manage WooCommerce saved payment methods via WC_Payment_Tokens and WC_Payment_Token_CC, covering token creation, retrieval, validation, attachment to orders, and deletion with proper nonce and ownership checks.
0