majiayu000 SetFit Few-Shot Skill
Capabilities
- Train SetFit models with few examples per class
- Configure contrastive learning settings
- Implement efficient classification pipelines
- Design few-shot training strategies
- Set up model evaluation
- Deploy lightweight classifiers
Target Processes
- intent-classification-system
Implementation Details
SetFit Advantages
- Few Examples: 8-16 examples per class
- No Prompts: No prompt engineering needed
- Fast Training: Minutes vs hours
- Small Models: Sentence transformer base
Training Process
- Contrastive fine-tuning of embeddings
- Classification head training
- Iterative sampling strategies
Configuration Options
- Base sentence transformer model
- Number of training examples
- Contrastive learning epochs
- Classification head architecture
- Evaluation metrics
Best Practices
- Diverse few-shot examples
- Balance class examples
- Use appropriate base model
- Validate on held-out data
Dependencies
- setfit
- sentence-transformers