Best Practices
Best Practices
- Use normalized embeddings - Set
normalize_embeddings=True - Force CPU mode - Set
CUDA_VISIBLE_DEVICES=""for stability - Add SQLite timeout - Use
timeout=30for concurrent access - Process in batches - 100-500 chunks per batch
- Track progress - Save after each batch for resumability
- Log errors - Capture failures for debugging