030104 Lancedb Hybrid

LanceDB hybrid search (vector + FTS with RRF), multivector search (ColBERT late interaction), and metadata filtering patterns.

natuleadan Updated

File contents

Hybrid & Multivector Search

Overview

Advanced search patterns combining vector and text search, multi-embedding late interaction models (ColBERT), and metadata filtering.

Quick Reference

Hybrid Search

vector search + FTS → RRF fusion → reranked results
const results = await table.search("query")
  .vector(queryVector)
  .text("search terms")
  .reranker(new RRFReranker(100))
  .toArray()

Multivector (ColBERT)

  • Late interaction: query tokens ↔ document tokens
  • MaxSim scoring for relevance
  • IVF_PQ index with cosine metric for multivector columns

Filtering

Approach When Performance
Pre-filter Before ANN Fast with scalar indexes
Post-filter After ANN May lose results
Push-down SQL pushdown Most efficient

References

  • Hybrid Search — Vector + FTS combination, RRF reranking
  • Multivector Search — ColBERT, late interaction, MaxSim scoring
  • Filtering — Pre/post filtering, SQL expressions, scalar indexes

natuleadan/skills/tree/main/skills/030104-lancedb-hybrid commit e8947ec18c

Frequently asked questions

npx skillmds@latest add natuleadan/030104-lancedb-hybrid