GitHub (Microsoft) Qdrant Scaling
First determine what you're scaling for:
- data volume
- query throughput (QPS)
- query latency
- query volume
After determining the scaling goal, we can choose scaling strategy based on tradeoffs and assumptions. Each pulls toward different strategies. Scaling for throughput and latency are opposite tuning directions.
Scaling Data Volume
This becomes relevant when volume of the dataset exceeds the capacity of a single node. Read more about scaling for data volume in Scaling Data Volume
Scaling for Query Throughput
If your system needs to handle more parallel queries than a single node can handle, then you need to scale for query throughput.
Read more about scaling for query throughput in Scaling for Query Throughput
Scaling for Query Latency
Latency of a single query is determined by the slowest component in the query execution path. It is in sometimes correlated with throughput, but not always. It might require different strategies for scaling.
Read more about scaling for query latency in Scaling for Query Latency
Scaling for Query Volume
By query volume we understand the amount of results that a single query returns. If the query volume is too high, it can cause performance issues and increase latency.
Tuning for query volume is opposite might require special strategies.
Read more about scaling for query volume in Scaling for Query Volume