Skip to content

Commit

Permalink
[DOCS] Adds more detail on disk usage of kNN quantized vectors (elast…
Browse files Browse the repository at this point in the history
…ic#105724)

Co-authored-by: Liam Thompson <[email protected]>
Co-authored-by: Benjamin Trent <[email protected]>
(cherry picked from commit 6073e74)
  • Loading branch information
szabosteve committed Feb 22, 2024
1 parent a153981 commit da5ae68
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion docs/reference/how-to/knn-search.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,9 @@ The default <<dense-vector-element-type,`element_type`>> is `float`. But this
can be automatically quantized during index time through
<<dense-vector-quantization,`quantization`>>. Quantization will reduce the
required memory by 4x, but it will also reduce the precision of the vectors and
increase disk usage for the field (by up to 25%).
increase disk usage for the field (by up to 25%). Increased disk usage is a
result of {es} storing both the quantized and the unquantized vectors.
For example, when quantizing 40GB of floating point vectors an extra 10GB of data will be stored for the quantized vectors. The total disk usage amounts to 50GB, but the memory usage for fast search will be reduced to 10GB.

For `float` vectors with `dim` greater than or equal to `384`, using a
<<dense-vector-quantization,`quantized`>> index is highly recommended.
Expand Down

0 comments on commit da5ae68

Please sign in to comment.