You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
With pre-fetching and newer quantization methods (e.g. the currently WIP bit quantization technique), it might be beneficial to have a clean interface indicating you want the scores for a handful of vectors.
I can see this helping with HNSW by allowing exploration to prefetch and then score all neighbors of the current candidate vector.
For higher levels of quantization quantization, since multiple corrective values need to be applied to the scored outputs, its conceivable that these corrections could be vectorized if multiple vectors were scored at the same time.
The text was updated successfully, but these errors were encountered:
Description
With pre-fetching and newer quantization methods (e.g. the currently WIP bit quantization technique), it might be beneficial to have a clean interface indicating you want the scores for a handful of vectors.
I can see this helping with HNSW by allowing exploration to prefetch and then score all neighbors of the current candidate vector.
For higher levels of quantization quantization, since multiple corrective values need to be applied to the scored outputs, its conceivable that these corrections could be vectorized if multiple vectors were scored at the same time.
The text was updated successfully, but these errors were encountered: