Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Should we add a new "BulkScoreVectors" type api to the vector scorer interfaces? #14013

Open
benwtrent opened this issue Nov 22, 2024 · 0 comments

Comments

@benwtrent
Copy link
Member

Description

With pre-fetching and newer quantization methods (e.g. the currently WIP bit quantization technique), it might be beneficial to have a clean interface indicating you want the scores for a handful of vectors.

I can see this helping with HNSW by allowing exploration to prefetch and then score all neighbors of the current candidate vector.

For higher levels of quantization quantization, since multiple corrective values need to be applied to the scored outputs, its conceivable that these corrections could be vectorized if multiple vectors were scored at the same time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant