-
Notifications
You must be signed in to change notification settings - Fork 199
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add support for 1024+ dim vectors in CAGRA search #1994
Add support for 1024+ dim vectors in CAGRA search #1994
Conversation
|
/ok to test |
…s0/raft into CAGRA-remove-max_dim-template-param
…s0/raft into CAGRA-remove-max_dim-template-param
…s0/raft into CAGRA-remove-max_dim-template-param
/ok to test |
…A-remove-max_dim-template-param
…s0/raft into CAGRA-remove-max_dim-template-param
/ok to test |
/ok to test |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM! This is an important feature and we have folks from Lucene and Lantern waiting on this. These changes look good, but we can follow up if anyone else sees any issues.
/merge |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @enp1s0 for the PR, it looks good to me.
This PR updates the CAGRA search implementation to support 1024+ dim vectors.
For 1024+ dim vectors, the distance between a vector and the query vector is calculated by splitting the vector into multiple 1024 dim vectors and accumulating the distances of each sub-vector.
Rel: #1948