Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add binary (single bit) KNN quantization option to knnPerfTest.py #317

Open
mikemccand opened this issue Nov 13, 2024 · 0 comments
Open

Comments

@mikemccand
Copy link
Owner

Currently knnPerfTest.py can test int4 and int7 KNN quantization (and float32, no quantization). Lucene also supports "simple binary quantization", though it's not so turnkey because the user must pre-quantize their vectors to single bit per dimension in byte[] vector form.

OpenSearch has such a binary quantizer to run outside of Lucene -- maybe we can poach that here? Or maybe improve Lucene so it can do this quantizing under the hood?

Lucene now also (soon?) has RabitQ inspired "better binary quantizer" which we should also add to knnPerfTest! So hard to keep up...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant