kaivalnp commented on PR #16710: URL: https://github.com/apache/lucene/pull/16710#issuecomment-5934255745
Thanks for the benchmarks @Pranshu-S! Could you run them with `filterStrategy = index-time-filter`, to see whether de-duplication correctly occurs for FP16 vectors? Could you also change the baseline to scalar quantized FP16 vectors using the "vanilla" (non-dedup) format? Looking to confirm whether recall is comparable b/w the two (which I think it will be, based on the above benchmark). Might be worth checking all quantization levels too (8, 4, 2, 1-bit), for exercising the symmetric / asymmetric path as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
