benwtrent commented on PR #12582: URL: https://github.com/apache/lucene/pull/12582#issuecomment-1962157430
@naveentatikonda , I used lucene-util. It's an off-heap memory requirement reduction. Instead of having to load float32 values in memory, it will load byte values. HNSW does many random reads, this read behavior really needs to be in memory for it to be fast. It uses about 25% more disk as the raw float32 vectors are kept along with the quantized ones. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org
