rmuir commented on issue #15420: URL: https://github.com/apache/lucene/issues/15420#issuecomment-3524905502
> Modern storage devices (SSDs, NVMe) can handle random writes efficiently and support concurrent writes to different file regions. Random access writes could enable parallel construction of index structures, significantly reducing total write time. Lucene already has parallel construction: just index with multiple threads. I agree with Uwe here, I think these datastructures are just not very efficient and not integrated well. With a quick search, you can find alternatives for ANN that are more sympathetic to the hardware and use sequential access. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
