rmuir commented on pull request #557: URL: https://github.com/apache/lucene/pull/557#issuecomment-998899509
Might be easiest to prototype a new DocValuesFormat (I would fork the existing Lucene90 as a start)? That's how I would attack the problem. Then I'd try to remove (at least some) usages of stuff like `DirectReader` and instead use iterators that decompress FOR/PFOR blocks, much like the postings lists? It's a heavy duty investigation / big task, as there are two cases (dense and sparse). For dense case if we want docid 500, we know how to get to its value (`500 % BLOCKSIZE`). For the sparse case, some docs may be missing: perhaps we also need skipdata, again like the postings does. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
