uschindler commented on issue #13158: URL: https://github.com/apache/lucene/issues/13158#issuecomment-3816890676
Hi, how about a MergePolicy that strips the full vectors? As read-only indexes are mostly optimized to one segment anyways, maybe add a MergePolicy that can do this somehow when doing a forceMerge? It would of course be important that the force merge runs isolated and merges all segemnts in one go. If it would split the segments and merges multiple times, you would have loss due to merging 2 segments without full vectors. This is why I think that the lossy operation should be done as a post-processing step and now glued into IndexWriter or the general merging algorithms. Still we need a way to tell the codec to disable full vectors, but this could be signalled with the type of merge (an extra "internal" IOContext flag added to the IOContext using our new IOContext-framework?) To prevent merging of such an index at a later stage, we can of course add flags to the index file. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
