raghavyadav01 opened a new pull request, #17437: URL: https://github.com/apache/pinot/pull/17437
This PR adds support for building and managing Lucene docId mapping files for offline segments when `storeInSegmentFile` is enabled. The changes ensure that the docId mapping is pre-built during segment creation and properly cleaned up after being merged into the Pinot segment file. - Pre-build docId mapping during segment creation: When `storeInSegmentFile` is enabled, the docId mapping file is now built during segment creation so it's available during segment load without requiring on-the-fly construction. - Cleanup temporary mapping file: After the docIdMapping file has been successfully merged into the combined Pinot segment file, the temporary mapping file is deleted to avoid leaving orphaned files in the segment directory. Testing - Verified that docId mapping is built correctly when `storeInSegmentFile` is enabled - Confirmed that mapping files are properly included when combining Lucene index files - Validated that temporary mapping files are cleaned up after merging -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
