deemoliu opened a new pull request, #10826: URL: https://github.com/apache/pinot/pull/10826
Bug fix for #10800 The current behavior of Upsert ValidDocIds Snapshot is, we took snapshot when removeSegments. However there might be PKs (e.g. pk1) that marked as invalid because same PK appears in the new consuming segment. When it happens, the snapshot will be persisted with invalid pk1. When restart, the new consuimg segment will be discard and re-ingested, then it will cause inconsistency because we will load ValidDocIds Snapshot instead of build ValidDocsIndexes. `bugfix` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
