jihoonson opened a new pull request #7547: Minor compaction URL: https://github.com/apache/incubator-druid/pull/7547 Fixes https://github.com/apache/incubator-druid/issues/7491. This PR is still WIP, but I think it includes all important changes. Remaining TODOs are mostly about adding more unit tests. I've been testing this PR in our in-house cluster for several days and it looks fine. This PR is slightly different from the proposal in #7491. I'll update the proposal shortly. This PR is marked as `Incompatible` because it introduces a new shardSpec. It's not possible to roll back after this PR. For rolling update while kafka/kinesis indexing service is running, any kind of overwriting tasks (including compaction task and index task) should be stopped first. Otherwise, kafka/kinesis index tasks might fail when they list segments with the new shardSpec generated by overwriting tasks.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
