kfaraz commented on PR #19016: URL: https://github.com/apache/druid/pull/19016#issuecomment-4022475098
Thanks, @GWphua ! In #19059 , compaction tasks will use `REPLACE` locks which are mutually exclusive with each other. So, at any time, only a single compaction task can be running for an interval. But there can be any number of concurrent `APPEND` jobs that may be writing to the same interval. Supporting multiple concurrent `REPLACE` tasks on the same interval would have to be a future enhancement. Meanwhile, with the support of minor compaction coupled with compaction supervisors (which are much more reactive in scheduling compaction jobs as compared to the old-style compaction duty on the Coordinator), I feel that compaction would be fast enough that we would not need to launch multiple jobs for the same interval together anyway. Please let me know if that answers your question. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
