gianm opened a new issue #6087: Synchronized segment allocation URL: https://github.com/apache/incubator-druid/issues/6087 Today, when SegmentAllocateAction is run by multiple threads at once, it can end up doing a lot of internal retries due to its SELECT -> INSERT logic (see `allocatePendingSegment` in IndexerSQLMetadataStorageCoordinator). There isn't much point in running concurrent allocations for the same datasource anyway, and the contention causes retries which add delay due to sleeps. It might work better to synchronize allocations on a per-datasource basis, so only one can happen at a time per datasource.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
