jihoonson commented on issue #8257: Add support for parallel native indexing with shuffle for perfect rollup URL: https://github.com/apache/incubator-druid/pull/8257#issuecomment-521786344 Thank you for the review. > currently, user needs to set `totalNumMergeTasks` which by default is set to a static value of 10. as a follow up, it would be great to change the default value dynamically based on size of data, number of partitions, number of segment intervals etc ... so that default behavior just works for most cases. Yes, the number of merge tasks can be automatically computed in the future. `PartitionStat` was added to collect some statistics which could be useful for such computation. I think it would be pretty cool if we support it, but not sure when I can work on it yet. Will try to do it before 0.17.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
