kfaraz commented on PR #14677: URL: https://github.com/apache/druid/pull/14677#issuecomment-1656119092
> Ah, no, because the code here runs on worker tasks after the splits have already been made by the main task. (Or on the Overlord to do sampling, where there is no parallelism anyway.) It is using createSplits simply as a way of getting the list of objects out of prefixes, objects, or uris. Ah, I see. Thanks for the clarification! > You can especially tell it doesn't matter because the splits are flatMap together anyway. Yes, fair point. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
