jihoonson edited a comment on issue #5492: Native parallel batch indexing without shuffle URL: https://github.com/apache/incubator-druid/pull/5492#issuecomment-410923528 @josephglanville in perfect roll-up, all rows which have the timestamp falling in the same interval should be in the same segment. If input data is already partitioned by timestamp, I think your idea would be nice. However, generally, we can't guarantee that data is already partitioned by their timestamp, and thus the shuffle phase is inevitable. @drcrallen thanks for the review! I'm going to resolve conflicts and merge this PR shortly.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@druid.apache.org For additional commands, e-mail: commits-h...@druid.apache.org
