jon-wei commented on issue #7133: 6088 - Time Ordering On Scans URL: https://github.com/apache/incubator-druid/pull/7133#issuecomment-474640476 I don't think this needs to be something done in this PR, but it's worth mentioning that moving the "time chunking" behavior to the broker, and issuing several subqueries to the historical could be a possible optimization: This could help in situations like the following: - I want an ascending time scan with limit X, across three days worth of data, with DAY granularity segments - The first day of data has enough data to hit limit X - I have three historicals: the first has data for the first day, and the second has data for the second 2 day, and the third has data only for third day - With the current approach in this PR, historical 2 and 3 would also have to do work to answer this query (it would go and return up to limit X rows, even though none of them would be included in the final result set), when only historical 1 really needs to be queried - If the broker split the query up into daily subqueries, this would cut down on the overall workload across historicals This would require more change to the broker to be able to support this new type of query, so I think the current approach is fine for now.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@druid.apache.org For additional commands, e-mail: commits-h...@druid.apache.org
