Re: How to force Drill to offload performing LIMIT onto the target storage?

2019-12-18 Thread Vova Vysotskyi
>From the code, it looks like it happens to all functions that are present in Drill even if such functions are part of the SQL standard (it was done since function behavior may not be strictly described by standard and therefore will be implementation-dependent). But functions that absent in Drill

Re: How to force Drill to offload performing LIMIT onto the target storage?

2019-12-18 Thread Vova Vysotskyi
Hi Andrew, Drill in general case pushes aggregations into the JDBC storage, but Drill doesn't push functions into JDBC storage since some databases may not have specific function implementations. In the plan, you have provided, the grouping is produced on top of TO_DATE() function call. If it is

How to force Drill to offload performing LIMIT onto the target storage?

2019-12-18 Thread Andrew Pashkin
Hello! I have a setup where I'm querying Impala server through JDBC connection using Drill and I noticed that when I'm doing a simple GROUP BY query with LIMIT with a small value the query runs for a very long time. And in the query profile I see that hundreds of thousands of rows are being