RE: Drill error with large sort

2016-02-26 Thread Paul Friedman
Thanks for this, these parameters fixed it! ---Paul -Original Message- From: Abdel Hakim Deneche [mailto:adene...@maprtech.com] Sent: Thursday, February 25, 2016 5:32 PM To: user <user@drill.apache.org> Subject: Re: Drill error with large sort Not so short answer: In Drill

Re: Drill error with large sort

2016-02-25 Thread Abdel Hakim Deneche
Not so short answer: In Drill 1.5 (I assume you are using 1.5) we have an improved allocator that better tracks how much memory each operator is using. In your case it seems that the date has very wide columns that are causing Sort to choke on the very first batch of data (1024 records taking up

Re: Drill error with large sort

2016-02-25 Thread Jeff Maass
If you are open to changing the query: # try removing the functions on the 5th column # is there any way you could further limit the query? # does the query finish if u add a limit / top clause? # what do the logs say? From: Paul Friedman