How to deal with Parquet files containing no rows without Drill errors?

2018-05-24 Thread Dave Challis
We've got some processes that dump some reporting data as a bunch of parquet files, then runs queries involving joins with those tables (i.e. we have a main table which is always non-empty, then a number of link tables which join against which can be empty). The Parquet files contain schema

Re: Which perform better JSON or convert JSON to parquet format ?

2018-06-15 Thread Dave Challis
One gotcha with JSON vs parquet is that there's a longstanding bug that causes errors when trying to read from Parquet files containing 0 rows. For cases where we're converting from datasets that might be empty, we use JSON, and for everything else, Parquet.

Re: Web console responsiveness under heavy load

2018-07-02 Thread Dave Challis
Khatua wrote: > Are you running the query through the WebUI? What are the memory settings > of your Drillbit? > > On 6/26/2018 7:45:30 AM, Dave Challis wrote: > Are there any recommended Drill settings to configure in order to ensure > that the web console (running on 8047) remai

Web console responsiveness under heavy load

2018-06-26 Thread Dave Challis
Are there any recommended Drill settings to configure in order to ensure that the web console (running on 8047) remains responsive even under heavy load? Currently, if I execute a large/complex query (that e.g. takes 5m to complete), all queries to 8047 just block until the query completes. I'd

Re: Web console responsiveness under heavy load

2018-07-03 Thread Dave Challis
tor the queries in flight, etc. > > On 6/30/2018 12:18:23 AM, Kunal Khatua wrote: > Are you running the query through the WebUI? What are the memory settings > of your Drillbit? > > On 6/26/2018 7:45:30 AM, Dave Challis wrote: > Are there any recommended Drill settings to

Re: Documentation for maths operations between different types?

2019-08-16 Thread Dave Challis
so that it can be added > to the documentation. > > Thanks, > - Paul > > > > On Thursday, August 15, 2019, 03:55:11 AM PDT, Dave Challis < > dave.chal...@cipher.ai> wrote: > > Is there any documentation out there on how mathematical functions are > handle

Documentation for maths operations between different types?

2019-08-15 Thread Dave Challis
Is there any documentation out there on how mathematical functions are handled when operating on different types? E.g.: * would integer division of 1 / 2 produce a float or double of 0.5? Or an integer of the same type set to 0? * if two INT are multipled and produce a result larger than INT