Re: About integration of drill and arrow

We experienced the same issue on first "null" value tripping up Drill's schema on-demand logic that assumes certain data type for "null" causing subsequent exception when a non-null is encountered. We added logic inside our storage plugin to make this work. But good to hear there is a general sol

Re: About integration of drill and arrow

Hi Ted, Thanks much for the feedback! Good test cases indeed. The good news is that we're close to finishing a "V2" JSON reader that smooths over a few more JSON quirks like the "first column null" issue that can cause problems: {n: 1, v: null}{n: 2, v: "Gotcha! Wasn't Int, is actually VARCHAR!

Re: About integration of drill and arrow

On Wed, Jan 15, 2020 at 2:58 PM Paul Rogers wrote: > ... > > For example, Ted, you mention lack of nullability on structure members. > But, Drill represents structures as MAPs, and MAPs can have nullable > members. So, there is likely more to your request than the short summary > suggests. Perhap

Re: About integration of drill and arrow

; >> ------ Forwarded message - >> From: Igor Guzenko >> Date: Fri, Jan 10, 2020 at 1:46 PM >> Subject: Re: About integration of drill and arrow >> To: dev >> >> >> Hello Drill Developers and Drill Users, >> >> This discussion s

Re: About integration of drill and arrow

> wrote: > > > -- Forwarded message --------- > > From: Igor Guzenko > > Date: Fri, Jan 10, 2020 at 1:46 PM > > Subject: Re: About integration of drill and arrow > > To: dev > > > > > > Hello Drill Developers and Drill Users, > >

Re: About integration of drill and arrow

gt; On Fri, Jan 10, 2020 at 3:48 AM Igor Guzenko > wrote: > > > -- Forwarded message --------- > > From: Igor Guzenko > > Date: Fri, Jan 10, 2020 at 1:46 PM > > Subject: Re: About integration of drill and arrow > > To: dev > > > > > >

Re: About integration of drill and arrow

hings work. 3) Not widely adopted causing issues with finding experts to continue our work. -- Jiang On Fri, Jan 10, 2020 at 3:48 AM Igor Guzenko wrote: > -- Forwarded message - > From: Igor Guzenko > Date: Fri, Jan 10, 2020 at 1:46 PM > Subject: Re: About integra

Re: About integration of drill and arrow

wrote: > > > > -- Forwarded message ----- > > From: Igor Guzenko > > Date: Fri, Jan 10, 2020 at 1:46 PM > > Subject: Re: About integration of drill and arrow > > To: dev > > > > > > Hello Drill Developers and Drill Users, > >

Re: About integration of drill and arrow

convenient than California time. Thanks, -- C > On Jan 10, 2020, at 6:47 AM, Igor Guzenko wrote: > > -- Forwarded message - > From: Igor Guzenko > Date: Fri, Jan 10, 2020 at 1:46 PM > Subject: Re: About integration of drill and arrow > To: dev > >

Re: About integration of drill and arrow

Hi Igor, +1! Very well said! This is exactly the discussion we should have. Perhaps we can drive towards an overall project goal: a vision that helps us choose which of the many options we should select. Here is a suggestion: Drill should become to queries what Python is to data science: a fle