FLATTEN doesn't quite give me what I need

I am querying a Parquet file containing records for nested data: SELECT household, minutes, lditem_array FROM `dfs`.`root`.`./S/Beddo/spark/pig-xpdb` limit 1; This returns the first record, which contains an array LDItem. For the first record, LDItem is an array of 8 {} structures), like so:

Re: FLATTEN doesn't quite give me what I need

Have you tried using the flatten query as a sub-query? Like: SELECT x.`household`, x.`minutes`, x.`LDItem`.`upc`, x.`LDItem`.`item_flags` from (SELECT household, minutes, FLATTEN(T.lditem_array.LDItem) as `LDItem` FROM `dfs`.`root`.`./S/Beddo/spark/pig-xpdb` T limit 8) as x; ​ Chris Matta

Re: Using Drill JDBC V1.2 with V1.1 release

Nikunj Thakkar wrote: ... I'm using drill v1.1.0 in my current setup and facing dependency issues. I came across https://issues.apache.org/jira/browse/DRILL-3589 which seems to be the root cause of my problem. Issue got resolved in v1.2. Can I use it with 1.1 release? Has anyone tried this? I

Re: Using Drill JDBC V1.2 with V1.1 release

Hi Nikunj, What kind of dependcy issues you are seeing ? DRILL-3589 purpose was to improve Drill JDBC dependencies but I think the JDBC driver didn't have any "known" issues in 1.1 Thanks On Wed, Sep 30, 2015 at 12:02 PM, Daniel Barclay wrote: > Nikunj Thakkar wrote: >

Using Drill JDBC V1.2 with V1.1 release

Hi, I'm using drill v1.1.0 in my current setup and facing dependency issues. I came across https://issues.apache.org/jira/browse/DRILL-3589 which seems to be the root cause of my problem. Issue got resolved in v1.2. Can I use it with 1.1 release? Has anyone tried this? Thanks, Nikunj

Drill to S3 set up and core-site.xml

Hi. Trying to set up drill to talk to S3 bucket. Following http://drill.apache.org/blog/2014/12/09/running-sql-queries-on-amazon-s3/. I’ve noticed that in the Web UI I can’t update the storage configuration, if I have a core-site.xml file present in $DRILL_HOME/conf directory. As soon as I

Re: Using Drill JDBC V1.2 with V1.1 release

Hakim, Abdel Hakim Deneche wrote: Hi Nikunj, What kind of dependcy issues you are seeing ? DRILL-3589 purpose was to improve Drill JDBC dependencies but I think the JDBC driver didn't have any "known" issues in 1.1 Actually, it did have dependency problems, especially library-conflict

RE: CSV with windows carriage return causes issues

Looks like a bug to me. Can you raise a jira for this if you haven't done it already On Sep 30, 2015 8:04 AM, wrote: > I've seen that issue too... ;) > > My personal opinion is that Drill (and sqlline) should treat Windows > end-of-line characters the same as Unix

Protobuf Files

I am looking at trying to make use a of a large collection of Protobuf files. We have the schema definition, and at this time I understand that Drill does not have a reader for Protobuf files. *Disclosure: I am not a strong developer, thus me asking the questions. 1. What is the difficulty in

Re: CSV with windows carriage return causes issues

I have this already filled in under: https://issues.apache.org/jira/browse/DRILL-3726 On Wed, Sep 30, 2015 at 11:47 AM, rahul challapalli < challapallira...@gmail.com> wrote: > Looks like a bug to me. Can you raise a jira for this if you haven't done > it already > On Sep 30, 2015 8:04 AM,