Re: [ANNOUNCE] New PMC Chair of Apache Drill

2019-08-23 Thread Robert Hou
Congratulations Charles, and thanks for your contributions to Drill! Thank you Arina for all you have done as PMC Chair this past year. --Robert On Fri, Aug 23, 2019 at 4:16 PM Khurram Faraaz wrote: > Congratulations Charles, and thank you Arina. > > Regards, > Khurram > > On Fri, Aug 23,

Re: [ANNOUNCE] New Committer: Bohdan Kazydub

2019-07-16 Thread Robert Hou
Congratulations, Bohdan. Thanks for contributing to Drill! --Robert On Tue, Jul 16, 2019 at 11:50 AM hanu mapr wrote: > Congratulations Bohdan! > > On Tue, Jul 16, 2019 at 9:30 AM Gautam Parai wrote: > > > Congratulations Bohdan! > > > > Gautam > > > > On Mon, Jul 15, 2019 at 11:53 PM Bohdan

Re: Json to Parquet

2019-03-08 Thread Robert Hou
If you know the schema ahead of time, you can try creating a view. Using your xyz.json example: create view newxyz as select cast(address as varchar) address, cast(zipcode as int) zipcode from xyz.json; select * from newxyz; +-+--+ | address | zipcode |

Re: Drill connection using jdbc

2019-01-09 Thread Robert Hou
I had to restart drill after I changed drill-override.conf. --Robert On Wed, Jan 9, 2019 at 1:19 AM Robert Hou wrote: > I added zk.root to my drill-override.conf and it showed up in zookeeper, > and I can connect to the new zk.root. Since you don't have zk.root, then > you should u

Re: Drill connection using jdbc

2019-01-09 Thread Robert Hou
I added zk.root to my drill-override.conf and it showed up in zookeeper, and I can connect to the new zk.root. Since you don't have zk.root, then you should use "drill" in your connection URL. Thanks. --Robert On Wed, Jan 9, 2019 at 1:08 AM Robert Hou wrote: > Whe

Re: Drill connection using jdbc

2019-01-09 Thread Robert Hou
_www.sidra.org_=DwIGaQ=cskdkSMqhcnjZxdQVpwTXg=GXRJhB4g1YFDJsrcglHwUA=GzXrG3NEgyu3DwC61SjSD5gw0TYMT4GGi_jOLjSGttY=3IKZg-nDhsGJG70FdwBMabw_o0GCo_vADXVODbny7T8= > > > > > On 1/9/19, 11:34 AM, "Robert Hou" wrote: > > I would suggest connecting with drillbi

Re: Drill connection using jdbc

2019-01-09 Thread Robert Hou
I would suggest connecting with drillbit first, and if that works, I would use zookeeper. sqlline -u "jdbc:drill:drillbit=" Please note the quotation marks. If that works, then try: sqlline -u "jdbc:drill:zk=:port//" zk.root is "drill" by default. If you have specified zk.root in

Re: [ANNOUNCE] New Committer: Hanumath Rao Maduri

2018-11-01 Thread Robert Hou
Congratulations, Hanu. Thanks for contributing to Drill. --Robert On Thu, Nov 1, 2018 at 4:06 PM Jyothsna Reddy wrote: > Congrats Hanu!! Well deserved :D > > Thank you, > Jyothsna > > On Thu, Nov 1, 2018 at 2:15 PM Sorabh Hamirwasia > wrote: > > > Congratulations Hanu! > > > > Thanks, > >

Re: Requesting guidance. Having trouble generating parquet files from jdbc connection to PostgreSQL. "java.lang.OutOfMemoryError: GC overhead limit exceeded"

2018-08-15 Thread Robert Hou
I'm wondering if you can export the json from Postgres to a json document. And then write it to parquet using Drill. This link may have some ideas: https://hashrocket.com/blog/posts/create-quick-json-data-dumps-from-postgresql Thanks. --Robert On Wed, Aug 15, 2018 at 10:16 AM, Reid Thompson

Re: Drill 1.14.0 and mapr ODBC drivers (linux/macos)

2018-08-05 Thread Robert Hou
The current MapR ODBC and JDBC drivers are not compatible with the new Apache Drill 1.14. release. (Apache Drill ships with a JDBC driver that will work). There will be new MapR ODBC and JDBC drivers coming out with the new MapR Drill release to address this. Thanks. --Robert On Sun, Aug 5,

Re: Apache Drill and Tableau connectivity issue

2018-05-16 Thread Robert Hou
Did anything change on your system that might indicate why you cannot connect lately? Thanks. --Robert From: Robert Hou <r...@mapr.com> Sent: Wednesday, May 16, 2018 10:25 AM To: user@drill.apache.org Subject: Re: Apache Drill and Tableau connectivity

Re: Apache Drill and Tableau connectivity issue

2018-05-16 Thread Robert Hou
MapR Driver Version 1.3.0 seems quite old. It may not work with recent versions of Drill. What version of Drill are you running? Thanks. --Robert From: Andries Engelbrecht Sent: Wednesday, May 16, 2018 7:27 AM To:

Re: is there any way to download the data through Drill Web UI?

2018-05-15 Thread Robert Hou
I think BI tools should have a way to export the data to csv. Tableau does. Thanks. --Robert From: Saurabh Mahapatra Sent: Tuesday, May 15, 2018 6:56 PM To: Divya Gehlot Cc: user@drill.apache.org Subject: Re: is there any way to

Re: Squirrel Schema list

2018-01-18 Thread Robert Hou
This appears to be a bug. I am able to reproduce this on my system. Can you file a Jira please? Thanks. --Robert From: Steven Peh Sent: Tuesday, January 9, 2018 4:19 PM To: user@drill.apache.org Subject: Squirrel Schema list Hi,

Re: Predicate Pushdown in Drill

2017-10-17 Thread Robert Hou
There is some information in the docs: https://drill.apache.org/docs/partition-pruning-introduction/ https://drill.apache.org/docs/parquet-filter-pushdown/ I don't believe we push predicates past a join. Thanks. --Robert From: Chetan Kothari

Re: Query Error on PCAP over MapR FS

2017-09-13 Thread Robert Hou
This might work: "pcap": { "type": "pcap" } Thanks. --Robert From: Arjun kr Sent: Wednesday, September 13, 2017 10:22 PM To: user@drill.apache.org Subject: Re: Query Error on PCAP over MapR FS I have not used pcap storage

Re: Query Error on PCAP over MapR FS

2017-09-13 Thread Robert Hou
You wrote: I’m running drill as user “drill”. How are you invoking sqllline? Are you specifying a user "drill"? You should be able to query the file with two steps: 1) use mfs; this invokes the plugin 2) select * from `x.pcap`; Since x.pcap is in the root directory, you don't need

Re: How to query values in list

2017-09-13 Thread Robert Hou
t_mode = true thanks!, gus Em Thu, Sep 14, 2017 at 12:47:31AM +, Robert Hou escreveu: > Try: > > >select t.v11._ from dfs.`` t where t.v11._ = '0070'; > > > This works for json. Try it with MongoDB. > > > Thanks. > > > --Robert > > __

Re: How to query values in list

2017-09-13 Thread Robert Hou
Try: select t.v11._ from dfs.`` t where t.v11._ = '0070'; This works for json. Try it with MongoDB. Thanks. --Robert From: gus Sent: Wednesday, September 13, 2017 11:26 AM To: user@drill.apache.org Subject: How to query values in

Re: ***UNCHECKED*** Re: Query Error on PCAP over MapR FS

2017-09-13 Thread Robert Hou
Takeo, if you file a > Jira, perhaps you can include the Drill profile, and we can look at how many > fragments are used by the query. The profiles can be found via a web URL I attached query profile to the issue. Thank you. > 2017/09/13 8:50、Robert Hou <r...@mapr.com>のメ�`

Re: ***UNCHECKED*** Re: Query Error on PCAP over MapR FS

2017-09-12 Thread Robert Hou
From: Ted Dunning <ted.dunn...@gmail.com> Sent: Tuesday, September 12, 2017 4:30 PM To: user Cc: j...@apache.org Subject: Re: ***UNCHECKED*** Re: Query Error on PCAP over MapR FS PCAP is a binary format that cannot easily be split. On Wed, Sep 13, 2017 at 1:15 AM, Robert Hou <r...

Re: ***UNCHECKED*** Re: Query Error on PCAP over MapR FS

2017-09-12 Thread Robert Hou
ooking at this. I think that this is a bug in the way that we wrote the format plugin in that it isn't telling Drill to not split the file. On Wed, Sep 13, 2017 at 12:52 AM, Robert Hou <r...@mapr.com> wrote: > I asked a couple of Drill developers. We don't have much experience with > PCAP ye

Re: ***UNCHECKED*** Re: Query Error on PCAP over MapR FS

2017-09-12 Thread Robert Hou
I asked a couple of Drill developers. We don't have much experience with PCAP yet. Takeo, can you file a Jira for this, and include the information below? The error message mentions a bad magic number, which Drill sometimes uses to help determine the file format. Also, it appears that you

Re: Drill on secure HDFS

2017-08-13 Thread Robert Hou
This will work for JDBC clients. If you are using ODBC, then there are other steps. Thanks. --Robert From: Padma Penumarthy Sent: Saturday, August 12, 2017 7:19 AM To: user@drill.apache.org Subject: Re: Drill on secure HDFS Did you

Re: Drill where clause vs Hive on non-partition column

2016-11-17 Thread Robert Hou
Drill > > > > native parquet reader). We do have plans to support filter pushdown > for > > > > this scenario in the future. > > > > > > > > - Rahul > > > > > > > > On Tue, Nov 15, 2016 at 8:01 AM, Sonny Heer <sonnyh...@gmail.co