Re: Drill dir0 issue

2015-08-23 Thread Jacques Nadeau
I think Hsuan misunderstood your question. Can you let us know what you get if you query: select * from dfs.root.`/user/hive/warehouse/table/year=2012` -- Jacques Nadeau CTO and Co-Founder, Dremio On Sun, Aug 23, 2015 at 7:07 AM, Sungwook Yoon sy...@maprtech.com wrote: Hi, I am

Re: Drill dir0 issue

2015-08-23 Thread Aman Sinha
Sungwook, do you have the latest master build which has the fix for Hive partition pruning (DRILL-3121) ? On Sun, Aug 23, 2015 at 12:15 PM, Sungwook Yoon sy...@maprtech.com wrote: Will do, Thanks, Sungwook On Sun, Aug 23, 2015 at 2:14 PM, Jacques Nadeau jacq...@dremio.com wrote: It

Re: Show Files Command

2015-08-23 Thread USC
Hi John, It is definitely a great idea to have SQL on show files. What we can do is open a JIRA issue. Usually, a interested person in community would pick up and work on :) On Aug 23, 2015, at 4:07 AM, John Omernik j...@omernik.com wrote: Hey all, So while I've dabbled in drill, this

Drill dir0 issue

2015-08-23 Thread Sungwook Yoon
Hi, I am trying to use Hive parquet stored files partitioned by some column. So, the directory structure is partitioned with the column. The column is actually year. Let's say there are 5 years, so dir0 are like year=2010, year=2011,year=2012,year=2013,year=2014 We did like following select *

Re: Show Files Command

2015-08-23 Thread Edmon Begoli
I just tried the approach recommended approach by Kristine and it worked (almost) fine. However, there was a noise in the columns. I think, to make things consistent, there should be an embeddable sql command as Jacques suggests. On Sun, Aug 23, 2015 at 7:33 PM, Jacques Nadeau jacq...@dremio.com

Re: Drill dir0 issue

2015-08-23 Thread Sungwook Yoon
So, I filed the issue here, https://issues.apache.org/jira/browse/DRILL-3692 If more details are needed let me know. Sungwook On Sun, Aug 23, 2015 at 2:45 PM, Aman Sinha asi...@maprtech.com wrote: Yes, I just realized that and was about to respond to my prior message. I just tested with a

Re: Show Files Command

2015-08-23 Thread Kristine Hahn
Correction: save the output to a .tbl file Kristine Hahn Sr. Technical Writer 415-497-8107 @krishahn skype:krishahn On Sun, Aug 23, 2015 at 4:04 PM, Kristine Hahn kh...@maprtech.com wrote: You can use the Drill Shell command !record to save the output to a .tbl command and then query the PSV

Re: Show Files Command

2015-08-23 Thread Kristine Hahn
You can use the Drill Shell command !record to save the output to a .tbl command and then query the PSV results using the COLUMNS[n] syntax, which can return the accessTime from COLUMNS[7]. Kristine Hahn Sr. Technical Writer 415-497-8107 @krishahn skype:krishahn On Sun, Aug 23, 2015 at 3:45 PM,

Fwd: [jira] [Created] (DRILL-3693) SQLLine/drill-localhost seems to demand 2.9GB just to start

2015-08-23 Thread Jacques Nadeau
Hey guys, if you have a question or want to have a discussion about something, please ask the question on the user list. The overhead of managing jiras when someone doesn't understand something is too high. The first question here is: what does drill-env.sh set the jvm memory settings to? This

Re: Show Files Command

2015-08-23 Thread John Omernik
I've created DRILL-3698, could the team please evaluate to ensure I've created a JIRA using the proper labels/settings for what this is. (I choose future for all versioins as I was unsure what to put). Thanks all for the feedback. These little things have me very excited about Drill.

Re: [jira] [Created] (DRILL-3697) REGEXP_REPLACE doc. says POSIX reg. expr.; which? not Java?

2015-08-23 Thread Jacques Nadeau
In the future, it would be helpful if you start by asking usage questions on the user list. I think that will get you faster answers and improve bug reports. Drill currently uses Java's regex. It would be great if you could provide a documentation pull request to correct the function

Re: Show Files Command

2015-08-23 Thread John Omernik
Kristine: We can do that, but it's not conducive to exploration it's a lot of work just to sort something different, trying to find a way to do that sort of thing intuitively as part of walking through the data. Do folks think this worth opening a Jira on? I think it would be really useful, but

Re: Need help in querying HDFS from drill

2015-08-23 Thread Malathi
Hi, The entire log of the sqlline is attached in the dropbox link: https://www.dropbox.com/s/oijx9vjibk1md5x/sqlline.log?dl=0 Error id is : *aa3410a8-8b11-412e-bb89-dec3e8bb8bb4* P.S : And one more thing to note is that it worked when both drill and apache HDFS run in centos in different