Re: unable to start Drill 1.6.0

2016-03-19 Thread Abdel Hakim Deneche
I'm not 100% sure, but I think some changes went in that require all UDFs to be recompiled with Drill 1.6.0. Did you recompile your UDFs ? Also, you can check drillbit.log and drillbit.out. When a Drillbit starts it logs any problem with the UDFs in the logs On Thu, Mar 17, 2016 at 4:25 PM,

Re: [ANNOUNCE] Apache Drill 1.6.0 released

2016-03-19 Thread Hanifi Gunes
False alarm. Looks like this particular mirror was not up to date. [1] has it all. Thanks. -Hanifi 1: http://repo1.maven.org/maven2/org/apache/drill/exec/drill-java-exec/ On Thu, Mar 17, 2016 at 4:48 PM, Hanifi Gunes wrote: > I am unable to find 1.6 at maven [1]. Did we

Re: unable to start Drill 1.6.0

2016-03-19 Thread Abdel Hakim Deneche
Easiest fix when Drill fails to load a storage plugin is to delete the existing configurations. Deleting /tmp/drill/ should resolve this. I know this may not be practical in some cases, and other developers may give you a better solution. On Thu, Mar 17, 2016 at 2:13 PM, Shankar Mane

Re: ConnectTimeoutException when starting drill

2016-03-19 Thread Aditya
Could you please check your "/etc/hosts" file for a possible mis-configuration of "localhost" and ensure that all localhost names are set to default, i.e. 127.0.0.1 localhost localhost.localdomain localhost4 > localhost4.localdomain4 > ::1 localhost localhost.localdomain localhost6 >

RE: Drill Storage Plugin for HBase 1.0

2016-03-19 Thread Kevin Verhoeven
Thanks Aditya, We see a problem when we query HBase 1.0 tables with more than five column qualifiers, where only a small amount of data is returned. We are able to repro the problem with Drill 1.5 against HBase 1.0 tables of just about any size, for example with 1,000,000 rows. A query

RE: Drill Storage Plugin for HBase 1.0

2016-03-19 Thread Kevin Verhoeven
Thanks Aditya, Where do I set the "org.apache.drill.exec.store.hbase.HBaseRecordReader" parameter? I set it under the drill-override.conf file and restarted Drill but I do not see this appear in the log. My drill-override.conf looks something like this (I abbreviated the file): drill.exec: {

Strange error with hive null data

2016-03-19 Thread Christopher Matta
I have some Hive data loaded with sqoop that looks like this: 0: jdbc:drill:> select curr_fiscal_week, load_dts from hive.dim.`YEAR_DATE_DIM`; +---++ | curr_fiscal_week |load_dts| +---++ | 12.0

Re: Drill Storage Plugin for HBase 1.0

2016-03-19 Thread Aditya
Could you please enable debug logging for "org.apache.drill.exec.store.hbase.HBaseRecordReader" and look for following log message in drillbit.log from this logger. > Took ms to get y records Does sum(y) for a query matches the expected number of record? On Wed, Mar 16, 2016 at

Re: Drill Storage Plugin for HBase 1.0

2016-03-19 Thread Aditya
Thanks Kevin, that is useful information. I have couple of follow up questions. 1. Was there any warning/error message in the log? 2. Was the result of count query in this instance == (3362 + 3362)? On Wed, Mar 16, 2016 at 1:55 PM, Kevin Verhoeven wrote: > Thanks

Re: unable to start Drill 1.6.0

2016-03-19 Thread Shankar Mane
@Jacques Nadeau Earlier in 1.2.0, we used blank drill-module.conf file as a part of UDF itself. And this file was not added into drill "conf" directory. Functions were working fine. Same we did in 1.6.0, but drill is not able to find the function. Btw As you suggested let me do changes. And

Setting Admin Users in drill-override.conf

2016-03-19 Thread John Omernik
Hey all, I am trying to set security.admin.users via drill-override.conf. Is this possible? (Obviously I tried it and it didn't work) What would the correct syntax to set it here be? (I don't want to logon with the user running the drillbit as it's a service account with no password, I'd prefer to

Re: Drill Storage Plugin for HBase 1.0

2016-03-19 Thread Aditya
My apologies, I should have been more explicit. For changing any log related settings, you'd need to modify "$DRILL_HOME/conf/logback.xml" on all Drillbit nodes and add the following snippet On Wed, Mar 16, 2016 at 1:05 PM, Kevin Verhoeven wrote: >

unable to start Drill 1.6.0

2016-03-19 Thread Shankar Mane
I am not able to start drill 1.6.0. Please find the attached file for more details.

Re: [ANNOUNCE] Apache Drill 1.6.0 released

2016-03-19 Thread Hanifi Gunes
I am unable to find 1.6 at maven [1]. Did we publish maven artifacts? Thanks. -Hanifi 1: http://mvnrepository.com/artifact/org.apache.drill.exec/drill-java-exec On Wed, Mar 16, 2016 at 10:09 AM, Parth Chandra wrote: > On behalf of *Apache* *Drill* community, I am happy to

RE: Drill query does not return all results from HBase

2016-03-19 Thread Kumiko Yada
Hello, I provided all information that was requested; however, I haven't heard back anything since February 24. Is anyone taking look at this? Are there any workarounds? https://issues.apache.org/jira/browse/DRILL-4271 Thanks Kumiko -Original Message- From: Aditya

Re: Salesforce connector

2016-03-19 Thread Tomer Shiran
Currently there isn't a storage plugin that connects directly to Salesforce. You could of course run an export (Salesforce can do a bulk export to JSON) and then use Drill to analyze the exported files. On Tue, Mar 15, 2016 at 11:07 PM, Marat Kalibekov wrote: > Hello, what is

Re: unable to start Drill 1.6.0

2016-03-19 Thread Shankar Mane
*drillbit.out =>* Exception in thread "main" org.apache.drill.exec.exception.DrillbitStartupException: Failure during initial startup of Drillbit. at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:284) at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:261) at

Re: Unable to access User Created Schema in SQL Server

2016-03-19 Thread Jacques Nadeau
I don't think we have tests covering this case so it may have issues. Can you file a JIRA? thanks, Jacques -- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Mar 17, 2016 at 11:11 PM, Sanjiv Kumar wrote: > *I want to know whether Apache Drill supports only dbo schema??

Re: Error parsing JSON (drill 1.6.0)

2016-03-19 Thread Abhishek Girish
Hello Shankar, >From the sample data you shared, it looks like you have JSON documents which differ considerably in the schema / structure. This isn't supported by default. You could try turning on UNION type (an experimental feature). > set `exec.enable_union_type` = true;

[ANNOUNCE] Apache Drill 1.6.0 released

2016-03-19 Thread Parth Chandra
On behalf of *Apache* *Drill* community, I am happy to *announce* the release of *Apache* *Drill* 1.6.0. The source and binary artifacts are available at [1] Review a complete list of fixes and enhancements at [2] This release of *Drill* fixes many issues and introduces a number of enhancements,

Re: Error parsing JSON (drill 1.6.0)

2016-03-19 Thread Abhishek Girish
For CTAS, I also hit a NPE when storage format was Parquet (default). With storage format as JSON, i hit this error: Error: SYSTEM ERROR: IllegalArgumentException: You tried to read a [readText()] type when you are using a field reader of type [UnionListReader]. Since this is still an

RE: Drill query does not return all results from HBase

2016-03-19 Thread Kumiko Yada
Aditya, When we were exchanging the emails, you mentioned to me that you discovered another issue in case where the table is spit into multiple regions and the first region returned to the client did not have any rows. I think this issue is related to the issue that I’m seeing. Have you

Re: unable to start Drill 1.6.0

2016-03-19 Thread Jacques Nadeau
There was a change in Drill 1.3 or 1.4 that required additional specification. See here: https://drill.apache.org/docs/adding-custom-functions-to-drill/ -- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Mar 17, 2016 at 10:13 AM, Shankar Mane wrote: > @Jacques

RE: Drill join performance

2016-03-19 Thread Dmitry Krivov
Just for info : After recreating tables with explicit columns CASTing have double performace of this query (from 60 to 35 sec.) Best regards, Dmitry > Hello > > I have load (as CTAS) into parquet-files StarShema Benchmark generated > csv-data (scale factor 50) > > For one of bencmark query's

Re: ConnectTimeoutException when starting drill

2016-03-19 Thread Sudheesh Katkam
Drill 1.6 introduces support for Java 1.8, which is generally available today. Download here . Thank you, Sudheesh > On Mar 3, 2016, at 1:40 PM, Rob Terpilowski wrote: > > I am

RE: Drill Storage Plugin for HBase 1.0

2016-03-19 Thread Kevin Verhoeven
Thanks Aditya, There were no warnings/errors in the log, and the result of the count was 6724 (3362 + 3362). Kevin From: Aditya [mailto:adityakish...@gmail.com] Sent: Wednesday, March 16, 2016 4:48 PM To: Kevin Verhoeven Cc: user@drill.apache.org Subject: Re: Drill

Re: Error parsing JSON (drill 1.6.0)

2016-03-19 Thread Shankar Mane
@Abhishek: Some events in 150 gb json file are like this where they differ in structure. I could say there are only 0.1% (per 150gb json file) are such events. And yes, union work perfectly. But only when we use select statements. Could you please change your select query to CTAS ? I am