[GitHub] drill pull request: Drill 4372 review

2016-03-01 Thread amansinha100
Github user amansinha100 commented on a diff in the pull request: https://github.com/apache/drill/pull/397#discussion_r54689413 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/DrillFunctionRegistry.java --- @@ -92,38 +94,110 @@ public

[GitHub] drill pull request: Drill 4372 review

2016-03-01 Thread amansinha100
Github user amansinha100 commented on a diff in the pull request: https://github.com/apache/drill/pull/397#discussion_r54688304 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/DrillFunctionRegistry.java --- @@ -92,38 +94,110 @@ public

[GitHub] drill pull request: Drill 4372 review

2016-03-01 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/397#discussion_r54681010 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/sql/TypeInferenceUtils.java --- @@ -0,0 +1,571 @@ +/** + * Licensed to the

[GitHub] drill pull request: Drill 4372 review

2016-03-01 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/397#discussion_r54680959 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/sql/TypeInferenceUtils.java --- @@ -0,0 +1,571 @@ +/** + * Licensed to the

[GitHub] drill pull request: Drill 4372 review

2016-03-01 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/397#discussion_r54680921 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/sql/TypeInferenceUtils.java --- @@ -0,0 +1,571 @@ +/** + * Licensed to the

[GitHub] drill pull request: Drill 4372 review

2016-03-01 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/397#discussion_r54680708 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/sql/DrillSqlOperator.java --- @@ -18,69 +18,43 @@ package

[GitHub] drill pull request: Drill 4372 review

2016-03-01 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/397#discussion_r54680335 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/sql/DrillSqlOperator.java --- @@ -18,69 +18,43 @@ package

Re: Time for the 1.6 Release

2016-03-01 Thread Edmon Begoli
May I please ask to give this issue the attention for 1.6: https://issues.apache.org/jira/plugins/servlet/mobile#issue/DRILL-3149 I will try to suggest a patch. Given my time constraints I might not be able to submit a complete, unit tested code but at least I will try to submit a snippet that

[GitHub] drill pull request: DRILL-4281: Support authorized users to delega...

2016-03-01 Thread jacques-n
Github user jacques-n commented on the pull request: https://github.com/apache/drill/pull/400#issuecomment-191014420 I think it would be better to have a single delegation setting that is json that describes the entirety of what we need to express. I think that will be much clearer

Time for the 1.6 Release

2016-03-01 Thread Parth Chandra
Hello everyone, It's time to start looking into the 1.6 release. Can all the folks working on open issues let me know if there are any JIRAs you would like to get into the release? I know of the following - *DRILL-4281 *- Drill should support inbound impersonation. Pull request expected

Re: [DISCUSS] New Feature: Drill Client Impersonation

2016-03-01 Thread Sudheesh Katkam
Thank you all for the feedback. + I am naming this feature User Delegation (since Client Impersonation can be confused with User Impersonation). + I updated the design document . + I opened a pull request (#400

[GitHub] drill pull request: DRILL-4281: Support authorized users to delega...

2016-03-01 Thread sudheeshkatkam
GitHub user sudheeshkatkam opened a pull request: https://github.com/apache/drill/pull/400 DRILL-4281: Support authorized users to delegate for other users + Need to make changes to [sqlline](https://github.com/mapr/sqlline) to pass down _delegator_ connection property. You can

[jira] [Created] (DRILL-4461) Drill Custom Authentication Startup Exception

2016-03-01 Thread Bridget Bevens (JIRA)
Bridget Bevens created DRILL-4461: - Summary: Drill Custom Authentication Startup Exception Key: DRILL-4461 URL: https://issues.apache.org/jira/browse/DRILL-4461 Project: Apache Drill Issue

Re: Drill Custom Authentication Startup Exception

2016-03-01 Thread Venki Korukanti
There is one step that is missing from the doc. For the custom classpath scanner to find the new class put the following config code in a file named drill-module.conf at the root of the jar file with custom authentication class. drill { classpath.scanning { packages +=

Fwd: Drill Custom Authentication Startup Exception

2016-03-01 Thread Elango Ganesan
Hi All, I tried creating a custom authenticator with Drill 1.5.0 by creating jar based on below source code and drill configuration. I placed the jar in $DRILLHOME/jars/ drill.exec: { cluster-id: "drillbits1", zk.connect: "dmdvhc0002d:2181,dmdvhc0003d:2181,dmdvhc0004d:2181"

On improving project maintainence

2016-03-01 Thread Jason Altekruse
Hello devs, I think everyone has noticed that there are some parts of project maintenance that have been lagging in the past few months. The good new is that the list has been really active, and I think that we really have been trying to get back to everyone. Despite a lot of responses from a

Re: Parallelization & Threading

2016-03-01 Thread Hanifi GUNES
@Jinfeng & Aman The proposal here is basically async execution. Pull or push are both fine. The main requirement is to eliminate blocking calls on incoming and outgoing buffers. In the pull model, like we discussed yesterday with some of Drillers, NOT_YET is the only state that needs to be

Re: Parallelization & Threading

2016-03-01 Thread Hanifi GUNES
Do you want to elaborate on and possibly walk though an example as to how shouldContinue(...) behaves at fragment boundaries(entry/exit) and in the middle considering back-pressure, inner pull loops like hash join, blocking semantics etc? Thanks. -Hanifi 2016-02-29 22:15 GMT-08:00 Neeraja

[GitHub] drill pull request: Drill 4372 review

2016-03-01 Thread hsuanyi
Github user hsuanyi commented on the pull request: https://github.com/apache/drill/pull/397#issuecomment-190864394 @amansinha100, @jinfengni can you review it? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[jira] [Created] (DRILL-4460) Provide feature that allows fall back to sort aggregation

2016-03-01 Thread John Omernik (JIRA)
John Omernik created DRILL-4460: --- Summary: Provide feature that allows fall back to sort aggregation Key: DRILL-4460 URL: https://issues.apache.org/jira/browse/DRILL-4460 Project: Apache Drill

Drill Hangout Starting

2016-03-01 Thread Jacques Nadeau
https://plus.google.com/hangouts/_/dremio.com/drillhangout?authuser=0 -- Jacques Nadeau CTO and Co-Founder, Dremio

Re: Parallelization & Threading

2016-03-01 Thread Jinfeng Ni
couple of quick questions. 1. By using this new thread model and switching to push model for the operators within a node, does it mean each operator will be scheduled as a tread task? (versus the current one where operators within a fragment will be executed in same thread). 2. Does it require to

Re: Parallelization & Threading

2016-03-01 Thread Aman Sinha
Just some initial thought...the pull model for iterator-based operators within a thread combined with push model across threads via Exchanges is fairly well understood (based on Volcano) and it would be good to build upon it to handle cluster overload situations. A hash join for instance need not

Re: Avro support in Drill - Missing support for the IN operator and other frustrating things

2016-03-01 Thread Jason Altekruse
Hey Stefan, It is possible that this is the case. A quick look at the code seems to indicate that the Avro reader is not overriding the default behavior of determining approximate row count of files. I believe there is still a small issue with the code handling tiny files, are the files you are

Re: Parallelization & Threading

2016-03-01 Thread Jacques Nadeau
The main point here is cluster behavior during heavy load periods. The goal would be to improve cluster responsiveness and performance in those situations. While related to the discussion on workload management, I think of this mostly as an independent topic relating to how we do thread modeling.

[GitHub] drill pull request: DRILL-3745: Hive CHAR not supported

2016-03-01 Thread vkorukanti
Github user vkorukanti commented on the pull request: https://github.com/apache/drill/pull/399#issuecomment-190757236 LGTM, +1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[jira] [Created] (DRILL-4459) SchemaChangeException while querying hive json table

2016-03-01 Thread Vitalii Diravka (JIRA)
Vitalii Diravka created DRILL-4459: -- Summary: SchemaChangeException while querying hive json table Key: DRILL-4459 URL: https://issues.apache.org/jira/browse/DRILL-4459 Project: Apache Drill

[jira] [Created] (DRILL-4458) JDBC plugin case sensitive table names

2016-03-01 Thread Paul Mogren (JIRA)
Paul Mogren created DRILL-4458: -- Summary: JDBC plugin case sensitive table names Key: DRILL-4458 URL: https://issues.apache.org/jira/browse/DRILL-4458 Project: Apache Drill Issue Type: Bug

[jira] [Created] (DRILL-4456) Hive translate function is not working

2016-03-01 Thread Arina Ielchiieva (JIRA)
Arina Ielchiieva created DRILL-4456: --- Summary: Hive translate function is not working Key: DRILL-4456 URL: https://issues.apache.org/jira/browse/DRILL-4456 Project: Apache Drill Issue

[GitHub] drill pull request: DRILL-3745: Hive CHAR not supported

2016-03-01 Thread arina-ielchiieva
GitHub user arina-ielchiieva opened a pull request: https://github.com/apache/drill/pull/399 DRILL-3745: Hive CHAR not supported 1. Added Hive Char support in queries and udf-s out parameter. Char is trimmed first and then treated as varchar. 2. Unit tests. You can merge this