Re: Apache Drill Cassandra Storage plugin

2016-09-26 Thread Aman Sinha
Hi Sumit, the Cassandra plugin for Drill was a work-in-progress based on this JIRA [1] but has not see much activity for a while. This will need to be picked up by someone in the community (you can volunteer too :)). There has been past requests for this capability on the dev and user list, so it

[GitHub] drill issue #518: DRILL-4653.json - Malformed JSON should not stop the entir...

2016-09-26 Thread ssriniva123
Github user ssriniva123 commented on the issue: https://github.com/apache/drill/pull/518 There is not much to do except change the JSON parser to support this functionality. - Indicate to the parser that a current record terminates when it encounters a \n (Of course this

[jira] [Created] (DRILL-4905) Push down the LIMIT to the parquet reader scan to limit the numbers of records read

2016-09-26 Thread Padma Penumarthy (JIRA)
Padma Penumarthy created DRILL-4905: --- Summary: Push down the LIMIT to the parquet reader scan to limit the numbers of records read Key: DRILL-4905 URL: https://issues.apache.org/jira/browse/DRILL-4905

Apache Drill Cassandra Storage plugin

2016-09-26 Thread Sumit Jain
Hi Team, We have a requirement for storing Log data to Apache Cassandra and would like to have complex SQL support on that. I could see Apache Drill support as of now MongoDB and RDBMS. Is there any way i can integrate Cassandra with Drill 1.8? If not, is there a release in near future(timeline)

[GitHub] drill issue #518: DRILL-4653.json - Malformed JSON should not stop the entir...

2016-09-26 Thread paul-rogers
Github user paul-rogers commented on the issue: https://github.com/apache/drill/pull/518 As it turns out, the sample code shown was actually tested with a stock Jackson JSON parser: it does work. No parser changes are needed. The issue is not whether we can make the parser do

[GitHub] drill pull request #574: DRILL-4726: Dynamic UDFs support

2016-09-26 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/574#discussion_r80548740 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/FunctionImplementationRegistry.java --- @@ -301,29 +323,120 @@ private ScanResult

[GitHub] drill pull request #597: DRILL-4905: Push down the LIMIT to the parquet read...

2016-09-26 Thread ppadma
GitHub user ppadma opened a pull request: https://github.com/apache/drill/pull/597 DRILL-4905: Push down the LIMIT to the parquet reader scan. For limit N query, where N is less than current default record batchSize (256K for all fixedlength, 32K otherwise), we still end up reading

[GitHub] drill pull request #597: DRILL-4905: Push down the LIMIT to the parquet read...

2016-09-26 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/597#discussion_r80606955 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/ParquetGroupScan.java --- @@ -115,6 +115,8 @@ private List rowGroupInfos;

[GitHub] drill pull request #597: DRILL-4905: Push down the LIMIT to the parquet read...

2016-09-26 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/597#discussion_r80608344 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/ParquetScanBatchCreator.java --- @@ -107,7 +107,7 @@ public ScanBatch

[GitHub] drill pull request #596: DRILL-4880: Support JDBC driver registration using ...

2016-09-26 Thread laurentgo
GitHub user laurentgo opened a pull request: https://github.com/apache/drill/pull/596 DRILL-4880: Support JDBC driver registration using ServiceLoader Support loading Drill driver using ServiceLoader. From the user perspective, it means being able to use the driver without

[GitHub] drill pull request #597: DRILL-4905: Push down the LIMIT to the parquet read...

2016-09-26 Thread gparai
Github user gparai commented on a diff in the pull request: https://github.com/apache/drill/pull/597#discussion_r80613372 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/ParquetGroupScan.java --- @@ -926,16 +944,22 @@ public GroupScan applyLimit(long

[GitHub] drill pull request #597: DRILL-4905: Push down the LIMIT to the parquet read...

2016-09-26 Thread gparai
Github user gparai commented on a diff in the pull request: https://github.com/apache/drill/pull/597#discussion_r80612914 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/ParquetGroupScan.java --- @@ -899,6 +907,16 @@ public FileGroupScan

[GitHub] drill pull request #597: DRILL-4905: Push down the LIMIT to the parquet read...

2016-09-26 Thread gparai
Github user gparai commented on a diff in the pull request: https://github.com/apache/drill/pull/597#discussion_r80612967 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/ParquetGroupScan.java --- @@ -899,6 +907,16 @@ public FileGroupScan

[GitHub] drill pull request #574: DRILL-4726: Dynamic UDFs support

2016-09-26 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/574#discussion_r80548125 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/FunctionImplementationRegistry.java --- @@ -301,29 +323,120 @@ private ScanResult

[GitHub] drill pull request #574: DRILL-4726: Dynamic UDFs support

2016-09-26 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/574#discussion_r80578885 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/sql/handlers/DropFunctionHandler.java --- @@ -48,54 +48,77 @@ public

[GitHub] drill pull request #574: DRILL-4726: Dynamic UDFs support

2016-09-26 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/574#discussion_r80534600 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/coord/zk/ZookeeperClient.java --- @@ -257,14 +263,47 @@ public void put(final String path,

[GitHub] drill pull request #574: DRILL-4726: Dynamic UDFs support

2016-09-26 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/574#discussion_r80549839 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/FunctionImplementationRegistry.java --- @@ -301,29 +323,120 @@ private ScanResult

[GitHub] drill pull request #574: DRILL-4726: Dynamic UDFs support

2016-09-26 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/574#discussion_r80547641 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/FunctionImplementationRegistry.java --- @@ -301,29 +323,120 @@ private ScanResult

[GitHub] drill pull request #574: DRILL-4726: Dynamic UDFs support

2016-09-26 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/574#discussion_r80559591 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/registry/FunctionRegistryHolder.java --- @@ -0,0 +1,360 @@ +/** + * Licensed

[GitHub] drill pull request #574: DRILL-4726: Dynamic UDFs support

2016-09-26 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/574#discussion_r80542988 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/FunctionImplementationRegistry.java --- @@ -179,14 +190,15 @@ public DrillFuncHolder

[GitHub] drill pull request #574: DRILL-4726: Dynamic UDFs support

2016-09-26 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/574#discussion_r80557682 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/registry/FunctionRegistryHolder.java --- @@ -0,0 +1,360 @@ +/** + * Licensed

[GitHub] drill pull request #574: DRILL-4726: Dynamic UDFs support

2016-09-26 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/574#discussion_r80554787 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/FunctionImplementationRegistry.java --- @@ -301,29 +323,120 @@ private ScanResult

[GitHub] drill pull request #574: DRILL-4726: Dynamic UDFs support

2016-09-26 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/574#discussion_r80539844 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/FunctionImplementationRegistry.java --- @@ -120,9 +129,9 @@ public

[GitHub] drill pull request #574: DRILL-4726: Dynamic UDFs support

2016-09-26 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/574#discussion_r80558464 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/registry/FunctionRegistryHolder.java --- @@ -0,0 +1,360 @@ +/** + * Licensed

[GitHub] drill pull request #574: DRILL-4726: Dynamic UDFs support

2016-09-26 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/574#discussion_r80579839 --- Diff: exec/java-exec/src/main/resources/drill-module.conf --- @@ -45,6 +45,8 @@ drill.client: { supports-complex-types: true }