[GitHub] drill pull request #1082: DRILL-5741: Automatically manage memory allocation...

2018-02-05 Thread kkhatua
Github user kkhatua commented on a diff in the pull request: https://github.com/apache/drill/pull/1082#discussion_r166196043 --- Diff: distribution/src/resources/auto-setup.sh --- @@ -0,0 +1,222 @@ +#!/usr/bin/env bash +# Licensed to the Apache Software Foundation (ASF)

[jira] [Created] (DRILL-6139) Travis CI hangs on TestVariableWidthWriter#testRestartRow

2018-02-05 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-6139: --- Summary: Travis CI hangs on TestVariableWidthWriter#testRestartRow Key: DRILL-6139 URL: https://issues.apache.org/jira/browse/DRILL-6139 Project: Apache Drill

[GitHub] drill issue #1113: DRILL-5902: Regression: Queries encounter random failure ...

2018-02-05 Thread vrozov
Github user vrozov commented on the issue: https://github.com/apache/drill/pull/1113 @arina-ielchiieva Please review ---

[GitHub] drill pull request #1113: DRILL-5902: Regression: Queries encounter random f...

2018-02-05 Thread vrozov
GitHub user vrozov opened a pull request: https://github.com/apache/drill/pull/1113 DRILL-5902: Regression: Queries encounter random failure due to RPC connection timed out You can merge this pull request into a Git repository by running: $ git pull

[jira] [Created] (DRILL-6138) Move RecordBatchSizer to org.apache.drill.exec.record package

2018-02-05 Thread Padma Penumarthy (JIRA)
Padma Penumarthy created DRILL-6138: --- Summary: Move RecordBatchSizer to org.apache.drill.exec.record package Key: DRILL-6138 URL: https://issues.apache.org/jira/browse/DRILL-6138 Project: Apache

[GitHub] drill pull request #1112: DRILL-6114: Metadata revisions

2018-02-05 Thread paul-rogers
GitHub user paul-rogers opened a pull request: https://github.com/apache/drill/pull/1112 DRILL-6114: Metadata revisions This PR is part of the "[batch handling updates\https://github.com/paul-rogers/drill/wiki/Batch-Handling-Upgrades]; project. It completes the new internal

Re: Apache Drill with Azure Data Lake Store

2018-02-05 Thread Saurabh Mahapatra
Hi Kamal, My understanding was that the file system running on top of Azure data store was still HDFS? Is that true? If that be the case, the DFS plugin should work. It is worth a test. Thanks, Saurabh Sent from my iPhone > On Feb 3, 2018, at 6:02 PM, Kamal Baig wrote:

Apache Drill with Azure Data Lake Store

2018-02-05 Thread Kamal Baig
Hi I am looking for some help around connecting and processing data stored in Azure Data lake store (Not the Azure Blob) using Apache Drill Any help and suggestion would be highly appreciated. I am a beginner with Apache Drill so any docs or steps would be great to get started Thanks

[GitHub] drill pull request #1082: DRILL-5741: Automatically manage memory allocation...

2018-02-05 Thread kkhatua
Github user kkhatua commented on a diff in the pull request: https://github.com/apache/drill/pull/1082#discussion_r166158426 --- Diff: distribution/src/resources/drill-config.sh --- @@ -180,18 +251,61 @@ else fi fi -# Default memory settings if none provided

[GitHub] drill pull request #1082: DRILL-5741: Automatically manage memory allocation...

2018-02-05 Thread kkhatua
Github user kkhatua commented on a diff in the pull request: https://github.com/apache/drill/pull/1082#discussion_r166157864 --- Diff: distribution/src/resources/drill-config.sh --- @@ -180,18 +251,61 @@ else fi fi -# Default memory settings if none provided

[GitHub] drill pull request #1082: DRILL-5741: Automatically manage memory allocation...

2018-02-05 Thread kkhatua
Github user kkhatua commented on a diff in the pull request: https://github.com/apache/drill/pull/1082#discussion_r166157561 --- Diff: distribution/src/resources/auto-setup.sh --- @@ -0,0 +1,222 @@ +#!/usr/bin/env bash +# Licensed to the Apache Software Foundation (ASF)

[GitHub] drill pull request #1082: DRILL-5741: Automatically manage memory allocation...

2018-02-05 Thread kkhatua
Github user kkhatua commented on a diff in the pull request: https://github.com/apache/drill/pull/1082#discussion_r166157369 --- Diff: distribution/src/assemble/bin.xml --- @@ -345,6 +345,21 @@ 0755 conf + +

[GitHub] drill issue #1011: Drill 1170: Drill-on-YARN

2018-02-05 Thread sachouche
Github user sachouche commented on the issue: https://github.com/apache/drill/pull/1011 +1 I have reviewed the code and overall looks good. My main feedback is that the current implementation doesn't currently support secure clusters (at least didn't see any logic associated with

[GitHub] drill issue #1107: DRILL-6123: Limit batch size for Merge Join based on memo...

2018-02-05 Thread ppadma
Github user ppadma commented on the issue: https://github.com/apache/drill/pull/1107 @sachouche @ilooner @paul-rogers Can one of you review this PR for me ? ---

[GitHub] drill pull request #1101: DRILL-6032: Made the batch sizing for HashAgg more...

2018-02-05 Thread ppadma
Github user ppadma commented on a diff in the pull request: https://github.com/apache/drill/pull/1101#discussion_r166096630 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/aggregate/HashAggTemplate.java --- @@ -215,6 +206,7 @@ public BatchHolder() {

[GitHub] drill pull request #1101: DRILL-6032: Made the batch sizing for HashAgg more...

2018-02-05 Thread ppadma
Github user ppadma commented on a diff in the pull request: https://github.com/apache/drill/pull/1101#discussion_r166142178 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/spill/RecordBatchSizer.java --- @@ -65,6 +70,14 @@ public int

[GitHub] drill pull request #1101: DRILL-6032: Made the batch sizing for HashAgg more...

2018-02-05 Thread ppadma
Github user ppadma commented on a diff in the pull request: https://github.com/apache/drill/pull/1101#discussion_r166098364 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/aggregate/HashAggTemplate.java --- @@ -140,6 +131,9 @@ private

[GitHub] drill pull request #1101: DRILL-6032: Made the batch sizing for HashAgg more...

2018-02-05 Thread ppadma
Github user ppadma commented on a diff in the pull request: https://github.com/apache/drill/pull/1101#discussion_r166141274 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/aggregate/HashAggTemplate.java --- @@ -733,28 +780,32 @@ private void

[GitHub] drill pull request #1101: DRILL-6032: Made the batch sizing for HashAgg more...

2018-02-05 Thread ppadma
Github user ppadma commented on a diff in the pull request: https://github.com/apache/drill/pull/1101#discussion_r166142507 --- Diff: exec/vector/src/main/codegen/templates/FixedValueVectors.java --- @@ -298,6 +298,11 @@ public int getPayloadByteCount(int valueCount) {

[GitHub] drill pull request #1101: DRILL-6032: Made the batch sizing for HashAgg more...

2018-02-05 Thread ppadma
Github user ppadma commented on a diff in the pull request: https://github.com/apache/drill/pull/1101#discussion_r166136279 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/aggregate/HashAggTemplate.java --- @@ -226,7 +221,7 @@ public BatchHolder() {

[GitHub] drill issue #1011: Drill 1170: Drill-on-YARN

2018-02-05 Thread priteshm
Github user priteshm commented on the issue: https://github.com/apache/drill/pull/1011 @sachouche @vrozov @arina-ielchiieva please review ---

[jira] [Created] (DRILL-6137) Join Failure When Some Json File Partitions Empty

2018-02-05 Thread Timothy Farkas (JIRA)
Timothy Farkas created DRILL-6137: - Summary: Join Failure When Some Json File Partitions Empty Key: DRILL-6137 URL: https://issues.apache.org/jira/browse/DRILL-6137 Project: Apache Drill

Google Hangouts: Lateral Join High Level Design Presentation

2018-02-05 Thread Timothy Farkas
Hi All, Aman and Sorabh will be talking about the high level design of lateral join in the next hangout session tomorrow. Since lateral join is a big topic they'll talk about more of the details of the design after Parth comes back in another hangout session. Thanks, Tim

[GitHub] drill issue #1111: Upgrade drill-hive libraries to 2.1.1 version.

2018-02-05 Thread priteshm
Github user priteshm commented on the issue: https://github.com/apache/drill/pull/ @vrozov can you please review this change? ---

RE: PCAP files with Apache Drill and Sergeant R

2018-02-05 Thread Kunal Khatua
I don’t think you can (or even want to) directly access them, assuming that the HTTP link you shared is your intended way of accessing the data. Bringing them into Amazon S3 will make it easier to spin up Drill and access the data, and you could even use the 'tmp' workspace or create temporary

[GitHub] drill pull request #1104: DRILL-6118: Handle item star columns during projec...

2018-02-05 Thread chunhui-shi
Github user chunhui-shi commented on a diff in the pull request: https://github.com/apache/drill/pull/1104#discussion_r166066830 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/project/ProjectRecordBatch.java --- @@ -596,10 +596,10 @@ private void

[GitHub] drill pull request #1104: DRILL-6118: Handle item star columns during projec...

2018-02-05 Thread chunhui-shi
Github user chunhui-shi commented on a diff in the pull request: https://github.com/apache/drill/pull/1104#discussion_r166094020 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/logical/DrillFilterItemStarReWriterRule.java --- @@ -0,0 +1,232 @@ +/* + *

[GitHub] drill pull request #1111: Upgrade drill-hive libraries to 2.1.1 version.

2018-02-05 Thread vdiravka
GitHub user vdiravka opened a pull request: https://github.com/apache/drill/pull/ Upgrade drill-hive libraries to 2.1.1 version. Updating hive properties for tests and resolving dependencies and API conflicts: * Allowing of using Hive's own calcite-core and avatica

PCAP files with Apache Drill and Sergeant R

2018-02-05 Thread Houssem Hosni
Hi, I am sending this mail with a hope to get some help from you. I am working on making some analysis and prediction models on large pcap files. Can Apache Drill with R Sergeant library help me in this context. Actually the pcap files are so large (MAWI) and they are available on the

[jira] [Created] (DRILL-6136) drill-jdbc-all jar missing dependencies

2018-02-05 Thread Craig Foote (JIRA)
Craig Foote created DRILL-6136: -- Summary: drill-jdbc-all jar missing dependencies Key: DRILL-6136 URL: https://issues.apache.org/jira/browse/DRILL-6136 Project: Apache Drill Issue Type: Bug

[jira] [Created] (DRILL-6135) New Feature: SHOW CREATE VIEW command

2018-02-05 Thread Hari Sekhon (JIRA)
Hari Sekhon created DRILL-6135: -- Summary: New Feature: SHOW CREATE VIEW command Key: DRILL-6135 URL: https://issues.apache.org/jira/browse/DRILL-6135 Project: Apache Drill Issue Type: New

[jira] [Created] (DRILL-6134) Many Drill queries fail when using JDBC Driver from Simba

2018-02-05 Thread Robert Hou (JIRA)
Robert Hou created DRILL-6134: - Summary: Many Drill queries fail when using JDBC Driver from Simba Key: DRILL-6134 URL: https://issues.apache.org/jira/browse/DRILL-6134 Project: Apache Drill