[GitHub] drill issue #826: DRILL-5379: Set Hdfs Block Size based on Parquet Block Siz...

2017-06-28 Thread ppadma
Github user ppadma commented on the issue: https://github.com/apache/drill/pull/826 @kkhatua HDFS allows specifying block size during file creation which overrides the default file system block size. With this PR, we can have single HDFS block per Parquet file that can be larger

[GitHub] drill issue #851: DRILL-5518: Test framework enhancements

2017-06-28 Thread amansinha100
Github user amansinha100 commented on the issue: https://github.com/apache/drill/pull/851 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] drill issue #826: DRILL-5379: Set Hdfs Block Size based on Parquet Block Siz...

2017-06-28 Thread kkhatua
Github user kkhatua commented on the issue: https://github.com/apache/drill/pull/826 @ppadma , Khurram [~khfaraaz] and I were looking at the details in the PR and it's not very clear what new behavior does the PR allow. If you need to specify the block-size as described in the

[GitHub] drill pull request #862: DRILL-5420: ParquetAsyncPgReader goes into infinite...

2017-06-28 Thread kkhatua
Github user kkhatua commented on a diff in the pull request: https://github.com/apache/drill/pull/862#discussion_r124688876 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/columnreaders/AsyncPageReader.java --- @@ -409,9 +414,10 @@ public Void call()

[GitHub] drill issue #831: DRILL-5432: Added pcap-format support

2017-06-28 Thread paul-rogers
Github user paul-rogers commented on the issue: https://github.com/apache/drill/pull/831 Filed DRILL-5618 to describe the `bootstrap-storage-plugin.json` issue. There are one or two remaining open comments. Will those be addressed, or should we do a final review based on the

[jira] [Created] (DRILL-5618) Allow non-core storage plugins to define an initial configuration

2017-06-28 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5618: -- Summary: Allow non-core storage plugins to define an initial configuration Key: DRILL-5618 URL: https://issues.apache.org/jira/browse/DRILL-5618 Project: Apache Drill

[jira] [Created] (DRILL-5617) spill filename conflict

2017-06-28 Thread Chun Chang (JIRA)
Chun Chang created DRILL-5617: - Summary: spill filename conflict Key: DRILL-5617 URL: https://issues.apache.org/jira/browse/DRILL-5617 Project: Apache Drill Issue Type: Bug Components:

[jira] [Created] (DRILL-5616) Hash Agg Spill: OOM while reading irregular varchar data

2017-06-28 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-5616: --- Summary: Hash Agg Spill: OOM while reading irregular varchar data Key: DRILL-5616 URL: https://issues.apache.org/jira/browse/DRILL-5616 Project: Apache Drill

Re: [GitHub] drill issue #831: DRILL-5432: Added pcap-format support

2017-06-28 Thread Parth Chandra
I didn't realize this and, to be honest, I don't know how the other format plugins are handling this. Leave this as it is? On Tue, Jun 27, 2017 at 5:11 PM, paul-rogers wrote: > Github user paul-rogers commented on the issue: > > https://github.com/apache/drill/pull/831

[GitHub] drill pull request #862: DRILL-5420: ParquetAsyncPgReader goes into infinite...

2017-06-28 Thread parthchandra
Github user parthchandra commented on a diff in the pull request: https://github.com/apache/drill/pull/862#discussion_r124659309 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/columnreaders/AsyncPageReader.java --- @@ -409,9 +414,10 @@ public Void

[GitHub] drill issue #862: DRILL-5420: ParquetAsyncPgReader goes into infinite loop d...

2017-06-28 Thread kkhatua
Github user kkhatua commented on the issue: https://github.com/apache/drill/pull/862 @parthchandra Can you please review this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] drill pull request #862: DRILL-5420: ParquetAsyncPgReader goes into infinite...

2017-06-28 Thread kkhatua
GitHub user kkhatua opened a pull request: https://github.com/apache/drill/pull/862 DRILL-5420: ParquetAsyncPgReader goes into infinite loop during cleanup PageQueue is cleaned up using poll() instead of take(), which constantly gets interrupted and causes CPU churn. During a

Re: [DISCUSS] Drill 1.11.0 release

2017-06-28 Thread Parth Chandra
FWIW, I put release instructions culled from gists written by previous release managers into an updated gist here [1] HTH Parth [1] https://github.com/parthchandra/drill/wiki/Drill-Release-Process On Tue, Jun 27, 2017 at 5:24

[jira] [Created] (DRILL-5615) DatabaseMetadata.getColumns fails with SQL Serrver (Unknown SQL type -155)

2017-06-28 Thread N Campbell (JIRA)
N Campbell created DRILL-5615: - Summary: DatabaseMetadata.getColumns fails with SQL Serrver (Unknown SQL type -155) Key: DRILL-5615 URL: https://issues.apache.org/jira/browse/DRILL-5615 Project: Apache

[jira] [Created] (DRILL-5613) DatabaseMetadata.getTables throws exception is the catalog parameter is set to NULL

2017-06-28 Thread N Campbell (JIRA)
N Campbell created DRILL-5613: - Summary: DatabaseMetadata.getTables throws exception is the catalog parameter is set to NULL Key: DRILL-5613 URL: https://issues.apache.org/jira/browse/DRILL-5613 Project: