[GitHub] drill issue #972: DRILL-5838: Fix MaprDB filter pushdown for the case of nes...

Github user paul-rogers commented on the issue: https://github.com/apache/drill/pull/972 I think we have an opportunity here to take as step back and think a bit about design rather than just applying code patches. Drill must handle a large variety of names:

[GitHub] drill pull request #972: DRILL-5838: Fix MaprDB filter pushdown for the case...

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/972#discussion_r143107921 --- Diff: contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/json/JsonConditionBuilder.java --- @@ -159,73 +159,73 @@ private void

[GitHub] drill pull request #972: DRILL-5838: Fix MaprDB filter pushdown for the case...

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/972#discussion_r143107072 --- Diff: logical/src/main/java/org/apache/drill/common/expression/PathSegment.java --- @@ -151,6 +151,15 @@ public boolean isNamed() { return

[GitHub] drill pull request #972: DRILL-5838: Fix MaprDB filter pushdown for the case...

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/972#discussion_r143107377 --- Diff: logical/src/main/java/org/apache/drill/common/expression/SchemaPath.java --- @@ -264,6 +264,56 @@ public String getRootSegmentPath() {

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r143086373 --- Diff: exec/java-exec/src/main/resources/drill-module.conf --- @@ -392,10 +419,12 @@ drill.exec.options: { exec.query_profile.debug_mode:

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r143084043 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DistributedQueryQueue.java --- @@ -0,0 +1,342 @@ +/* + * Licensed

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r143082027 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DefaultResourceManager.java --- @@ -0,0 +1,121 @@ +/* + * Licensed

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r143085902 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/EmbeddedQueryQueue.java --- @@ -0,0 +1,147 @@ +/* + * Licensed to

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r143082265 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DistributedQueryQueue.java --- @@ -0,0 +1,342 @@ +/* + * Licensed

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r143088158 --- Diff: exec/java-exec/src/main/resources/drill-module.conf --- @@ -392,10 +419,12 @@ drill.exec.options: { exec.query_profile.debug_mode:

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r143084915 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DynamicResourceManager.java --- @@ -0,0 +1,125 @@ +/* + * Licensed

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r143085678 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/EmbeddedQueryQueue.java --- @@ -0,0 +1,147 @@ +/* + * Licensed to

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r143083580 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DistributedQueryQueue.java --- @@ -0,0 +1,342 @@ +/* + * Licensed

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r143086005 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/EmbeddedQueryQueue.java --- @@ -0,0 +1,147 @@ +/* + * Licensed to

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r143084292 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DistributedQueryQueue.java --- @@ -0,0 +1,342 @@ +/* + * Licensed

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r143102000 --- Diff: protocol/src/main/java/org/apache/drill/exec/proto/UserBitShared.java --- @@ -12140,6 +12140,31 @@ public Builder clearDef() { */

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r143085493 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DynamicResourceManager.java --- @@ -0,0 +1,125 @@ +/* + * Licensed

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r143100991 --- Diff: exec/java-exec/src/main/resources/rest/index.ftl --- @@ -74,23 +74,66 @@ -Encryption Info +

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r143082463 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DistributedQueryQueue.java --- @@ -0,0 +1,342 @@ +/* + * Licensed

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r143083783 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DistributedQueryQueue.java --- @@ -0,0 +1,342 @@ +/* + * Licensed

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r143082012 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DefaultResourceManager.java --- @@ -0,0 +1,121 @@ +/* + * Licensed

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r143084974 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DynamicResourceManager.java --- @@ -0,0 +1,125 @@ +/* + * Licensed

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r143086088 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/QueryQueue.java --- @@ -0,0 +1,140 @@ +/* + * Licensed to the

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r143081467 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/AbstractResourceManager.java --- @@ -0,0 +1,68 @@ +/* + * Licensed

[jira] [Created] (DRILL-5848) Implement Parquet Columnar Processing & Use Bulk APIs for processing

salim achouche created DRILL-5848: - Summary: Implement Parquet Columnar Processing & Use Bulk APIs for processing Key: DRILL-5848 URL: https://issues.apache.org/jira/browse/DRILL-5848 Project: Apache

Re: Parquet Metadata table on Rolling window

Unfortunately, we do not do incremental metadata updates. If new files are getting added constantly, refresh table metadata will not help. Thanks Padma > On Oct 5, 2017, at 5:36 PM, François Méthot wrote: > > Hi, > > I have been using drill for more than year now, we

Parquet Metadata table on Rolling window

Hi, I have been using drill for more than year now, we are running 1.10. My queries can spend from 5 to 10 minutes for planning because I am dealing with lots of file in HDFS. (then 5 min to 60 min for execution) I maintain a rolling window of data partitionned by the epoch seconds rounded

[GitHub] drill pull request #975: DRILL-5743: Handling column family and column scan ...

GitHub user prasadns14 opened a pull request: https://github.com/apache/drill/pull/975 DRILL-5743: Handling column family and column scan for hbase This PR handles the scenario where the projected column list contains both a column family and a column within the same family.

Hangout minutes for Oct/3 2017

Attendees: Sorabh, Sindhu, Padma, Arina, Vitalii, Volodymyr, Vova, Pritesh, Aman, Vlad, Boaz We discussed about 1.12.0 release timeline, and might want to set the release time to early November. Arina offered to work as release manager for this release and will come up with the timeline

[GitHub] drill issue #974: DRILL-5839: Handle Empty Batches in Merge Receiver

Github user ppadma commented on the issue: https://github.com/apache/drill/pull/974 @paul-rogers Thank you Paul. I made the change and pushed the new diffs. ---

[jira] [Created] (DRILL-5847) Flat Parquet Reader Performance Analysis

salim achouche created DRILL-5847: - Summary: Flat Parquet Reader Performance Analysis Key: DRILL-5847 URL: https://issues.apache.org/jira/browse/DRILL-5847 Project: Apache Drill Issue Type:

[jira] [Created] (DRILL-5846) Improve Parquet Reader Performance for Flat Data types

salim achouche created DRILL-5846: - Summary: Improve Parquet Reader Performance for Flat Data types Key: DRILL-5846 URL: https://issues.apache.org/jira/browse/DRILL-5846 Project: Apache Drill

[GitHub] drill pull request #974: DRILL-5839: Handle Empty Batches in Merge Receiver

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/974#discussion_r143049947 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/mock/MockRecordReader.java --- @@ -52,7 +52,7 @@ public

[GitHub] drill issue #950: DRILL-5431: SSL Support

Github user parthchandra commented on the issue: https://github.com/apache/drill/pull/950 @arina-ielchiieva The `TestSSLConfig.testMissingKeystorePassword` test will fail if the exception is not thrown. The test is checking that the exception is in fact being thrown. Anyway, I added

[GitHub] drill pull request #950: DRILL-5431: SSL Support

Github user parthchandra commented on a diff in the pull request: https://github.com/apache/drill/pull/950#discussion_r143042574 --- Diff: contrib/native/client/src/clientlib/wincert.ipp --- @@ -0,0 +1,98 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

[GitHub] drill pull request #970: DRILL-5832: Migrate OperatorFixture to use SystemOp...

Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/970#discussion_r143017778 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet2/DrillParquetReader.java --- @@ -84,14 +82,7 @@ private RecordReader

[GitHub] drill pull request #970: DRILL-5832: Migrate OperatorFixture to use SystemOp...

Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/970#discussion_r143020963 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/writer/TestParquetWriter.java --- @@ -184,25 +183,26 @@ public void

[GitHub] drill pull request #950: DRILL-5431: SSL Support

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/950#discussion_r142994068 --- Diff: contrib/native/client/src/clientlib/channel.hpp --- @@ -0,0 +1,236 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

[GitHub] drill pull request #950: DRILL-5431: SSL Support

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/950#discussion_r142993025 --- Diff: contrib/native/client/src/clientlib/wincert.ipp --- @@ -0,0 +1,98 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

[jira] [Created] (DRILL-5845) Columns returned by select with "ORDER BY" and "LIMIT" clauses returned in correct order

Vitalii Diravka created DRILL-5845: -- Summary: Columns returned by select with "ORDER BY" and "LIMIT" clauses returned in correct order Key: DRILL-5845 URL: https://issues.apache.org/jira/browse/DRILL-5845

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r142948996 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/EmbeddedQueryQueue.java --- @@ -0,0 +1,147 @@ +/* + * Licensed

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r142702103 --- Diff: exec/java-exec/src/main/resources/rest/index.ftl --- @@ -74,23 +74,66 @@ -Encryption Info +

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r142718897 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DefaultResourceManager.java --- @@ -0,0 +1,121 @@ +/* + *

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r142946871 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DistributedQueryQueue.java --- @@ -0,0 +1,342 @@ +/* + *

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r142944789 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DefaultResourceManager.java --- @@ -0,0 +1,121 @@ +/* + *

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r142726899 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DynamicResourceManager.java --- @@ -0,0 +1,125 @@ +/* + *

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r142943128 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DynamicResourceManager.java --- @@ -0,0 +1,125 @@ +/* + *

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r142723896 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DistributedQueryQueue.java --- @@ -0,0 +1,342 @@ +/* + *

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r142954623 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DistributedQueryQueue.java --- @@ -0,0 +1,342 @@ +/* + *

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r142967011 --- Diff: exec/java-exec/src/main/resources/drill-module.conf --- @@ -392,10 +419,12 @@ drill.exec.options: {

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r142935606 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DistributedQueryQueue.java --- @@ -0,0 +1,342 @@ +/* + *

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r142727260 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/EmbeddedQueryQueue.java --- @@ -0,0 +1,147 @@ +/* + * Licensed

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r142933298 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/AbstractResourceManager.java --- @@ -0,0 +1,68 @@ +/* + *

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r142726171 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DynamicResourceManager.java --- @@ -0,0 +1,125 @@ +/* + *

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r142721394 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DistributedQueryQueue.java --- @@ -0,0 +1,342 @@ +/* + *

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r142719680 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/QueryQueue.java --- @@ -0,0 +1,140 @@ +/* + * Licensed to the

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r142721931 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/DistributedQueryQueue.java --- @@ -0,0 +1,342 @@ +/* + *

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r142944163 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/rm/EmbeddedQueryQueue.java --- @@ -0,0 +1,147 @@ +/* + * Licensed

[GitHub] drill pull request #928: DRILL-5716: Queue-driven memory allocation

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/928#discussion_r142707486 --- Diff: exec/java-exec/src/main/resources/rest/index.ftl --- @@ -74,23 +74,66 @@ -Encryption Info +

[GitHub] drill pull request #950: DRILL-5431: SSL Support

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/950#discussion_r142862510 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/TestSSLConfig.java --- @@ -49,12 +64,19 @@ public void testMissingKeystorePassword()

[GitHub] drill pull request #950: DRILL-5431: SSL Support

Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/950#discussion_r142861999 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/rpc/user/security/TestUserBitSSL.java --- @@ -223,9 +223,12 @@ public void

[jira] [Created] (DRILL-5844) Incorrect values of TABLE_TYPE returned from method DatabaseMetaData.getTables of JDBC API

second88 created DRILL-5844: --- Summary: Incorrect values of TABLE_TYPE returned from method DatabaseMetaData.getTables of JDBC API Key: DRILL-5844 URL: https://issues.apache.org/jira/browse/DRILL-5844

[jira] [Created] (DRILL-5843) Incorrect values of INFORMATION_SCHEMA.TABLES.TABLE_TYPE

second88 created DRILL-5843: --- Summary: Incorrect values of INFORMATION_SCHEMA.TABLES.TABLE_TYPE Key: DRILL-5843 URL: https://issues.apache.org/jira/browse/DRILL-5843 Project: Apache Drill Issue