[GitHub] drill pull request #1058: DRILL-6002: Avoid memory copy from direct buffer t...

2018-01-10 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/1058#discussion_r160841030 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/spill/SpillSet.java --- @@ -107,7 +107,7 @@ * nodes provide

[GitHub] drill issue #1069: DRILL-5994 Added webserver maxThreads configuration optio...

2018-01-10 Thread vrozov
Github user vrozov commented on the issue: https://github.com/apache/drill/pull/1069 @MitchelLabonte My proposal is to limit the number of acceptors instead of allowing to increase the max number of threads in the connection pool. If the number of acceptors is limited, the number of

[GitHub] drill issue #1069: DRILL-5994 Added webserver maxThreads configuration optio...

2018-01-10 Thread MitchelLabonte
Github user MitchelLabonte commented on the issue: https://github.com/apache/drill/pull/1069 @vrozov the Web server definitely doesn't need this much, but Drill won't launch on a machine with more than 200 cores and throw an exception: Exception in thread "main"

[jira] [Created] (DRILL-6080) Sort incorrectly limits batch size to 65535 records rather than 65536

2018-01-10 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-6080: -- Summary: Sort incorrectly limits batch size to 65535 records rather than 65536 Key: DRILL-6080 URL: https://issues.apache.org/jira/browse/DRILL-6080 Project: Apache

[GitHub] drill issue #1069: DRILL-5994 Added webserver maxThreads configuration optio...

2018-01-10 Thread vrozov
Github user vrozov commented on the issue: https://github.com/apache/drill/pull/1069 @MitchelLabonte @arina-ielchiieva I don't think that Drill needs that many threads/acceptors to handle HTTP(s) requests as it is not a real web (REST API) server. For proper resource utilization, it

[GitHub] drill pull request #1082: DRILL-5741: Automatically manage memory allocation...

2018-01-10 Thread kkhatua
Github user kkhatua commented on a diff in the pull request: https://github.com/apache/drill/pull/1082#discussion_r160803438 --- Diff: distribution/src/resources/drill-config.sh --- @@ -180,18 +251,46 @@ else fi fi -# Default memory settings if none provided

[GitHub] drill pull request #1082: DRILL-5741: Automatically manage memory allocation...

2018-01-10 Thread kkhatua
Github user kkhatua commented on a diff in the pull request: https://github.com/apache/drill/pull/1082#discussion_r160802962 --- Diff: distribution/src/assemble/bin.xml --- @@ -345,6 +345,16 @@ 0755 conf + +

[GitHub] drill pull request #1072: DRILL-5879: Improved SQL Pattern Contains Performa...

2018-01-10 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1072#discussion_r160759375 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl/SqlPatternContainsMatcher.java --- @@ -19,44 +19,283 @@ import

[GitHub] drill pull request #1072: DRILL-5879: Improved SQL Pattern Contains Performa...

2018-01-10 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1072#discussion_r160763490 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl/SqlPatternContainsMatcher.java --- @@ -19,44 +19,283 @@ import

[GitHub] drill pull request #1072: DRILL-5879: Improved SQL Pattern Contains Performa...

2018-01-10 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1072#discussion_r160753323 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl/SqlPatternContainsMatcher.java --- @@ -19,44 +19,283 @@ import

[GitHub] drill pull request #1072: DRILL-5879: Improved SQL Pattern Contains Performa...

2018-01-10 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1072#discussion_r160765882 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/expr/fn/impl/TestSqlPatterns.java --- @@ -446,6 +446,61 @@ public void

[GitHub] drill pull request #1072: DRILL-5879: Improved SQL Pattern Contains Performa...

2018-01-10 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1072#discussion_r160755097 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl/SqlPatternContainsMatcher.java --- @@ -19,44 +19,283 @@ import

[GitHub] drill pull request #1072: DRILL-5879: Improved SQL Pattern Contains Performa...

2018-01-10 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1072#discussion_r160758370 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl/SqlPatternContainsMatcher.java --- @@ -19,44 +19,283 @@ import

[GitHub] drill pull request #1072: DRILL-5879: Improved SQL Pattern Contains Performa...

2018-01-10 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1072#discussion_r160764681 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl/SqlPatternContainsMatcher.java --- @@ -19,44 +19,283 @@ import

[GitHub] drill pull request #1072: DRILL-5879: Improved SQL Pattern Contains Performa...

2018-01-10 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1072#discussion_r160754694 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl/SqlPatternContainsMatcher.java --- @@ -19,44 +19,283 @@ import

[GitHub] drill pull request #570: DRILL-4834 decimal implementation is vulnerable to ...

2018-01-10 Thread daveoshinsky
Github user daveoshinsky commented on a diff in the pull request: https://github.com/apache/drill/pull/570#discussion_r160792114 --- Diff: exec/vector/src/main/java/org/apache/drill/exec/util/DecimalUtility.java --- @@ -159,9 +159,20 @@ public static BigDecimal

[GitHub] drill pull request #570: DRILL-4834 decimal implementation is vulnerable to ...

2018-01-10 Thread daveoshinsky
Github user daveoshinsky commented on a diff in the pull request: https://github.com/apache/drill/pull/570#discussion_r160791971 --- Diff: exec/vector/src/main/codegen/templates/VariableLengthVectors.java --- @@ -539,7 +553,12 @@ public void setValueLengthSafe(int index, int

[GitHub] drill pull request #570: DRILL-4834 decimal implementation is vulnerable to ...

2018-01-10 Thread daveoshinsky
Github user daveoshinsky commented on a diff in the pull request: https://github.com/apache/drill/pull/570#discussion_r160790684 --- Diff: exec/vector/src/main/codegen/templates/ComplexWriters.java --- @@ -99,7 +99,7 @@ public void write(Nullable${minor.class?cap_first}Holder h) {

[GitHub] drill pull request #570: DRILL-4834 decimal implementation is vulnerable to ...

2018-01-10 Thread daveoshinsky
Github user daveoshinsky commented on a diff in the pull request: https://github.com/apache/drill/pull/570#discussion_r160786416 --- Diff: exec/java-exec/src/main/codegen/templates/StringOutputRecordWriter.java --- @@ -146,7 +146,7 @@ public void writeField() throws IOException {

[GitHub] drill pull request #570: DRILL-4834 decimal implementation is vulnerable to ...

2018-01-10 Thread daveoshinsky
Github user daveoshinsky commented on a diff in the pull request: https://github.com/apache/drill/pull/570#discussion_r160785721 --- Diff: exec/java-exec/src/main/codegen/templates/SqlAccessors.java --- @@ -127,6 +127,25 @@ public String getString(int index) { }

[GitHub] drill pull request #570: DRILL-4834 decimal implementation is vulnerable to ...

2018-01-10 Thread daveoshinsky
Github user daveoshinsky commented on a diff in the pull request: https://github.com/apache/drill/pull/570#discussion_r160779892 --- Diff: exec/java-exec/src/main/codegen/templates/Decimal/DecimalFunctions.java --- @@ -102,7 +111,578 @@ <#-- For each DECIMAL... type (in

[GitHub] drill pull request #570: DRILL-4834 decimal implementation is vulnerable to ...

2018-01-10 Thread daveoshinsky
Github user daveoshinsky commented on a diff in the pull request: https://github.com/apache/drill/pull/570#discussion_r160777281 --- Diff: exec/java-exec/src/main/codegen/templates/Decimal/CastIntDecimal.java --- @@ -68,15 +68,31 @@ public void setup() { public void

[GitHub] drill pull request #570: DRILL-4834 decimal implementation is vulnerable to ...

2018-01-10 Thread daveoshinsky
Github user daveoshinsky commented on a diff in the pull request: https://github.com/apache/drill/pull/570#discussion_r160776544 --- Diff: exec/java-exec/src/main/codegen/templates/Decimal/DecimalAggrTypeFunctions2.java --- @@ -108,9 +108,12 @@ public void output() {

[GitHub] drill issue #1086: DRILL-6076: Reduce the default memory from a total of 13G...

2018-01-10 Thread priteshm
Github user priteshm commented on the issue: https://github.com/apache/drill/pull/1086 @paul-rogers, @parthchandra can you review/ comment on this change? ---

[HANGOUT] Minutes Jan 9, 2018

2018-01-10 Thread Vlad Rozov
Attendees: Arina, Paul, Pritesh, Vitalii, Volodymyr, Vova, Vlad, Sorabh, Anil, Hanumath, Boaz, Karthik Discussion topics and action items: - Support Java 8 in 1.13.0 by default. Community to continue work on several JIRAs (see

[jira] [Resolved] (DRILL-5833) Parquet reader fails with assertion error for Decimal9, Decimal18 types

2018-01-10 Thread Paul Rogers (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers resolved DRILL-5833. Resolution: Fixed > Parquet reader fails with assertion error for Decimal9, Decimal18 types >

[GitHub] drill pull request #1078: DRILL-6054: don't try to split the filter when it ...

2018-01-10 Thread chunhui-shi
Github user chunhui-shi commented on a diff in the pull request: https://github.com/apache/drill/pull/1078#discussion_r160741806 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/logical/partition/FindPartitionConditions.java --- @@ -195,8 +195,16 @@ private

[GitHub] drill pull request #1078: DRILL-6054: don't try to split the filter when it ...

2018-01-10 Thread chunhui-shi
Github user chunhui-shi commented on a diff in the pull request: https://github.com/apache/drill/pull/1078#discussion_r160741771 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/logical/partition/FindPartitionConditions.java --- @@ -228,13 +236,16 @@ private

[GitHub] drill pull request #1001: JIRA DRILL-5879: Like operator performance improve...

2018-01-10 Thread sachouche
Github user sachouche closed the pull request at: https://github.com/apache/drill/pull/1001 ---

[GitHub] drill issue #1001: JIRA DRILL-5879: Like operator performance improvements

2018-01-10 Thread sachouche
Github user sachouche commented on the issue: https://github.com/apache/drill/pull/1001 Created another pull request #1072to merge my changes with the one done with Padma's. ---

[GitHub] drill issue #1087: Attempt to fix memory leak in Parquet

2018-01-10 Thread sachouche
Github user sachouche commented on the issue: https://github.com/apache/drill/pull/1087 Thank you Arina for catching this; I created the commit for QA before vacation so that they could verify the fix. At that time, I didn't have an Apache JIRA. I have now updated the comment to

[GitHub] drill pull request #1083: DRILL-4185: UNION ALL involving empty directory on...

2018-01-10 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1083#discussion_r160717181 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/ParquetFormatPlugin.java --- @@ -250,20 +250,12 @@ private boolean

[GitHub] drill pull request #1083: DRILL-4185: UNION ALL involving empty directory on...

2018-01-10 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1083#discussion_r160711830 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/base/SchemalessScan.java --- @@ -0,0 +1,90 @@ +/* + * Licensed to

[GitHub] drill pull request #1083: DRILL-4185: UNION ALL involving empty directory on...

2018-01-10 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1083#discussion_r160712431 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/dfs/FileSelection.java --- @@ -424,6 +429,23 @@ public MetadataContext

[GitHub] drill pull request #1083: DRILL-4185: UNION ALL involving empty directory on...

2018-01-10 Thread vdiravka
Github user vdiravka commented on a diff in the pull request: https://github.com/apache/drill/pull/1083#discussion_r160685002 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/ParquetFormatPlugin.java --- @@ -250,20 +250,12 @@ private boolean

[GitHub] drill pull request #1083: DRILL-4185: UNION ALL involving empty directory on...

2018-01-10 Thread vdiravka
Github user vdiravka commented on a diff in the pull request: https://github.com/apache/drill/pull/1083#discussion_r160666020 --- Diff: exec/java-exec/src/test/java/org/apache/drill/test/BaseTestQuery.java --- @@ -119,6 +125,15 @@ public static void setupDefaultTestCluster()

[GitHub] drill pull request #1083: DRILL-4185: UNION ALL involving empty directory on...

2018-01-10 Thread vdiravka
Github user vdiravka commented on a diff in the pull request: https://github.com/apache/drill/pull/1083#discussion_r160663414 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/base/SchemalessScan.java --- @@ -0,0 +1,80 @@ +/* + * Licensed to the Apache

[GitHub] drill pull request #1083: DRILL-4185: UNION ALL involving empty directory on...

2018-01-10 Thread vdiravka
Github user vdiravka commented on a diff in the pull request: https://github.com/apache/drill/pull/1083#discussion_r160663989 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/TestEmptyInputSql.java --- @@ -177,4 +177,33 @@ public void testQueryEmptyCsv() throws

[GitHub] drill pull request #1083: DRILL-4185: UNION ALL involving empty directory on...

2018-01-10 Thread vdiravka
Github user vdiravka commented on a diff in the pull request: https://github.com/apache/drill/pull/1083#discussion_r160664191 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/store/parquet/TestParquetGroupScan.java --- @@ -56,65 +56,50 @@ private void

[GitHub] drill pull request #1083: DRILL-4185: UNION ALL involving empty directory on...

2018-01-10 Thread vdiravka
Github user vdiravka commented on a diff in the pull request: https://github.com/apache/drill/pull/1083#discussion_r160663507 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/sql/handlers/RefreshMetadataHandler.java --- @@ -78,19 +78,24 @@ public PhysicalPlan

[GitHub] drill pull request #1083: DRILL-4185: UNION ALL involving empty directory on...

2018-01-10 Thread vdiravka
Github user vdiravka commented on a diff in the pull request: https://github.com/apache/drill/pull/1083#discussion_r160663899 --- Diff: exec/java-exec/src/test/java/org/apache/drill/TestUnionAll.java --- @@ -1197,4 +1197,64 @@ public void testFieldWithDots() throws Exception {

[GitHub] drill pull request #1083: DRILL-4185: UNION ALL involving empty directory on...

2018-01-10 Thread vdiravka
Github user vdiravka commented on a diff in the pull request: https://github.com/apache/drill/pull/1083#discussion_r160666274 --- Diff: exec/java-exec/src/test/java/org/apache/drill/test/BaseTestQuery.java --- @@ -119,6 +125,15 @@ public static void setupDefaultTestCluster()

Re: Drill Hangout Jan 9, 2018

2018-01-10 Thread Arina Yelchiyeva
During hangout was decided to support JDK 8 by default in Apache Drill 1.13.0. We'l consider moving to Java 9 afterwards. There is already open Jira for this issue - https://issues.apache.org/jira/browse/DRILL-1491. I have linked all other related issue to it as well. Also it seems there is an

[GitHub] drill issue #1074: DRILL-6025: Display execution time of a query in RUNNING ...

2018-01-10 Thread arina-ielchiieva
Github user arina-ielchiieva commented on the issue: https://github.com/apache/drill/pull/1074 @prasadns14 please resolve the conflicts. ---

[GitHub] drill pull request #1078: DRILL-6054: don't try to split the filter when it ...

2018-01-10 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1078#discussion_r160665449 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/logical/partition/FindPartitionConditions.java --- @@ -195,8 +195,16 @@

[GitHub] drill pull request #1078: DRILL-6054: don't try to split the filter when it ...

2018-01-10 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1078#discussion_r160664549 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/logical/partition/FindPartitionConditions.java --- @@ -228,13 +236,16 @@

[GitHub] drill issue #1087: Attempt to fix memory leak in Parquet

2018-01-10 Thread arina-ielchiieva
Github user arina-ielchiieva commented on the issue: https://github.com/apache/drill/pull/1087 @sachouche do you have Jira for this fix (if not please create it)? Could you please include Jira number in PR and description and PR commit message (it's a Drill standard) [1, 2, 3].

[GitHub] drill pull request #1084: DRILL-5868: Support SQL syntax highlighting of que...

2018-01-10 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1084#discussion_r160650090 --- Diff: exec/java-exec/src/main/resources/rest/static/js/ace-code-editor/snippets/sql.js --- @@ -0,0 +1,46 @@ +/** + * Drill SQL Syntax

[GitHub] drill pull request #1084: DRILL-5868: Support SQL syntax highlighting of que...

2018-01-10 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1084#discussion_r160650903 --- Diff: exec/java-exec/src/main/resources/rest/static/js/ace-code-editor/snippets/sql.js --- @@ -0,0 +1,46 @@ +/** + * Drill SQL Syntax

[GitHub] drill pull request #1084: DRILL-5868: Support SQL syntax highlighting of que...

2018-01-10 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1084#discussion_r160651815 --- Diff: exec/java-exec/src/main/resources/rest/static/js/ace-code-editor/snippets/sql.js --- @@ -0,0 +1,46 @@ +/** + * Drill SQL Syntax

[jira] [Resolved] (DRILL-5037) NPE in Parquet Decimal Converter with the complex parquet reader

2018-01-10 Thread Volodymyr Vysotskyi (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-5037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Volodymyr Vysotskyi resolved DRILL-5037. Resolution: Fixed Fix Version/s: 1.12.0 Fixed in