[GitHub] drill issue #1234: DRILL-5927: Fixed memory leak in TestBsonRecordReader, an...

2018-04-25 Thread ilooner
Github user ilooner commented on the issue: https://github.com/apache/drill/pull/1234 @parthchandra Please let me know if you have any comments. ---

Display column data type without code

2018-04-25 Thread Paul Rogers
Hi All, Anyone know if there is a non-code way to display the data types of columns returned from a Drill query? Sqlline appears to only show the column names and values. The same is true of the Drill web console. The EXPLAIN PLAN FOR ... command shows the query plan, but not type (which are

[GitHub] drill issue #1184: DRILL-6242 - Use java.sql.[Date|Time|Timestamp] classes t...

2018-04-25 Thread paul-rogers
Github user paul-rogers commented on the issue: https://github.com/apache/drill/pull/1184 Sorry, coming late. There seem to be two problems. The original "nested column" issue is an artifact of the JDBC driver. In Drill, a Map (the thing that contains your nested column) is just a

[jira] [Created] (DRILL-6359) All-text mode in JSON still reads missing column as Nullable Int

2018-04-25 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-6359: -- Summary: All-text mode in JSON still reads missing column as Nullable Int Key: DRILL-6359 URL: https://issues.apache.org/jira/browse/DRILL-6359 Project: Apache Drill

Re: Display column data type without code

2018-04-25 Thread Abhishek Girish
Hey Paul, You could use the typeof() function for this purpose. It takes a single parameter - the column name. For example: > select typeof(c_current_cdemo_sk) from customer limit 1; +-+ | EXPR$0 | +-+ | BIGINT | +-+ 1 row selected (0.472 seconds) On Wed, Apr 25, 2018

[jira] [Created] (DRILL-6358) Null value returned from WHERE a IS NOT NULL query

2018-04-25 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-6358: -- Summary: Null value returned from WHERE a IS NOT NULL query Key: DRILL-6358 URL: https://issues.apache.org/jira/browse/DRILL-6358 Project: Apache Drill Issue

[GitHub] drill pull request #1228: DRILL-6307: Handle empty batches in record batch s...

2018-04-25 Thread ppadma
Github user ppadma commented on a diff in the pull request: https://github.com/apache/drill/pull/1228#discussion_r184258865 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/record/RecordBatchSizer.java --- @@ -536,6 +556,11 @@ public ColumnSize getColumn(String name)

Re: Display column data type without code

2018-04-25 Thread Aman Sinha
You can do it through SQL using typeof() function. Since there is no global schema, Drill evaluates this for each row. 0: jdbc:drill:drillbit=10.10.101.41> select n_name, typeof(n_name) as name_type, n_nationkey, typeof(n_nationkey) as nationkey_type from cp.`tpch/nation.parquet` limit 2;

[jira] [Created] (DRILL-6357) Unexpected column "**" when reading a JSON file

2018-04-25 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-6357: -- Summary: Unexpected column "**" when reading a JSON file Key: DRILL-6357 URL: https://issues.apache.org/jira/browse/DRILL-6357 Project: Apache Drill Issue Type:

[GitHub] drill pull request #1228: DRILL-6307: Handle empty batches in record batch s...

2018-04-25 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/1228#discussion_r184264961 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/record/RecordBatchSizer.java --- @@ -536,6 +556,11 @@ public ColumnSize getColumn(String

[GitHub] drill pull request #1234: DRILL-5927: Fixed memory leak in TestBsonRecordRea...

2018-04-25 Thread ilooner
Github user ilooner commented on a diff in the pull request: https://github.com/apache/drill/pull/1234#discussion_r183956964 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/store/bson/TestBsonRecordReader.java --- @@ -45,21 +46,24 @@ import

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-25 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1214#discussion_r183983380 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/AbstractParquetGroupScan.java --- @@ -0,0 +1,462 @@ +/* + *

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-25 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1214#discussion_r183981672 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/RowGroupInfo.java --- @@ -0,0 +1,95 @@ +/* +* Licensed to the

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-25 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1214#discussion_r183981543 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/ParquetRowGroupScan.java --- @@ -40,31 +36,26 @@ import

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-25 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1214#discussion_r183981479 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/ParquetGroupScanStatistics.java --- @@ -0,0 +1,217 @@ +/* + *

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-25 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1214#discussion_r183981425 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/AbstractParquetScanBatchCreator.java --- @@ -0,0 +1,195 @@ +/*

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-25 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1214#discussion_r183981354 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/AbstractParquetScanBatchCreator.java --- @@ -0,0 +1,195 @@ +/*

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-25 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1214#discussion_r183980574 --- Diff: contrib/storage-hive/core/src/main/java/org/apache/drill/exec/store/hive/HiveDrillNativeParquetScan.java --- @@ -1,114 +1,223 @@ /*

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-25 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1214#discussion_r183980539 --- Diff: contrib/storage-hive/core/src/main/java/org/apache/drill/exec/store/hive/HiveDrillNativeParquetRowGroupScan.java --- @@ -0,0 +1,130 @@

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-25 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1214#discussion_r183981250 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/ColumnExplorer.java --- @@ -156,43 +157,74 @@ public static boolean

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-25 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1214#discussion_r183981138 --- Diff: contrib/storage-hive/core/src/test/java/org/apache/drill/exec/store/hive/HiveTestDataGenerator.java --- @@ -64,16 +68,17 @@ public

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-25 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1214#discussion_r183980496 --- Diff: contrib/storage-hive/core/src/main/java/org/apache/drill/exec/planner/sql/logical/ConvertHiveParquetScanToDrillParquetScan.java --- @@

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-25 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1214#discussion_r183980928 --- Diff: contrib/storage-hive/core/src/test/java/org/apache/drill/exec/TestHiveDrillNativeParquetReader.java --- @@ -0,0 +1,247 @@ +/* +*

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-25 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1214#discussion_r183983280 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/AbstractParquetGroupScan.java --- @@ -0,0 +1,462 @@ +/* + *

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-25 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1214#discussion_r183982099 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/RowGroupInfo.java --- @@ -0,0 +1,95 @@ +/* +* Licensed to the

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-25 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1214#discussion_r183980648 --- Diff: contrib/storage-hive/core/src/test/java/org/apache/drill/exec/TestHiveDrillNativeParquetReader.java --- @@ -0,0 +1,247 @@ +/* +*

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-25 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1214#discussion_r183981301 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/dfs/easy/EasyFormatPlugin.java --- @@ -147,10 +147,12 @@ CloseableRecordBatch

[GitHub] drill issue #1214: DRILL-6331: Revisit Hive Drill native parquet implementat...

2018-04-25 Thread arina-ielchiieva
Github user arina-ielchiieva commented on the issue: https://github.com/apache/drill/pull/1214 @vdiravka thanks for the code review! Addressed code review comment. ---

[GitHub] drill issue #1234: DRILL-5927: Fixed memory leak in TestBsonRecordReader, an...

2018-04-25 Thread vrozov
Github user vrozov commented on the issue: https://github.com/apache/drill/pull/1234 LGTM ---

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184070218 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/record/RawFragmentBatch.java --- @@ -77,4 +83,46 @@ public long getByteCount() { public

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184075517 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/record/RawFragmentBatch.java --- @@ -77,4 +83,46 @@ public long getByteCount() { public

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184084128 --- Diff: exec/memory/base/src/main/java/org/apache/drill/exec/memory/AllocationManager.java --- @@ -253,10 +261,12 @@ public boolean transferBalance(final

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184085544 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/unorderedreceiver/UnorderedReceiverBatch.java --- @@ -153,8 +153,10 @@ private

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184050305 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/unorderedreceiver/UnorderedReceiverBatch.java --- @@ -182,13 +184,18 @@ public

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184068798 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/unorderedreceiver/UnorderedReceiverBatch.java --- @@ -153,8 +153,10 @@ private

[GitHub] drill pull request #1189: DRILL-6282: Excluding io.dropwizard.metrics depend...

2018-04-25 Thread vdiravka
Github user vdiravka commented on a diff in the pull request: https://github.com/apache/drill/pull/1189#discussion_r184024460 --- Diff: pom.xml --- @@ -1164,7 +1164,27 @@ io.dropwizard.metrics metrics-core -4.0.2 +

[GitHub] drill pull request #1189: DRILL-6282: Excluding io.dropwizard.metrics depend...

2018-04-25 Thread vdiravka
Github user vdiravka commented on a diff in the pull request: https://github.com/apache/drill/pull/1189#discussion_r184066086 --- Diff: pom.xml --- @@ -1333,6 +1353,12 @@ + --- End diff -- I thought that Drill uses

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184049558 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/unorderedreceiver/UnorderedReceiverBatch.java --- @@ -201,6 +208,11 @@ public

[GitHub] drill pull request #1189: DRILL-6282: Excluding io.dropwizard.metrics depend...

2018-04-25 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1189#discussion_r184144021 --- Diff: logical/pom.xml --- @@ -85,14 +85,12 @@ - com.codahale.metrics + io.dropwizard.metrics --- End

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184146733 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/unorderedreceiver/UnorderedReceiverBatch.java --- @@ -182,13 +184,18 @@ public

[GitHub] drill pull request #1239: DRILL-143: CGroup Support for Drill-on-YARN

2018-04-25 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/1239#discussion_r184144439 --- Diff: distribution/src/resources/yarn-drillbit.sh --- @@ -175,4 +209,11 @@ fi echo "`date` Starting drillbit on `hostname` under YARN, logging

[GitHub] drill pull request #1230: DRILL-6345: DRILL Query fails on Function LOG10

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1230#discussion_r184144882 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/fn/impl/TestNewMathFunctions.java --- @@ -132,4 +148,200 @@ public void testIsNumeric()

[GitHub] drill pull request #1230: DRILL-6345: DRILL Query fails on Function LOG10

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1230#discussion_r184106411 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/fn/impl/TestNewMathFunctions.java --- @@ -132,4 +148,200 @@ public void testIsNumeric()

[GitHub] drill pull request #1230: DRILL-6345: DRILL Query fails on Function LOG10

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1230#discussion_r184110535 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/fn/impl/TestNewMathFunctions.java --- @@ -132,4 +148,200 @@ public void testIsNumeric()

[GitHub] drill pull request #1230: DRILL-6345: DRILL Query fails on Function LOG10

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1230#discussion_r184138785 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/fn/impl/TestNewMathFunctions.java --- @@ -132,4 +148,200 @@ public void testIsNumeric()

[GitHub] drill pull request #1230: DRILL-6345: DRILL Query fails on Function LOG10

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1230#discussion_r184145427 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/fn/impl/TestNewMathFunctions.java --- @@ -20,12 +20,20 @@ import static

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-25 Thread parthchandra
Github user parthchandra commented on a diff in the pull request: https://github.com/apache/drill/pull/1214#discussion_r183909850 --- Diff: common/src/main/java/org/apache/drill/common/Stopwatch.java --- @@ -0,0 +1,186 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] drill pull request #1230: DRILL-6345: DRILL Query fails on Function LOG10

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1230#discussion_r184107121 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/fn/impl/TestNewMathFunctions.java --- @@ -132,4 +148,200 @@ public void testIsNumeric()

[GitHub] drill pull request #1230: DRILL-6345: DRILL Query fails on Function LOG10

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1230#discussion_r184138601 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/fn/impl/TestNewMathFunctions.java --- @@ -132,4 +148,200 @@ public void testIsNumeric()

[GitHub] drill issue #1239: DRILL-143: CGroup Support for Drill-on-YARN

2018-04-25 Thread paul-rogers
Github user paul-rogers commented on the issue: https://github.com/apache/drill/pull/1239 There may be some misunderstanding of how DoY works. The only info that users can pass to DoY is that which is in the DoY config file. We should add arguments to that file which will be passed

[GitHub] drill issue #1189: DRILL-6282: Excluding io.dropwizard.metrics dependencies

2018-04-25 Thread vrozov
Github user vrozov commented on the issue: https://github.com/apache/drill/pull/1189 Please update JIRA, PR and commit titles and squash commits. ---

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r184004929 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/ScanBatch.java --- @@ -409,7 +409,7 @@ public void clear() {

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r184062425 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/columnreaders/ParquetFixedWidthDictionaryReaders.java --- @@ -248,27 +227,61

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r184099659 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/sql/SqlConverter.java --- @@ -559,6 +560,19 @@ public RexNode makeCast(RelDataType

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r184008307 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/ParquetRecordWriter.java --- @@ -228,14 +232,33 @@ private void newSchema()

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r184027803 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/common/DrillValuesRelBase.java --- @@ -169,12 +168,12 @@ private static void

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r184061116 --- Diff: exec/java-exec/src/test/java/org/apache/drill/PlanningBase.java --- @@ -20,12 +20,17 @@ import java.io.IOException; import

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r184012035 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/join/TestNestedLoopJoin.java --- @@ -409,4 +409,30 @@ public void

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r184035111 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/fn/impl/TestVarDecimalFunctions.java --- @@ -0,0 +1,911 @@ +/* + * Licensed to the

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r184008988 --- Diff: exec/vector/src/main/codegen/templates/NullReader.java --- @@ -31,19 +31,19 @@ * This class is generated using freemarker and the

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r184065631 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/window/FrameSupportTemplate.java --- @@ -300,7 +300,7 @@ public void

[GitHub] drill issue #1239: DRILL-143: CGroup Support for Drill-on-YARN

2018-04-25 Thread kkhatua
Github user kkhatua commented on the issue: https://github.com/apache/drill/pull/1239 Thanks for that pointer, @paul-rogers ! I'll make the relevant changes and add to this commit. ---

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-25 Thread parthchandra
Github user parthchandra commented on a diff in the pull request: https://github.com/apache/drill/pull/1214#discussion_r183919198 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/ops/BaseOperatorContext.java --- @@ -158,25 +159,26 @@ public void close() { }

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r184051298 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/store/parquet/TestFixedlenDecimal.java --- @@ -20,61 +20,74 @@ import

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r184035055 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/fn/impl/TestVarDecimalFunctions.java --- @@ -0,0 +1,911 @@ +/* + * Licensed to the

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r184002128 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/output/DecimalReturnTypeInference.java --- @@ -281,20 +295,45 @@ @Override

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r184002812 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/stat/RangeExprEvaluator.java --- @@ -219,6 +219,7 @@ private Statistics

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r184008881 --- Diff: exec/vector/src/main/codegen/templates/AbstractPromotableFieldWriter.java --- @@ -75,12 +75,19 @@ public void endList() { <#list

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r184010194 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/store/parquet/TestVarlenDecimal.java --- @@ -0,0 +1,153 @@ +/* + * Licensed to the

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r184031285 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/sql/TypeInferenceUtils.java --- @@ -382,13 +407,26 @@ public RelDataType

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r184028590 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/sql/TypeInferenceUtils.java --- @@ -668,46 +706,95 @@ public RelDataType

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r184007677 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl/Hash64WithSeedAsDouble.java --- @@ -265,6 +268,42 @@ public void eval() {

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r183998600 --- Diff: contrib/storage-jdbc/src/main/java/org/apache/drill/exec/store/jdbc/JdbcRecordReader.java --- @@ -225,10 +247,10 @@ public int next() {

[GitHub] drill pull request #1232: DRILL-6094: Decimal data type enhancements

2018-04-25 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/1232#discussion_r184008595 --- Diff: exec/vector/src/main/codegen/templates/AbstractFieldReader.java --- @@ -29,9 +29,9 @@ * This class is generated using freemarker and the

[jira] [Created] (DRILL-6355) Decimal data type enhancements for pre-planning stage

2018-04-25 Thread Volodymyr Vysotskyi (JIRA)
Volodymyr Vysotskyi created DRILL-6355: -- Summary: Decimal data type enhancements for pre-planning stage Key: DRILL-6355 URL: https://issues.apache.org/jira/browse/DRILL-6355 Project: Apache Drill

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184114148 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/unorderedreceiver/UnorderedReceiverBatch.java --- @@ -153,8 +153,10 @@ private

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184117938 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/unorderedreceiver/UnorderedReceiverBatch.java --- @@ -182,13 +184,18 @@ public

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184138876 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/record/RawFragmentBatch.java --- @@ -77,4 +83,46 @@ public long getByteCount() {

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184112400 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/unorderedreceiver/UnorderedReceiverBatch.java --- @@ -153,8 +153,10 @@ private

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184140733 --- Diff: exec/memory/base/src/main/java/org/apache/drill/exec/memory/AllocationManager.java --- @@ -253,10 +261,12 @@ public boolean

[GitHub] drill pull request #1189: DRILL-6282: Excluding io.dropwizard.metrics depend...

2018-04-25 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1189#discussion_r184144853 --- Diff: pom.xml --- @@ -1333,6 +1353,12 @@ + --- End diff -- I am not sure why is it

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184154997 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/record/RawFragmentBatch.java --- @@ -77,4 +83,46 @@ public long getByteCount() { public

[GitHub] drill pull request #1240: DRILL-6327: Update unary operators to handle IterO...

2018-04-25 Thread sohami
GitHub user sohami opened a pull request: https://github.com/apache/drill/pull/1240 DRILL-6327: Update unary operators to handle IterOutcome.EMIT Note: Handles for Non-Blocking Unary operators (like Filter/Project/etc) with EMIT Iter.Outcome You can merge this pull

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184197278 --- Diff: exec/memory/base/src/main/java/org/apache/drill/exec/memory/AllocationManager.java --- @@ -253,10 +261,12 @@ public boolean

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184197379 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/unorderedreceiver/UnorderedReceiverBatch.java --- @@ -153,8 +153,10 @@ private

[GitHub] drill pull request #1239: DRILL-143: CGroup Support for Drill-on-YARN

2018-04-25 Thread kkhatua
Github user kkhatua commented on a diff in the pull request: https://github.com/apache/drill/pull/1239#discussion_r184153040 --- Diff: distribution/src/resources/yarn-drillbit.sh --- @@ -175,4 +209,11 @@ fi echo "`date` Starting drillbit on `hostname` under YARN, logging to

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184156922 --- Diff: exec/memory/base/src/main/java/org/apache/drill/exec/memory/AllocationManager.java --- @@ -253,10 +261,12 @@ public boolean transferBalance(final

[GitHub] drill issue #1240: DRILL-6327: Update unary operators to handle IterOutcome....

2018-04-25 Thread sohami
Github user sohami commented on the issue: https://github.com/apache/drill/pull/1240 @parthchandra - please help to review this PR. ---

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184151186 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/unorderedreceiver/UnorderedReceiverBatch.java --- @@ -182,13 +184,18 @@ public

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184159218 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/unorderedreceiver/UnorderedReceiverBatch.java --- @@ -153,8 +153,10 @@ private

[GitHub] drill pull request #1239: DRILL-143: CGroup Support for Drill-on-YARN

2018-04-25 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/1239#discussion_r184169114 --- Diff: distribution/src/resources/yarn-drillbit.sh --- @@ -175,4 +209,11 @@ fi echo "`date` Starting drillbit on `hostname` under YARN, logging

[GitHub] drill issue #1239: DRILL-143: CGroup Support for Drill-on-YARN

2018-04-25 Thread paul-rogers
Github user paul-rogers commented on the issue: https://github.com/apache/drill/pull/1239 One other thing to highlight from an earlier comment. CPU is something that the user specifies in the DoY config file. That information is passed to YARN in container requests. This feature asks

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-25 Thread arina-ielchiieva
Github user arina-ielchiieva commented on a diff in the pull request: https://github.com/apache/drill/pull/1214#discussion_r184188427 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/ops/BaseOperatorContext.java --- @@ -158,25 +159,26 @@ public void close() {

[GitHub] drill issue #1231: DRILL-6342: Fix schema path unIndexed method to return co...

2018-04-25 Thread parthchandra
Github user parthchandra commented on the issue: https://github.com/apache/drill/pull/1231 +1. LGTM ---

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread sachouche
Github user sachouche commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184192630 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/record/RawFragmentBatch.java --- @@ -77,4 +83,46 @@ public long getByteCount() {

[GitHub] drill pull request #1214: DRILL-6331: Revisit Hive Drill native parquet impl...

2018-04-25 Thread parthchandra
Github user parthchandra commented on a diff in the pull request: https://github.com/apache/drill/pull/1214#discussion_r184199682 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/ops/BaseOperatorContext.java --- @@ -158,25 +159,26 @@ public void close() { }

[GitHub] drill pull request #1237: DRILL-6348: Fixed code so that Unordered Receiver ...

2018-04-25 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1237#discussion_r184155724 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/record/RawFragmentBatch.java --- @@ -77,4 +83,46 @@ public long getByteCount() { public

[GitHub] drill issue #1239: DRILL-143: CGroup Support for Drill-on-YARN

2018-04-25 Thread paul-rogers
Github user paul-rogers commented on the issue: https://github.com/apache/drill/pull/1239 @kkhatua, putting on my Apache hat... Apache Drill is an Apache project that must work with other Apache projects such as Apache YARN. The Apache Drill DoY support is designed to work well with

[GitHub] drill issue #1225: DRILL-6272: Refactor dynamic UDFs and function initialize...

2018-04-25 Thread arina-ielchiieva
Github user arina-ielchiieva commented on the issue: https://github.com/apache/drill/pull/1225 @vrozov re-implemented using maven embedder. Had to upgrade jmokcit lib to the latest version since it caused NPE with maven embedder (NPE from jmockit even if no mocks are used, fixed in

[GitHub] drill pull request #1228: DRILL-6307: Handle empty batches in record batch s...

2018-04-25 Thread ppadma
Github user ppadma commented on a diff in the pull request: https://github.com/apache/drill/pull/1228#discussion_r184192443 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/record/RecordBatchSizer.java --- @@ -50,7 +50,7 @@ public class RecordBatchSizer {

  1   2   >