[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/9368 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. IMPALA-5752: Add support for DECIMAL on Kudu tables Adds support for the Kudu DECIMAL type introduced in Kudu 1.7.0. Note: Adding support for Kudu decimal min/max filters is tracked in IMPALA-6533. Tests: * Added Kudu create with decimal test to AnalyzeDDLTest.java * Added Kudu table_format to test_decimal_queries.py ** Both decimal.test and decimal-exprs.test workloads * Added decimal queries to the following Kudu workloads: ** kudu_create.test ** kudu_delete.test ** kudu_insert.test ** kudu_update.test ** kudu_upsert.test Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Reviewed-on: http://gerrit.cloudera.org:8080/9368 Reviewed-by: Dimitris TsirogiannisTested-by: Impala Public Jenkins --- M be/src/exec/kudu-scanner.cc M be/src/exec/kudu-table-sink.cc M be/src/exec/kudu-util.cc M be/src/exec/kudu-util.h M be/src/exprs/kudu-partition-expr.cc M fe/src/main/java/org/apache/impala/catalog/KuduColumn.java M fe/src/main/java/org/apache/impala/planner/KuduScanNode.java M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java M fe/src/main/java/org/apache/impala/service/KuduCatalogOpExecutor.java M fe/src/main/java/org/apache/impala/util/KuduUtil.java M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java M testdata/datasets/functional/functional_schema_template.sql M testdata/datasets/functional/schema_constraints.csv M testdata/workloads/functional-query/queries/QueryTest/kudu_create.test M testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test M testdata/workloads/functional-query/queries/QueryTest/kudu_describe.test M testdata/workloads/functional-query/queries/QueryTest/kudu_insert.test M testdata/workloads/functional-query/queries/QueryTest/kudu_update.test M testdata/workloads/functional-query/queries/QueryTest/kudu_upsert.test M tests/query_test/test_decimal_queries.py M tests/query_test/test_kudu.py 21 files changed, 882 insertions(+), 637 deletions(-) Approvals: Dimitris Tsirogiannis: Looks good to me, approved Impala Public Jenkins: Verified -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 10 Gerrit-Owner: Grant Henke Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Dimitris Tsirogiannis Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Impala Public Jenkins has posted comments on this change. ( http://gerrit.cloudera.org:8080/9368 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 9: Verified+1 -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 9 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Dimitris Tsirogiannis Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall Gerrit-Comment-Date: Fri, 23 Feb 2018 00:03:53 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Dimitris Tsirogiannis has posted comments on this change. ( http://gerrit.cloudera.org:8080/9368 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 9: Code-Review+2 Rebased -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 9 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Dimitris Tsirogiannis Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall Gerrit-Comment-Date: Thu, 22 Feb 2018 18:58:59 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Dan Hecht has posted comments on this change. ( http://gerrit.cloudera.org:8080/9368 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 8: Code-Review+1 I think you just need Dimitris' +2 and then we can merge it. -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 8 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Dimitris Tsirogiannis Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall Gerrit-Comment-Date: Thu, 22 Feb 2018 18:28:56 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Grant Henke has posted comments on this change. ( http://gerrit.cloudera.org:8080/9368 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 8: Note: This patch passes all tests and is ready for further review. -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 8 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Dimitris Tsirogiannis Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall Gerrit-Comment-Date: Thu, 22 Feb 2018 17:06:38 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Hello Thomas Tauber-Marshall, Taras Bobrovytsky, Dimitris Tsirogiannis, Dan Hecht, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/9368 to look at the new patch set (#8). Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. IMPALA-5752: Add support for DECIMAL on Kudu tables Adds support for the Kudu DECIMAL type introduced in Kudu 1.7.0. Note: Adding support for Kudu decimal min/max filters is tracked in IMPALA-6533. Tests: * Added Kudu create with decimal test to AnalyzeDDLTest.java * Added Kudu table_format to test_decimal_queries.py ** Both decimal.test and decimal-exprs.test workloads * Added decimal queries to the following Kudu workloads: ** kudu_create.test ** kudu_delete.test ** kudu_insert.test ** kudu_update.test ** kudu_upsert.test Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 --- M be/src/exec/kudu-scanner.cc M be/src/exec/kudu-table-sink.cc M be/src/exec/kudu-util.cc M be/src/exec/kudu-util.h M be/src/exprs/kudu-partition-expr.cc M fe/src/main/java/org/apache/impala/catalog/KuduColumn.java M fe/src/main/java/org/apache/impala/planner/KuduScanNode.java M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java M fe/src/main/java/org/apache/impala/service/KuduCatalogOpExecutor.java M fe/src/main/java/org/apache/impala/util/KuduUtil.java M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java M testdata/datasets/functional/functional_schema_template.sql M testdata/datasets/functional/schema_constraints.csv M testdata/workloads/functional-query/queries/QueryTest/kudu_create.test M testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test M testdata/workloads/functional-query/queries/QueryTest/kudu_describe.test M testdata/workloads/functional-query/queries/QueryTest/kudu_insert.test M testdata/workloads/functional-query/queries/QueryTest/kudu_update.test M testdata/workloads/functional-query/queries/QueryTest/kudu_upsert.test M tests/query_test/test_decimal_queries.py M tests/query_test/test_kudu.py 21 files changed, 882 insertions(+), 637 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/68/9368/8 -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 8 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Dimitris Tsirogiannis Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Hello Thomas Tauber-Marshall, Taras Bobrovytsky, Dimitris Tsirogiannis, Dan Hecht, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/9368 to look at the new patch set (#7). Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. IMPALA-5752: Add support for DECIMAL on Kudu tables Adds support for the Kudu DECIMAL type introduced in Kudu 1.7.0. Note: Adding support for Kudu decimal min/max filters is tracked in IMPALA-6533. Tests: * Added Kudu create with decimal test to AnalyzeDDLTest.java * Added Kudu table_format to test_decimal_queries.py ** Both decimal.test and decimal-exprs.test workloads * Added decimal queries to the following Kudu workloads: ** kudu_create.test ** kudu_delete.test ** kudu_insert.test ** kudu_update.test ** kudu_upsert.test Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 --- M be/src/exec/kudu-scanner.cc M be/src/exec/kudu-table-sink.cc M be/src/exec/kudu-util.cc M be/src/exec/kudu-util.h M be/src/exprs/kudu-partition-expr.cc M fe/src/main/java/org/apache/impala/catalog/KuduColumn.java M fe/src/main/java/org/apache/impala/planner/KuduScanNode.java M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java M fe/src/main/java/org/apache/impala/service/KuduCatalogOpExecutor.java M fe/src/main/java/org/apache/impala/util/KuduUtil.java M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java M testdata/datasets/functional/functional_schema_template.sql M testdata/datasets/functional/schema_constraints.csv M testdata/workloads/functional-query/queries/QueryTest/kudu_create.test M testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test M testdata/workloads/functional-query/queries/QueryTest/kudu_describe.test M testdata/workloads/functional-query/queries/QueryTest/kudu_insert.test M testdata/workloads/functional-query/queries/QueryTest/kudu_update.test M testdata/workloads/functional-query/queries/QueryTest/kudu_upsert.test M tests/query_test/test_decimal_queries.py M tests/query_test/test_kudu.py 21 files changed, 882 insertions(+), 637 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/68/9368/7 -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 7 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Dimitris Tsirogiannis Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Hello Thomas Tauber-Marshall, Taras Bobrovytsky, Dimitris Tsirogiannis, Dan Hecht, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/9368 to look at the new patch set (#6). Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. IMPALA-5752: Add support for DECIMAL on Kudu tables Adds support for the Kudu DECIMAL type introduced in Kudu 1.7.0. Note: Adding support for Kudu decimal min/max filters is tracked in IMPALA-6533. Tests: * Added Kudu create with decimal test to AnalyzeDDLTest.java * Added Kudu table_format to test_decimal_queries.py ** Both decimal.test and decimal-exprs.test workloads * Added decimal queries to the following Kudu workloads: ** kudu_create.test ** kudu_delete.test ** kudu_insert.test ** kudu_update.test ** kudu_upsert.test Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 --- M be/src/exec/kudu-scanner.cc M be/src/exec/kudu-table-sink.cc M be/src/exec/kudu-util.cc M be/src/exec/kudu-util.h M be/src/exprs/kudu-partition-expr.cc M fe/src/main/java/org/apache/impala/catalog/KuduColumn.java M fe/src/main/java/org/apache/impala/planner/KuduScanNode.java M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java M fe/src/main/java/org/apache/impala/service/KuduCatalogOpExecutor.java M fe/src/main/java/org/apache/impala/util/KuduUtil.java M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java M testdata/datasets/functional/functional_schema_template.sql M testdata/datasets/functional/schema_constraints.csv M testdata/workloads/functional-query/queries/QueryTest/kudu_create.test M testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test M testdata/workloads/functional-query/queries/QueryTest/kudu_describe.test M testdata/workloads/functional-query/queries/QueryTest/kudu_insert.test M testdata/workloads/functional-query/queries/QueryTest/kudu_update.test M testdata/workloads/functional-query/queries/QueryTest/kudu_upsert.test M tests/query_test/test_decimal_queries.py M tests/query_test/test_kudu.py 21 files changed, 881 insertions(+), 636 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/68/9368/6 -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 6 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Dimitris Tsirogiannis Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Grant Henke has posted comments on this change. ( http://gerrit.cloudera.org:8080/9368 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 5: (12 comments) http://gerrit.cloudera.org:8080/#/c/9368/3/be/src/exec/kudu-util.h File be/src/exec/kudu-util.h: http://gerrit.cloudera.org:8080/#/c/9368/3/be/src/exec/kudu-util.h@78 PS3, Line 78: l_type > that needs updating (param is 'col_type'). But also I think you should not Done http://gerrit.cloudera.org:8080/#/c/9368/3/be/src/exec/kudu-util.h@85 PS3, Line 85: l_type > same Done http://gerrit.cloudera.org:8080/#/c/9368/3/fe/src/main/java/org/apache/impala/util/KuduUtil.java File fe/src/main/java/org/apache/impala/util/KuduUtil.java: http://gerrit.cloudera.org:8080/#/c/9368/3/fe/src/main/java/org/apache/impala/util/KuduUtil.java@190 PS3, Line 190: For example, The `impalaType` is :* translated to a Kudu Type 'type' and if 'type' is 'INT8', the returned :* value is a J > Update the comment (input param is no longer a Kudu.Type). Done http://gerrit.cloudera.org:8080/#/c/9368/4/fe/src/main/java/org/apache/impala/util/KuduUtil.java File fe/src/main/java/org/apache/impala/util/KuduUtil.java: http://gerrit.cloudera.org:8080/#/c/9368/4/fe/src/main/java/org/apache/impala/util/KuduUtil.java@190 PS4, Line 190: For example, The `impalaType` is :* translated to a Kudu Type 'type' and if 'type' is 'INT8', the returned :* value is a J > Update comment ('type' is renamed and it's not a kudu type). Done http://gerrit.cloudera.org:8080/#/c/9368/4/fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java File fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java: http://gerrit.cloudera.org:8080/#/c/9368/4/fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java@a1809 PS4, Line 1809: : : > Why not converting it into a positive test? Do you have a CTAS test with de Done http://gerrit.cloudera.org:8080/#/c/9368/4/fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java@2157 PS4, Line 2157: "SORT BY (d)", "SORT BY colu > I think we need to add some tests here as well since a new column type is a Done http://gerrit.cloudera.org:8080/#/c/9368/4/fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java@2498 PS4, Line 2498: } else { : AnalyzesOk(createTblStr); : } : } : } > nit: plz don't change the style wrt '+' (always at the end of the line) Done http://gerrit.cloudera.org:8080/#/c/9368/4/fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java@2531 PS4, Line 2531: "value 'INVALID_ENC'. Supported encoding values are: " + : Joiner.on(", ").join(Encoding.values())); : // Unsupported compression algorithm : AnalysisError("create table tab (x int primary key, y int compression " + : "invalid_comp) partition by hash (x) partitions 3 stored as kudu", : "Unsupported compres > same here Done http://gerrit.cloudera.org:8080/#/c/9368/4/testdata/workloads/functional-query/queries/QueryTest/kudu_create.test File testdata/workloads/functional-query/queries/QueryTest/kudu_create.test: http://gerrit.cloudera.org:8080/#/c/9368/4/testdata/workloads/functional-query/queries/QueryTest/kudu_create.test@293 PS4, Line 293: QUERY : # Creates a Kudu table with decimal columns and primary key : create table create_decimal : ( : decimal_4 decimal(9, 9), : decimal_8 decimal(18, 2) not null default 100.00, : decimal_16 decimal(38, 0) null, : primary key (decimal_4)) : stored as kudu; : RESULTS : : QUERY : # Create as select table with decimal columns and primary key : create table ctas_decimal primary key (d3) : stored as kudu : as select * from functional.decimal_tbl; : select * from ctas_decimal; : RESULTS : 1234,,1.23456789,.1 > This looks more like an insert test (shouldn't it be in kudu_insert.test?). When I wrote this I hadn't fixed the workload data loading issue for decimal_tiny and decimal_tbl. Will change this to just the create statement and add a ctas version. http://gerrit.cloudera.org:8080/#/c/9368/4/testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test File testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test: http://gerrit.cloudera.org:8080/#/c/9368/4/testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test@299 PS4, Line 299: INT, > Can you add some tests in which the predicate is on a decimal
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Hello Thomas Tauber-Marshall, Taras Bobrovytsky, Dimitris Tsirogiannis, Dan Hecht, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/9368 to look at the new patch set (#5). Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. IMPALA-5752: Add support for DECIMAL on Kudu tables Adds support for the Kudu DECIMAL type introduced in Kudu 1.7.0. Note: Adding support for Kudu decimal min/max filters is tracked in IMPALA-6533. Tests: * Added Kudu create with decimal test to AnalyzeDDLTest.java * Added Kudu table_format to test_decimal_queries.py ** Both decimal.test and decimal-exprs.test workloads * Added decimal queries to the following Kudu workloads: ** kudu_create.test ** kudu_delete.test ** kudu_insert.test ** kudu_update.test ** kudu_upsert.test Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 --- M be/src/exec/kudu-scanner.cc M be/src/exec/kudu-table-sink.cc M be/src/exec/kudu-util.cc M be/src/exec/kudu-util.h M be/src/exprs/kudu-partition-expr.cc M fe/src/main/java/org/apache/impala/catalog/KuduColumn.java M fe/src/main/java/org/apache/impala/planner/KuduScanNode.java M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java M fe/src/main/java/org/apache/impala/service/KuduCatalogOpExecutor.java M fe/src/main/java/org/apache/impala/util/KuduUtil.java M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java M testdata/datasets/functional/functional_schema_template.sql M testdata/datasets/functional/schema_constraints.csv M testdata/workloads/functional-query/queries/QueryTest/kudu_create.test M testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test M testdata/workloads/functional-query/queries/QueryTest/kudu_describe.test M testdata/workloads/functional-query/queries/QueryTest/kudu_insert.test M testdata/workloads/functional-query/queries/QueryTest/kudu_update.test M testdata/workloads/functional-query/queries/QueryTest/kudu_upsert.test M tests/query_test/test_decimal_queries.py M tests/query_test/test_kudu.py 21 files changed, 881 insertions(+), 636 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/68/9368/5 -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 5 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Dimitris Tsirogiannis Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Dan Hecht has posted comments on this change. ( http://gerrit.cloudera.org:8080/9368 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 3: (2 comments) http://gerrit.cloudera.org:8080/#/c/9368/3/be/src/exec/kudu-util.h File be/src/exec/kudu-util.h: http://gerrit.cloudera.org:8080/#/c/9368/3/be/src/exec/kudu-util.h@78 PS3, Line 78: 'type' that needs updating (param is 'col_type'). But also I think you should not say "the primitive type in" since the decimal case requires the column type. http://gerrit.cloudera.org:8080/#/c/9368/3/be/src/exec/kudu-util.h@85 PS3, Line 85: 'type' same -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 3 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Dimitris Tsirogiannis Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall Gerrit-Comment-Date: Wed, 21 Feb 2018 23:39:39 + Gerrit-HasComments: Yes
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Dimitris Tsirogiannis has posted comments on this change. ( http://gerrit.cloudera.org:8080/9368 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 4: (10 comments) http://gerrit.cloudera.org:8080/#/c/9368/3/fe/src/main/java/org/apache/impala/util/KuduUtil.java File fe/src/main/java/org/apache/impala/util/KuduUtil.java: http://gerrit.cloudera.org:8080/#/c/9368/3/fe/src/main/java/org/apache/impala/util/KuduUtil.java@190 PS3, Line 190: E.g. if 'type' is 'INT8', the returned :* value is a Java byte, and if 'type' is 'UNIXTIME_MICROS', the returned value is :* a Java long. Update the comment (input param is no longer a Kudu.Type). http://gerrit.cloudera.org:8080/#/c/9368/4/fe/src/main/java/org/apache/impala/util/KuduUtil.java File fe/src/main/java/org/apache/impala/util/KuduUtil.java: http://gerrit.cloudera.org:8080/#/c/9368/4/fe/src/main/java/org/apache/impala/util/KuduUtil.java@190 PS4, Line 190: E.g. if 'type' is 'INT8', the returned :* value is a Java byte, and if 'type' is 'UNIXTIME_MICROS', the returned value is :* a Java long. Update comment ('type' is renamed and it's not a kudu type). http://gerrit.cloudera.org:8080/#/c/9368/4/fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java File fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java: http://gerrit.cloudera.org:8080/#/c/9368/4/fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java@a1809 PS4, Line 1809: : : Why not converting it into a positive test? Do you have a CTAS test with decimal somewhere else? http://gerrit.cloudera.org:8080/#/c/9368/4/fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java@2157 PS4, Line 2157: public void TestAlterKuduTable() { I think we need to add some tests here as well since a new column type is added. http://gerrit.cloudera.org:8080/#/c/9368/4/fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java@2498 PS4, Line 2498: AnalyzesOk("create table tab (x int primary key, i1 tinyint default null, " : + "i2 smallint default null, i3 int default null, i4 bigint default null, " : + "vals string default null, valf float default null, vald double default null, " : + "valb boolean default null, valdec decimal(10, 5) default null) " : + "partition by hash (x) partitions 3 stored as kudu"); nit: plz don't change the style wrt '+' (always at the end of the line) http://gerrit.cloudera.org:8080/#/c/9368/4/fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java@2531 PS4, Line 2531: + "i3 int default 100, i4 bigint default 1000, vals string default 'test', " : + "valf float default cast(1.2 as float), vald double default " : + "cast(3.1452 as double), valb boolean default true, " : + "valdec decimal(10, 5) default 3.14159, " : + "primary key (i1, i2, i3, i4, vals)) partition by hash (i1) partitions 3 " : + "stored as kudu"); same here http://gerrit.cloudera.org:8080/#/c/9368/4/testdata/workloads/functional-query/queries/QueryTest/kudu_create.test File testdata/workloads/functional-query/queries/QueryTest/kudu_create.test: http://gerrit.cloudera.org:8080/#/c/9368/4/testdata/workloads/functional-query/queries/QueryTest/kudu_create.test@293 PS4, Line 293: QUERY : # Creates a Kudu table with decimal columns and primary key : create table create_decimal_test : ( : decimal_4 decimal(9, 9), : decimal_8 decimal(18, 2) not null default 100.00, : decimal_16 decimal(38, 0) null, : primary key (decimal_4)) : stored as kudu; : insert into create_decimal_test (decimal_4) values (0.1) : RUNTIME_PROFILE : NumModifiedRows: 1 : NumRowErrors: 0 : LABELS : DECIMAL_4, DECIMAL_8, DECIMAL_16 : DML_RESULTS: create_decimal_test : 0.1,100.00,NULL : TYPES : DECIMAL,DECIMAL,DECIMAL This looks more like an insert test (shouldn't it be in kudu_insert.test?). Also, you should add a CTAS test with decimal (couldn't find any). http://gerrit.cloudera.org:8080/#/c/9368/4/testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test File testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test: http://gerrit.cloudera.org:8080/#/c/9368/4/testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test@299 PS4, Line 299: Can you add some tests in which the predicate is on a decimal column?
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Grant Henke has posted comments on this change. ( http://gerrit.cloudera.org:8080/9368 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 3: (1 comment) http://gerrit.cloudera.org:8080/#/c/9368/3/be/src/exec/kudu-util.cc File be/src/exec/kudu-util.cc: http://gerrit.cloudera.org:8080/#/c/9368/3/be/src/exec/kudu-util.cc@215 PS3, Line 215: return ColumnType::CreateDecimalType( : type_attributes.precision(), type_attributes.scale()); > Since this no longer fits on one line, just follow what the formatter says, I ran the formatter and updated the patch to use the suggested changes. -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 3 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall Gerrit-Comment-Date: Wed, 21 Feb 2018 19:35:06 + Gerrit-HasComments: Yes
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Taras Bobrovytsky has posted comments on this change. ( http://gerrit.cloudera.org:8080/9368 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 4: Code-Review+1 The patch looks good to me. One thing we need to do for TPCDS and possibly TPCH is change some of the columns from DOUBLE to DECIMAL for Kudu. The expected results need to be updated as well. The expected results should be the same as for other storage types. It probably makes sense to do that in a separate patch. -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 4 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall Gerrit-Comment-Date: Wed, 21 Feb 2018 20:05:38 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Hello Thomas Tauber-Marshall, Taras Bobrovytsky, Dan Hecht, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/9368 to look at the new patch set (#4). Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. IMPALA-5752: Add support for DECIMAL on Kudu tables Adds support for the Kudu DECIMAL type introduced in Kudu 1.7.0. Note: Adding support for Kudu decimal min/max filters is tracked in IMPALA-6533. Tests: * Added Kudu create with decimal test to AnalyzeDDLTest.java * Added Kudu table_format to test_decimal_queries.py ** Both decimal.test and decimal-exprs.test workloads * Added decimal queries to the following Kudu workloads: ** kudu_create.test ** kudu_delete.test ** kudu_insert.test ** kudu_update.test ** kudu_upsert.test Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 --- M be/src/exec/kudu-scanner.cc M be/src/exec/kudu-table-sink.cc M be/src/exec/kudu-util.cc M be/src/exec/kudu-util.h M be/src/exprs/kudu-partition-expr.cc M fe/src/main/java/org/apache/impala/catalog/KuduColumn.java M fe/src/main/java/org/apache/impala/planner/KuduScanNode.java M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java M fe/src/main/java/org/apache/impala/service/KuduCatalogOpExecutor.java M fe/src/main/java/org/apache/impala/util/KuduUtil.java M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java M testdata/datasets/functional/functional_schema_template.sql M testdata/datasets/functional/schema_constraints.csv M testdata/workloads/functional-query/queries/QueryTest/kudu_create.test M testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test M testdata/workloads/functional-query/queries/QueryTest/kudu_describe.test M testdata/workloads/functional-query/queries/QueryTest/kudu_insert.test M testdata/workloads/functional-query/queries/QueryTest/kudu_update.test M testdata/workloads/functional-query/queries/QueryTest/kudu_upsert.test M tests/query_test/test_decimal_queries.py M tests/query_test/test_kudu.py 21 files changed, 806 insertions(+), 643 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/68/9368/4 -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 4 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Thomas Tauber-Marshall has posted comments on this change. ( http://gerrit.cloudera.org:8080/9368 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 3: (1 comment) Backend looks good, just please run the formatter again. http://gerrit.cloudera.org:8080/#/c/9368/3/be/src/exec/kudu-util.cc File be/src/exec/kudu-util.cc: http://gerrit.cloudera.org:8080/#/c/9368/3/be/src/exec/kudu-util.cc@215 PS3, Line 215: return ColumnType::CreateDecimalType( : type_attributes.precision(), type_attributes.scale()); Since this no longer fits on one line, just follow what the formatter says, i.e. put the return on the next line. -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 3 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall Gerrit-Comment-Date: Wed, 21 Feb 2018 19:16:03 + Gerrit-HasComments: Yes
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Thomas Tauber-Marshall has posted comments on this change. ( http://gerrit.cloudera.org:8080/9368 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 4: Code-Review+2 +2 is just for the BE Thanks for taking this on! -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 4 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall Gerrit-Comment-Date: Wed, 21 Feb 2018 20:29:19 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Grant Henke has posted comments on this change. ( http://gerrit.cloudera.org:8080/9368 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 4: Thanks Taras. I have created IMPALA-5752 to track that. -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 4 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall Gerrit-Comment-Date: Wed, 21 Feb 2018 20:13:25 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Grant Henke has posted comments on this change. ( http://gerrit.cloudera.org:8080/9368 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 3: Here is a successful pre-review test run on patch set 3: https://jenkins.impala.io/job/pre-review-test/134/ -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 3 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall Gerrit-Comment-Date: Wed, 21 Feb 2018 13:31:58 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Grant Henke has posted comments on this change. ( http://gerrit.cloudera.org:8080/9368 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 3: Here is a successful pre-review test run on patch set 2: https://jenkins.impala.io/job/pre-review-test/133 -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 3 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall Gerrit-Comment-Date: Wed, 21 Feb 2018 05:13:22 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Hello Thomas Tauber-Marshall, Taras Bobrovytsky, Dan Hecht, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/9368 to look at the new patch set (#3). Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. IMPALA-5752: Add support for DECIMAL on Kudu tables Adds support for the Kudu DECIMAL type introduced in Kudu 1.7.0. Note: Adding support for Kudu decimal min/max filters is tracked in IMPALA-6533. Tests: * Added Kudu create with decimal test to AnalyzeDDLTest.java * Added Kudu table_format to test_decimal_queries.py ** Both decimal.test and decimal-exprs.test workloads * Added decimal queries to the following Kudu workloads: ** kudu_create.test ** kudu_delete.test ** kudu_insert.test ** kudu_update.test ** kudu_upsert.test Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 --- M be/src/exec/kudu-scanner.cc M be/src/exec/kudu-table-sink.cc M be/src/exec/kudu-util.cc M be/src/exec/kudu-util.h M be/src/exprs/kudu-partition-expr.cc M fe/src/main/java/org/apache/impala/catalog/KuduColumn.java M fe/src/main/java/org/apache/impala/planner/KuduScanNode.java M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java M fe/src/main/java/org/apache/impala/service/KuduCatalogOpExecutor.java M fe/src/main/java/org/apache/impala/util/KuduUtil.java M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java M testdata/datasets/functional/functional_schema_template.sql M testdata/datasets/functional/schema_constraints.csv M testdata/workloads/functional-query/queries/QueryTest/kudu_create.test M testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test M testdata/workloads/functional-query/queries/QueryTest/kudu_describe.test M testdata/workloads/functional-query/queries/QueryTest/kudu_insert.test M testdata/workloads/functional-query/queries/QueryTest/kudu_update.test M testdata/workloads/functional-query/queries/QueryTest/kudu_upsert.test M tests/query_test/test_decimal_queries.py M tests/query_test/test_kudu.py 21 files changed, 806 insertions(+), 644 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/68/9368/3 -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 3 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Grant Henke has posted comments on this change. ( http://gerrit.cloudera.org:8080/9368 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 2: (1 comment) http://gerrit.cloudera.org:8080/#/c/9368/1/be/src/exec/kudu-util.h File be/src/exec/kudu-util.h: http://gerrit.cloudera.org:8080/#/c/9368/1/be/src/exec/kudu-util.h@82 PS1, Line 82: const ColumnTyp > here and elsewhere: Impala generally uses 'const ColumnType&' for ColumnTyp Done -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 2 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall Gerrit-Comment-Date: Wed, 21 Feb 2018 02:28:21 + Gerrit-HasComments: Yes
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Hello Thomas Tauber-Marshall, Taras Bobrovytsky, Dan Hecht, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/9368 to look at the new patch set (#2). Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. IMPALA-5752: Add support for DECIMAL on Kudu tables Adds support for the Kudu DECIMAL type introduced in Kudu 1.7.0. Note: Adding support for Kudu decimal min/max filters is tracked in IMPALA-6533. Tests: * Added Kudu create with decimal test to AnalyzeDDLTest.java * Added Kudu table_format to test_decimal_queries.py ** Both decimal.test and decimal-exprs.test workloads * Added decimal queries to the following Kudu workloads: ** kudu_create.test ** kudu_delete.test ** kudu_insert.test ** kudu_update.test ** kudu_upsert.test Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 --- M be/src/exec/kudu-scanner.cc M be/src/exec/kudu-table-sink.cc M be/src/exec/kudu-util.cc M be/src/exec/kudu-util.h M be/src/exprs/kudu-partition-expr.cc M fe/src/main/java/org/apache/impala/catalog/KuduColumn.java M fe/src/main/java/org/apache/impala/planner/KuduScanNode.java M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java M fe/src/main/java/org/apache/impala/service/KuduCatalogOpExecutor.java M fe/src/main/java/org/apache/impala/util/KuduUtil.java M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java M testdata/datasets/functional/functional_schema_template.sql M testdata/datasets/functional/schema_constraints.csv M testdata/workloads/functional-query/queries/QueryTest/kudu_create.test M testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test M testdata/workloads/functional-query/queries/QueryTest/kudu_describe.test M testdata/workloads/functional-query/queries/QueryTest/kudu_insert.test M testdata/workloads/functional-query/queries/QueryTest/kudu_update.test M testdata/workloads/functional-query/queries/QueryTest/kudu_upsert.test M tests/query_test/test_decimal_queries.py M tests/query_test/test_kudu.py 21 files changed, 805 insertions(+), 643 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/68/9368/2 -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 2 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Dan Hecht has posted comments on this change. ( http://gerrit.cloudera.org:8080/9368 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 1: (1 comment) http://gerrit.cloudera.org:8080/#/c/9368/1/be/src/exec/kudu-util.h File be/src/exec/kudu-util.h: http://gerrit.cloudera.org:8080/#/c/9368/1/be/src/exec/kudu-util.h@82 PS1, Line 82: ColumnType type here and elsewhere: Impala generally uses 'const ColumnType&' for ColumnType parameters since this is a struct (whereas PrimitiveType is a scalar enum). Let's stick with that pattern. -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 1 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall Gerrit-Comment-Date: Tue, 20 Feb 2018 22:47:44 + Gerrit-HasComments: Yes
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Grant Henke has posted comments on this change. ( http://gerrit.cloudera.org:8080/9368 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 1: Note: This is a continuation of https://gerrit.cloudera.org/#/c/9306/ which was abandoned due to technical difficulties. -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 1 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Grant Henke Gerrit-Comment-Date: Tue, 20 Feb 2018 22:21:28 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Grant Henke has abandoned this change. ( http://gerrit.cloudera.org:8080/9306 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Abandoned Abandoning in favor of https://gerrit.cloudera.org/#/c/9368/. Unfortunately I needed to iterate with the pre-review test due to my own environment issues and that muddies the patch set history and had an issue with the jenkins job. I will reference this review set there. -- To view, visit http://gerrit.cloudera.org:8080/9306 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: abandon Gerrit-Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 Gerrit-Change-Number: 9306 Gerrit-PatchSet: 10 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Grant Henke Gerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Grant Henke has uploaded this change for review. ( http://gerrit.cloudera.org:8080/9368 Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. IMPALA-5752: Add support for DECIMAL on Kudu tables Adds support for the Kudu DECIMAL type introduced in Kudu 1.7.0. Note: Adding support for Kudu decimal min/max filters is tracked in IMPALA-6533. Tests: * Added Kudu create with decimal test to AnalyzeDDLTest.java * Added Kudu table_format to test_decimal_queries.py ** Both decimal.test and decimal-exprs.test workloads * Added decimal queries to the following Kudu workloads: ** kudu_create.test ** kudu_delete.test ** kudu_insert.test ** kudu_update.test ** kudu_upsert.test Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 --- M be/src/exec/kudu-scanner.cc M be/src/exec/kudu-table-sink.cc M be/src/exec/kudu-util.cc M be/src/exec/kudu-util.h M be/src/exprs/kudu-partition-expr.cc M fe/src/main/java/org/apache/impala/catalog/KuduColumn.java M fe/src/main/java/org/apache/impala/planner/KuduScanNode.java M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java M fe/src/main/java/org/apache/impala/service/KuduCatalogOpExecutor.java M fe/src/main/java/org/apache/impala/util/KuduUtil.java M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java M testdata/datasets/functional/functional_schema_template.sql M testdata/datasets/functional/schema_constraints.csv M testdata/workloads/functional-query/queries/QueryTest/kudu_create.test M testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test M testdata/workloads/functional-query/queries/QueryTest/kudu_describe.test M testdata/workloads/functional-query/queries/QueryTest/kudu_insert.test M testdata/workloads/functional-query/queries/QueryTest/kudu_update.test M testdata/workloads/functional-query/queries/QueryTest/kudu_upsert.test M tests/query_test/test_decimal_queries.py M tests/query_test/test_kudu.py 21 files changed, 804 insertions(+), 642 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/68/9368/1 -- To view, visit http://gerrit.cloudera.org:8080/9368 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I3a9fe5acadc53ec198585d765a8cfb0abe56e199 Gerrit-Change-Number: 9368 Gerrit-PatchSet: 1 Gerrit-Owner: Grant Henke
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Hello Thomas Tauber-Marshall, Taras Bobrovytsky, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/9306 to look at the new patch set (#10). Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. IMPALA-5752: Add support for DECIMAL on Kudu tables Adds support for the Kudu DECIMAL type introduced in Kudu 1.7.0. Note: Adding support for Kudu decimal min/max filters is tracked in IMPALA-6533. Tests: * Added Kudu create with decimal test to AnalyzeDDLTest.java * Added Kudu table_format to test_decimal_queries.py ** Both decimal.test and decimal-exprs.test workloads * Added decimal queries to the following Kudu workloads: ** kudu_create.test ** kudu_delete.test ** kudu_insert.test ** kudu_update.test ** kudu_upsert.test Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 --- M be/src/exec/kudu-scanner.cc M be/src/exec/kudu-table-sink.cc M be/src/exec/kudu-util.cc M be/src/exec/kudu-util.h M be/src/exprs/kudu-partition-expr.cc M fe/src/main/java/org/apache/impala/catalog/KuduColumn.java M fe/src/main/java/org/apache/impala/planner/KuduScanNode.java M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java M fe/src/main/java/org/apache/impala/service/KuduCatalogOpExecutor.java M fe/src/main/java/org/apache/impala/util/KuduUtil.java M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java M testdata/datasets/functional/functional_schema_template.sql M testdata/datasets/functional/schema_constraints.csv M testdata/workloads/functional-query/queries/QueryTest/kudu_create.test M testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test M testdata/workloads/functional-query/queries/QueryTest/kudu_describe.test M testdata/workloads/functional-query/queries/QueryTest/kudu_insert.test M testdata/workloads/functional-query/queries/QueryTest/kudu_update.test M testdata/workloads/functional-query/queries/QueryTest/kudu_upsert.test M tests/query_test/test_decimal_queries.py M tests/query_test/test_kudu.py 21 files changed, 803 insertions(+), 641 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/06/9306/10 -- To view, visit http://gerrit.cloudera.org:8080/9306 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 Gerrit-Change-Number: 9306 Gerrit-PatchSet: 10 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Hello Thomas Tauber-Marshall, Taras Bobrovytsky, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/9306 to look at the new patch set (#9). Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. IMPALA-5752: Add support for DECIMAL on Kudu tables Adds support for the Kudu DECIMAL type introduced in Kudu 1.7.0. Note: Adding support for Kudu decimal min/max filters is tracked in IMPALA-6533. Tests: * Added Kudu create with decimal test to AnalyzeDDLTest.java * Added Kudu table_format to test_decimal_queries.py ** Both decimal.test and decimal-exprs.test workloads * Added decimal queries to the following Kudu workloads: ** kudu_create.test ** kudu_delete.test ** kudu_insert.test ** kudu_update.test ** kudu_upsert.test Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 --- M be/src/exec/kudu-scanner.cc M be/src/exec/kudu-table-sink.cc M be/src/exec/kudu-util.cc M be/src/exec/kudu-util.h M be/src/exprs/kudu-partition-expr.cc M fe/src/main/java/org/apache/impala/catalog/KuduColumn.java M fe/src/main/java/org/apache/impala/planner/KuduScanNode.java M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java M fe/src/main/java/org/apache/impala/service/KuduCatalogOpExecutor.java M fe/src/main/java/org/apache/impala/util/KuduUtil.java M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java M testdata/datasets/functional/functional_schema_template.sql M testdata/datasets/functional/schema_constraints.csv M testdata/workloads/functional-query/queries/QueryTest/kudu_create.test M testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test M testdata/workloads/functional-query/queries/QueryTest/kudu_describe.test M testdata/workloads/functional-query/queries/QueryTest/kudu_insert.test M testdata/workloads/functional-query/queries/QueryTest/kudu_update.test M testdata/workloads/functional-query/queries/QueryTest/kudu_upsert.test M tests/query_test/test_decimal_queries.py M tests/query_test/test_kudu.py 21 files changed, 795 insertions(+), 633 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/06/9306/9 -- To view, visit http://gerrit.cloudera.org:8080/9306 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 Gerrit-Change-Number: 9306 Gerrit-PatchSet: 9 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Hello Thomas Tauber-Marshall, Taras Bobrovytsky, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/9306 to look at the new patch set (#8). Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. IMPALA-5752: Add support for DECIMAL on Kudu tables Adds support for the Kudu DECIMAL type introduced in Kudu 1.7.0. Note: Adding support for Kudu decimal min/max filters is tracked in IMPALA-6533. Tests: * Added Kudu create with decimal test to AnalyzeDDLTest.java * Added Kudu table_format to test_decimal_queries.py ** Both decimal.test and decimal-exprs.test workloads * Added decimal queries to the following Kudu workloads: ** kudu_create.test ** kudu_delete.test ** kudu_insert.test ** kudu_update.test ** kudu_upsert.test Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 --- M be/src/exec/kudu-scanner.cc M be/src/exec/kudu-table-sink.cc M be/src/exec/kudu-util.cc M be/src/exec/kudu-util.h M be/src/exprs/kudu-partition-expr.cc M fe/src/main/java/org/apache/impala/catalog/KuduColumn.java M fe/src/main/java/org/apache/impala/planner/KuduScanNode.java M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java M fe/src/main/java/org/apache/impala/service/KuduCatalogOpExecutor.java M fe/src/main/java/org/apache/impala/util/KuduUtil.java M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java M testdata/datasets/functional/functional_schema_template.sql M testdata/datasets/functional/schema_constraints.csv M testdata/workloads/functional-query/queries/QueryTest/kudu_create.test M testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test M testdata/workloads/functional-query/queries/QueryTest/kudu_describe.test M testdata/workloads/functional-query/queries/QueryTest/kudu_insert.test M testdata/workloads/functional-query/queries/QueryTest/kudu_update.test M testdata/workloads/functional-query/queries/QueryTest/kudu_upsert.test M tests/query_test/test_decimal_queries.py M tests/query_test/test_kudu.py 21 files changed, 794 insertions(+), 632 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/06/9306/8 -- To view, visit http://gerrit.cloudera.org:8080/9306 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 Gerrit-Change-Number: 9306 Gerrit-PatchSet: 8 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Hello Thomas Tauber-Marshall, Taras Bobrovytsky, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/9306 to look at the new patch set (#7). Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. IMPALA-5752: Add support for DECIMAL on Kudu tables Adds support for the Kudu DECIMAL type introduced in Kudu 1.7.0. Note: Adding support for Kudu decimal min/max filters is tracked in IMPALA-6533. Tests: * Added Kudu create with decimal test to AnalyzeDDLTest.java * Added Kudu table_format to test_decimal_queries.py ** Both decimal.test and decimal-exprs.test workloads * Added decimal queries to the following Kudu workloads: ** kudu_create.test ** kudu_delete.test ** kudu_insert.test ** kudu_update.test ** kudu_upsert.test Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 --- M be/src/exec/kudu-scanner.cc M be/src/exec/kudu-table-sink.cc M be/src/exec/kudu-util.cc M be/src/exec/kudu-util.h M be/src/exprs/kudu-partition-expr.cc M fe/src/main/java/org/apache/impala/catalog/KuduColumn.java M fe/src/main/java/org/apache/impala/planner/KuduScanNode.java M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java M fe/src/main/java/org/apache/impala/service/KuduCatalogOpExecutor.java M fe/src/main/java/org/apache/impala/util/KuduUtil.java M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java M testdata/datasets/functional/functional_schema_template.sql M testdata/datasets/functional/schema_constraints.csv M testdata/workloads/functional-query/queries/QueryTest/kudu_create.test M testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test M testdata/workloads/functional-query/queries/QueryTest/kudu_describe.test M testdata/workloads/functional-query/queries/QueryTest/kudu_insert.test M testdata/workloads/functional-query/queries/QueryTest/kudu_update.test M testdata/workloads/functional-query/queries/QueryTest/kudu_upsert.test M tests/query_test/test_decimal_queries.py M tests/query_test/test_kudu.py 21 files changed, 784 insertions(+), 626 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/06/9306/7 -- To view, visit http://gerrit.cloudera.org:8080/9306 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 Gerrit-Change-Number: 9306 Gerrit-PatchSet: 7 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Hello Thomas Tauber-Marshall, Taras Bobrovytsky, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/9306 to look at the new patch set (#6). Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. IMPALA-5752: Add support for DECIMAL on Kudu tables Adds support for the Kudu DECIMAL type introduced in Kudu 1.7.0. Note: Adding support for Kudu decimal min/max filters is tracked in IMPALA-6533. Tests: * Added Kudu create with decimal test to AnalyzeDDLTest.java * Added Kudu table_format to test_decimal_queries.py ** Both decimal.test and decimal-exprs.test workloads * Added decimal queries to the following Kudu workloads: ** kudu_create.test ** kudu_delete.test ** kudu_insert.test ** kudu_update.test ** kudu_upsert.test Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 --- M be/src/exec/kudu-scanner.cc M be/src/exec/kudu-table-sink.cc M be/src/exec/kudu-util.cc M be/src/exec/kudu-util.h M be/src/exprs/kudu-partition-expr.cc M fe/src/main/java/org/apache/impala/catalog/KuduColumn.java M fe/src/main/java/org/apache/impala/planner/KuduScanNode.java M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java M fe/src/main/java/org/apache/impala/service/KuduCatalogOpExecutor.java M fe/src/main/java/org/apache/impala/util/KuduUtil.java M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java M testdata/datasets/functional/functional_schema_template.sql M testdata/datasets/functional/schema_constraints.csv M testdata/workloads/functional-query/queries/QueryTest/kudu_create.test M testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test M testdata/workloads/functional-query/queries/QueryTest/kudu_describe.test M testdata/workloads/functional-query/queries/QueryTest/kudu_insert.test M testdata/workloads/functional-query/queries/QueryTest/kudu_update.test M testdata/workloads/functional-query/queries/QueryTest/kudu_upsert.test M tests/query_test/test_decimal_queries.py M tests/query_test/test_kudu.py 21 files changed, 784 insertions(+), 626 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/06/9306/6 -- To view, visit http://gerrit.cloudera.org:8080/9306 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 Gerrit-Change-Number: 9306 Gerrit-PatchSet: 6 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Hello Thomas Tauber-Marshall, Taras Bobrovytsky, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/9306 to look at the new patch set (#5). Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. IMPALA-5752: Add support for DECIMAL on Kudu tables Adds support for the Kudu DECIMAL type introduced in Kudu 1.7.0. Note: Adding support for Kudu decimal min/max filters is tracked in IMPALA-6533. Tests: * Added Kudu create with decimal test to AnalyzeDDLTest.java * Added Kudu table_format to test_decimal_queries.py ** Both decimal.test and decimal-exprs.test workloads * Added decimal queries to the following Kudu workloads: ** kudu_create.test ** kudu_delete.test ** kudu_insert.test ** kudu_update.test ** kudu_upsert.test Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 --- M be/src/exec/kudu-scanner.cc M be/src/exec/kudu-table-sink.cc M be/src/exec/kudu-util.cc M be/src/exec/kudu-util.h M be/src/exprs/kudu-partition-expr.cc M fe/src/main/java/org/apache/impala/catalog/KuduColumn.java M fe/src/main/java/org/apache/impala/planner/KuduScanNode.java M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java M fe/src/main/java/org/apache/impala/service/KuduCatalogOpExecutor.java M fe/src/main/java/org/apache/impala/util/KuduUtil.java M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java M testdata/datasets/functional/functional_schema_template.sql M testdata/datasets/functional/schema_constraints.csv M testdata/workloads/functional-query/queries/QueryTest/kudu_create.test M testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test M testdata/workloads/functional-query/queries/QueryTest/kudu_describe.test M testdata/workloads/functional-query/queries/QueryTest/kudu_insert.test M testdata/workloads/functional-query/queries/QueryTest/kudu_update.test M testdata/workloads/functional-query/queries/QueryTest/kudu_upsert.test M tests/query_test/test_decimal_queries.py M tests/query_test/test_kudu.py 21 files changed, 780 insertions(+), 624 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/06/9306/5 -- To view, visit http://gerrit.cloudera.org:8080/9306 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 Gerrit-Change-Number: 9306 Gerrit-PatchSet: 5 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Hello Thomas Tauber-Marshall, Taras Bobrovytsky, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/9306 to look at the new patch set (#4). Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. IMPALA-5752: Add support for DECIMAL on Kudu tables Adds support for the Kudu DECIMAL type introduced in Kudu 1.7.0. Note: Adding support for Kudu decimal min/max filters is tracked in IMPALA-6533. Tests: * Added Kudu create with decimal test to AnalyzeDDLTest.java * Added Kudu table_format to test_decimal_queries.py ** Both decimal.test and decimal-exprs.test workloads * Added decimal queries to the following Kudu workloads: ** kudu_create.test ** kudu_delete.test ** kudu_insert.test ** kudu_update.test ** kudu_upsert.test Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 --- M be/src/exec/kudu-scanner.cc M be/src/exec/kudu-table-sink.cc M be/src/exec/kudu-util.cc M be/src/exec/kudu-util.h M be/src/exprs/kudu-partition-expr.cc M fe/src/main/java/org/apache/impala/catalog/KuduColumn.java M fe/src/main/java/org/apache/impala/planner/KuduScanNode.java M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java M fe/src/main/java/org/apache/impala/service/KuduCatalogOpExecutor.java M fe/src/main/java/org/apache/impala/util/KuduUtil.java M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java M testdata/datasets/functional/schema_constraints.csv M testdata/workloads/functional-query/queries/QueryTest/kudu_create.test M testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test M testdata/workloads/functional-query/queries/QueryTest/kudu_describe.test M testdata/workloads/functional-query/queries/QueryTest/kudu_insert.test M testdata/workloads/functional-query/queries/QueryTest/kudu_update.test M testdata/workloads/functional-query/queries/QueryTest/kudu_upsert.test M tests/query_test/test_decimal_queries.py M tests/query_test/test_kudu.py 20 files changed, 716 insertions(+), 603 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/06/9306/4 -- To view, visit http://gerrit.cloudera.org:8080/9306 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 Gerrit-Change-Number: 9306 Gerrit-PatchSet: 4 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Grant Henke has posted comments on this change. ( http://gerrit.cloudera.org:8080/9306 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 3: FYI. I am adding some primary key tests and working on running/validating the tests. -- To view, visit http://gerrit.cloudera.org:8080/9306 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 Gerrit-Change-Number: 9306 Gerrit-PatchSet: 3 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Grant Henke Gerrit-Reviewer: Taras Bobrovytsky Gerrit-Reviewer: Thomas Tauber-Marshall Gerrit-Comment-Date: Fri, 16 Feb 2018 18:55:33 + Gerrit-HasComments: No
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Grant Henke has posted comments on this change. ( http://gerrit.cloudera.org:8080/9306 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 3: (2 comments) http://gerrit.cloudera.org:8080/#/c/9306/2/be/src/exec/kudu-util.cc File be/src/exec/kudu-util.cc: http://gerrit.cloudera.org:8080/#/c/9306/2/be/src/exec/kudu-util.cc@214 PS2, Line 214: > Yeah, I just took what the formatter suggested. Will update. Done http://gerrit.cloudera.org:8080/#/c/9306/2/fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java File fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java: http://gerrit.cloudera.org:8080/#/c/9306/2/fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java@625 PS2, Line 625: for (TupleId tupleId: targetSlotsByTid.keySet()) { > I filed IMPALA-6533. Can you reference that here? Done -- To view, visit http://gerrit.cloudera.org:8080/9306 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 Gerrit-Change-Number: 9306 Gerrit-PatchSet: 3 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Grant Henke Gerrit-Reviewer: Thomas Tauber-Marshall Gerrit-Comment-Date: Fri, 16 Feb 2018 16:22:45 + Gerrit-HasComments: Yes
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Grant Henke has posted comments on this change. ( http://gerrit.cloudera.org:8080/9306 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 3: (4 comments) > For example, you could add tests for insert/update/delete with decimal values > that are outside the range for the precision/scale of the column, creating a > table with a decimal primary key, etc. Do these tests exist for the decimal type in general? For other formats like text, parquet, and Avro? I looked in the decimal.test and decimal_exprs.test workloads but didn't see anything. I suspect that sort of "validation" occurs before calling down to the specific format. If not, reusing the existing tests would be great. http://gerrit.cloudera.org:8080/#/c/9306/2//COMMIT_MSG Commit Message: http://gerrit.cloudera.org:8080/#/c/9306/2//COMMIT_MSG@10 PS2, Line 10: > We generally include a "Testing" section here, eg. what tests were added, w Done http://gerrit.cloudera.org:8080/#/c/9306/1/be/src/exec/kudu-util.h File be/src/exec/kudu-util.h: http://gerrit.cloudera.org:8080/#/c/9306/1/be/src/exec/kudu-util.h@a69 PS1, Line 69: > Well its useful for debugging I filed KUDU-2303 to add a ToString method to KuduSchema itself. http://gerrit.cloudera.org:8080/#/c/9306/2/be/src/exec/kudu-util.cc File be/src/exec/kudu-util.cc: http://gerrit.cloudera.org:8080/#/c/9306/2/be/src/exec/kudu-util.cc@214 PS2, Line 214: > I imagine the formatter told you to do this. We don't follow it 100%, so yo Yeah, I just took what the formatter suggested. Will update. http://gerrit.cloudera.org:8080/#/c/9306/2/fe/src/main/java/org/apache/impala/util/KuduUtil.java File fe/src/main/java/org/apache/impala/util/KuduUtil.java: http://gerrit.cloudera.org:8080/#/c/9306/2/fe/src/main/java/org/apache/impala/util/KuduUtil.java@400 PS2, Line 400: Fall through below */ > Another place you can ignore the formatter. Done -- To view, visit http://gerrit.cloudera.org:8080/9306 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 Gerrit-Change-Number: 9306 Gerrit-PatchSet: 3 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Grant Henke Gerrit-Reviewer: Thomas Tauber-Marshall Gerrit-Comment-Date: Fri, 16 Feb 2018 16:21:58 + Gerrit-HasComments: Yes
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Hello Thomas Tauber-Marshall, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/9306 to look at the new patch set (#3). Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. IMPALA-5752: Add support for DECIMAL on Kudu tables Adds support for the Kudu DECIMAL type introduced in Kudu 1.7.0. Note: Adding support for Kudu decimal min/max filters is tracked in IMPALA-6533. Tests: * Added Kudu create with decimal test to AnalyzeDDLTest.java * Added Kudu table_format to test_decimal_queries.py ** Both decimal.test and decimal-exprs.test workloads * Added decimal queries to the following Kudu workloads: ** kudu_create.test ** kudu_delete.test ** kudu_insert.test ** kudu_update.test ** kudu_upsert.test Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 --- M be/src/exec/kudu-scanner.cc M be/src/exec/kudu-table-sink.cc M be/src/exec/kudu-util.cc M be/src/exec/kudu-util.h M be/src/exprs/kudu-partition-expr.cc M fe/src/main/java/org/apache/impala/catalog/KuduColumn.java M fe/src/main/java/org/apache/impala/planner/KuduScanNode.java M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java M fe/src/main/java/org/apache/impala/service/KuduCatalogOpExecutor.java M fe/src/main/java/org/apache/impala/util/KuduUtil.java M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java M testdata/datasets/functional/schema_constraints.csv M testdata/workloads/functional-query/queries/QueryTest/kudu_create.test M testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test M testdata/workloads/functional-query/queries/QueryTest/kudu_describe.test M testdata/workloads/functional-query/queries/QueryTest/kudu_insert.test M testdata/workloads/functional-query/queries/QueryTest/kudu_update.test M testdata/workloads/functional-query/queries/QueryTest/kudu_upsert.test M tests/query_test/test_decimal_queries.py M tests/query_test/test_kudu.py 20 files changed, 691 insertions(+), 603 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/06/9306/3 -- To view, visit http://gerrit.cloudera.org:8080/9306 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 Gerrit-Change-Number: 9306 Gerrit-PatchSet: 3 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Grant Henke Gerrit-Reviewer: Thomas Tauber-Marshall
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Thomas Tauber-Marshall has posted comments on this change. ( http://gerrit.cloudera.org:8080/9306 ) Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. Patch Set 2: (5 comments) > (1 comment) > > I ran the code formatter and updated the patch with those changes. > > I think the runtime filter functionality should be added, but I > should likely do that in a separate patch to keep this patch > smaller and focused. I can create a jira to track that if you > agree. I will look how difficult adding decimal min-max filters is > tomorrow. Sounds good. I think the biggest thing now is just making sure we've tested everything well enough. For example, you could add tests for insert/update/delete with decimal values that are outside the range for the precision/scale of the column, creating a table with a decimal primary key, etc. http://gerrit.cloudera.org:8080/#/c/9306/2//COMMIT_MSG Commit Message: http://gerrit.cloudera.org:8080/#/c/9306/2//COMMIT_MSG@10 PS2, Line 10: We generally include a "Testing" section here, eg. what tests were added, what did you run, etc. You should also take a look at tests/query_tests/test_decimal_queries.py. You should be able to add Kudu to TestDecimalQueries with something like: "v.get_value('table_format').file_format in ['parquet', 'kudu']" You'll also need to take a look at testdata/datasets/functional/schema_constraints.csv to add the decimal related tables to data load for Kudu. http://gerrit.cloudera.org:8080/#/c/9306/1/be/src/exec/kudu-util.h File be/src/exec/kudu-util.h: http://gerrit.cloudera.org:8080/#/c/9306/1/be/src/exec/kudu-util.h@a69 PS1, Line 69: > Since it's not used I don't see a reason to keep it around. Well its useful for debugging http://gerrit.cloudera.org:8080/#/c/9306/2/be/src/exec/kudu-util.cc File be/src/exec/kudu-util.cc: http://gerrit.cloudera.org:8080/#/c/9306/2/be/src/exec/kudu-util.cc@214 PS2, Line 214: return ColumnType(PrimitiveType::TYPE_DECIMAL); I imagine the formatter told you to do this. We don't follow it 100%, so you can just follow the example of the above lines. http://gerrit.cloudera.org:8080/#/c/9306/2/fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java File fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java: http://gerrit.cloudera.org:8080/#/c/9306/2/fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java@625 PS2, Line 625: // TODO: Support Kudu Decimal Min/Max Filters I filed IMPALA-6533. Can you reference that here? http://gerrit.cloudera.org:8080/#/c/9306/2/fe/src/main/java/org/apache/impala/util/KuduUtil.java File fe/src/main/java/org/apache/impala/util/KuduUtil.java: http://gerrit.cloudera.org:8080/#/c/9306/2/fe/src/main/java/org/apache/impala/util/KuduUtil.java@400 PS2, Line 400: return org.apache.kudu.Type.DECIMAL; Another place you can ignore the formatter. -- To view, visit http://gerrit.cloudera.org:8080/9306 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 Gerrit-Change-Number: 9306 Gerrit-PatchSet: 2 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Grant Henke Gerrit-Reviewer: Thomas Tauber-Marshall Gerrit-Comment-Date: Fri, 16 Feb 2018 04:02:49 + Gerrit-HasComments: Yes
[Impala-ASF-CR] IMPALA-5752: Add support for DECIMAL on Kudu tables
Grant Henke has uploaded this change for review. ( http://gerrit.cloudera.org:8080/9306 Change subject: IMPALA-5752: Add support for DECIMAL on Kudu tables .. IMPALA-5752: Add support for DECIMAL on Kudu tables Adds support for the Kudu DECIMAL type introduced in Kudu 1.7.0. Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 --- M be/src/exec/kudu-scanner.cc M be/src/exec/kudu-table-sink.cc M be/src/exec/kudu-util.cc M be/src/exec/kudu-util.h M be/src/exprs/kudu-partition-expr.cc M fe/src/main/java/org/apache/impala/catalog/KuduColumn.java M fe/src/main/java/org/apache/impala/planner/KuduScanNode.java M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java M fe/src/main/java/org/apache/impala/service/KuduCatalogOpExecutor.java M fe/src/main/java/org/apache/impala/util/KuduUtil.java M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java M testdata/workloads/functional-query/queries/QueryTest/kudu_create.test M testdata/workloads/functional-query/queries/QueryTest/kudu_delete.test M testdata/workloads/functional-query/queries/QueryTest/kudu_describe.test M testdata/workloads/functional-query/queries/QueryTest/kudu_insert.test M testdata/workloads/functional-query/queries/QueryTest/kudu_update.test M testdata/workloads/functional-query/queries/QueryTest/kudu_upsert.test M tests/query_test/test_kudu.py 18 files changed, 689 insertions(+), 598 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/06/9306/2 -- To view, visit http://gerrit.cloudera.org:8080/9306 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I2f927fce25dc4fa9529a4e0b688825699f5c0ea6 Gerrit-Change-Number: 9306 Gerrit-PatchSet: 2 Gerrit-Owner: Grant HenkeGerrit-Reviewer: Grant Henke Gerrit-Reviewer: Thomas Tauber-Marshall