Hello Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/20440
to look at the new patch set (#4).
Change subject: POC local partitioned join
......................................................................
POC local partitioned join
Could measure some speedup in build heavy queries:
set mt_dop=8;
broadcast:
select straight_join count(*) from tpcds_parquet.store_sales s1 join
/*+broadcast*/ tpcds_parquet.store_sales16 s2 on s1.ss_customer_sk =
s2.ss_customer_sk;
5.7s total, 2.7s join build
local partitioning:
select straight_join count(*) from tpcds_parquet.store_sales s1 join
/*+local_shuffle*/ tpcds_parquet.store_sales16 s2 on s1.ss_customer_sk =
s2.ss_customer_sk;
4.5s total, 0.6s join build
Change-Id: I05780343c788c12f345992066091e0e7813028f5
---
M be/src/exec/partitioned-hash-join-builder.h
M be/src/runtime/coordinator.cc
M be/src/runtime/coordinator.h
M be/src/runtime/krpc-data-stream-sender-ir.cc
M be/src/runtime/krpc-data-stream-sender.cc
M be/src/runtime/krpc-data-stream-sender.h
M be/src/runtime/runtime-filter-bank.cc
M be/src/scheduling/scheduler.cc
M be/src/service/query-options.cc
M be/src/service/query-options.h
M common/thrift/ImpalaService.thrift
M common/thrift/Partitions.thrift
M common/thrift/PlanNodes.thrift
M common/thrift/Planner.thrift
M common/thrift/Query.thrift
M fe/src/main/java/org/apache/impala/analysis/TableRef.java
M fe/src/main/java/org/apache/impala/planner/DataPartition.java
M fe/src/main/java/org/apache/impala/planner/DistributedPlanner.java
M fe/src/main/java/org/apache/impala/planner/HashJoinNode.java
M fe/src/main/java/org/apache/impala/planner/JoinNode.java
M fe/src/main/java/org/apache/impala/planner/PlanFragment.java
M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java
M tests/query_test/test_join_queries.py
23 files changed, 249 insertions(+), 29 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/40/20440/4
--
To view, visit http://gerrit.cloudera.org:8080/20440
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I05780343c788c12f345992066091e0e7813028f5
Gerrit-Change-Number: 20440
Gerrit-PatchSet: 4
Gerrit-Owner: Csaba Ringhofer <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
