Csaba Ringhofer has uploaded a new patch set (#2). ( http://gerrit.cloudera.org:8080/20440 )
Change subject: POC local partitioned join ...................................................................... POC local partitioned join Could measure some speedup in build heavy queries: set mt_dop=8; broadcast: select straight_join count(*) from tpcds_parquet.store_sales s1 join /*+broadcast*/ tpcds_parquet.store_sales16 s2 on s1.ss_customer_sk = s2.ss_customer_sk; 5.7s total, 2.7s join build local partitioning: select straight_join count(*) from tpcds_parquet.store_sales s1 join /*+local_shuffle*/ tpcds_parquet.store_sales16 s2 on s1.ss_customer_sk = s2.ss_customer_sk; 4.5s total, 0.6s join build Change-Id: I05780343c788c12f345992066091e0e7813028f5 --- M be/src/exec/partitioned-hash-join-builder.h M be/src/runtime/coordinator.cc M be/src/runtime/coordinator.h M be/src/runtime/krpc-data-stream-sender-ir.cc M be/src/runtime/krpc-data-stream-sender.cc M be/src/runtime/krpc-data-stream-sender.h M be/src/scheduling/scheduler.cc M be/src/service/query-options.cc M be/src/service/query-options.h M common/thrift/ImpalaService.thrift M common/thrift/Partitions.thrift M common/thrift/Planner.thrift M common/thrift/Query.thrift M fe/src/main/java/org/apache/impala/analysis/TableRef.java M fe/src/main/java/org/apache/impala/planner/DataPartition.java M fe/src/main/java/org/apache/impala/planner/DistributedPlanner.java M fe/src/main/java/org/apache/impala/planner/HashJoinNode.java M fe/src/main/java/org/apache/impala/planner/JoinNode.java M fe/src/main/java/org/apache/impala/planner/PlanFragment.java M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java M tests/query_test/test_join_queries.py 21 files changed, 198 insertions(+), 20 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/40/20440/2 -- To view, visit http://gerrit.cloudera.org:8080/20440 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I05780343c788c12f345992066091e0e7813028f5 Gerrit-Change-Number: 20440 Gerrit-PatchSet: 2 Gerrit-Owner: Csaba Ringhofer <[email protected]>
