[
https://issues.apache.org/jira/browse/TAJO-2177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15384296#comment-15384296
]
Hudson commented on TAJO-2177:
------------------------------
FAILURE: Integrated in Tajo-0.11.4-build #196 (See
[https://builds.apache.org/job/Tajo-0.11.4-build/196/])
TAJO-2177: In BroadcastJoinRule, the total volume of broadcast tables
(jihoonson: rev 27a709c25d6cc5986f945fb5275b3228e7cd419e)
* tajo-core/src/main/java/org/apache/tajo/benchmark/TPCH.java
*
tajo-core/src/main/java/org/apache/tajo/engine/planner/global/ExecutionBlock.java
*
tajo-core-tests/src/test/resources/results/TestMultipleJoinTypes/testExceedBroadcastThreshold.1.result
*
tajo-core-tests/src/test/resources/results/TestMultipleJoinTypes/testExceedBroadcastThreshold.1.Sort_NoBroadcast.plan
*
tajo-plan/src/main/java/org/apache/tajo/plan/verifier/PostLogicalPlanVerifier.java
*
tajo-core-tests/src/test/resources/results/TestMultipleJoinTypes/testExceedBroadcastThreshold.1.Sort.plan
* tajo-plan/src/main/java/org/apache/tajo/plan/util/PlannerUtil.java
*
tajo-core/src/main/java/org/apache/tajo/engine/planner/global/rewriter/rules/BroadcastJoinRule.java
* CHANGES
*
tajo-core-tests/src/test/resources/results/TestMultipleJoinTypes/testExceedBroadcastThreshold.1.Hash_NoBroadcast.plan
*
tajo-core-tests/src/test/resources/results/TestMultipleJoinTypes/testExceedBroadcastThreshold.1.Hash.plan
* tajo-cluster-tests/src/test/java/org/apache/tajo/TpchTestBase.java
* tajo-core-tests/src/test/java/org/apache/tajo/engine/query/TestJoinQuery.java
*
tajo-core-tests/src/test/java/org/apache/tajo/engine/query/TestMultipleJoinTypes.java
*
tajo-core/src/main/java/org/apache/tajo/engine/planner/global/rewriter/rules/GlobalPlanRewriteUtil.java
* tajo-cluster-tests/src/test/resources/tpch/small_supplier.tbl
> In BroadcastJoinRule, the total volume of broadcast tables should be checked
> before stages are merged
> -----------------------------------------------------------------------------------------------------
>
> Key: TAJO-2177
> URL: https://issues.apache.org/jira/browse/TAJO-2177
> Project: Tajo
> Issue Type: Bug
> Components: Planner/Optimizer
> Affects Versions: 0.11.3
> Reporter: Jihoon Son
> Assignee: Jihoon Son
> Fix For: 0.12.0, 0.11.4
>
>
> Currently, one of broadcast candidates may be marked as not being
> broadcastable because the total volume of the merged stage exceeds the
> broadcast join threshold.
> This is done in BroadcastJoinRule::checkTotalSizeOfBroadcastableRelations(),
> but it causes a bug because it doesn't split the merged stage into separate
> ones again.
> This routine should be improved to check the total volume of broadcast
> candidates before merging stages.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
