[
https://issues.apache.org/jira/browse/TAJO-2177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380441#comment-15380441
]
ASF GitHub Bot commented on TAJO-2177:
--------------------------------------
GitHub user jihoonson opened a pull request:
https://github.com/apache/tajo/pull/1040
TAJO-2177: In BroadcastJoinRule, the total volume of broadcast tables…
… should be checked before stages are merged.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jihoonson/tajo-2 TAJO-2177
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/tajo/pull/1040.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1040
----
commit 86ff60cbc5e1451ed2b0f51a8da51ca99a3c4c1e
Author: Jihoon Son <[email protected]>
Date: 2016-07-16T01:07:39Z
TAJO-2177: In BroadcastJoinRule, the total volume of broadcast tables
should be checked before stages are merged.
----
> In BroadcastJoinRule, the total volume of broadcast tables should be checked
> before stages are merged
> -----------------------------------------------------------------------------------------------------
>
> Key: TAJO-2177
> URL: https://issues.apache.org/jira/browse/TAJO-2177
> Project: Tajo
> Issue Type: Bug
> Components: Planner/Optimizer
> Affects Versions: 0.11.3
> Reporter: Jihoon Son
> Assignee: Jihoon Son
> Fix For: 0.12.0, 0.11.4
>
>
> Currently, one of broadcast candidates may be marked as not being
> broadcastable because the total volume of the merged stage exceeds the
> broadcast join threshold.
> This is done in BroadcastJoinRule::checkTotalSizeOfBroadcastableRelations(),
> but it causes a bug because it doesn't split the merged stage into separate
> ones again.
> This routine should be improved to check the total volume of broadcast
> candidates before merging stages.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
