GitHub user blrunner opened a pull request:
https://github.com/apache/tajo/pull/357
TAJO-1311: Enable Scattered Hash Shuffle for CTAS statement.
Currently, Tajo just use hash shuffle for CTAS statement. If you use large
partitioned table for target table, you will see poor performance of wrong task
number. Thus, we need to calculate the number for the partitioned table with
scattered hash shuffle.
For reference, CTAS includes two bugs as follows:
- Tajo doesn't verify target column number for CTAS statement
- If target table and source table are column partitioned table, Tajo
doesn't support CTAS statement.
I'll create another jira issues at once.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/blrunner/tajo TAJO-1311
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/tajo/pull/357.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #357
----
commit 6eb2d10cb1d7805d46436829f443c92ef0d15f29
Author: JaeHwa Jung <[email protected]>
Date: 2015-01-22T14:37:34Z
TAJO-1311: Enable Scattered Hash Shuffle for CTAS statement.
commit 6e5e14e82d21d81de1ceaedf53307acc39ccf7c0
Author: JaeHwa Jung <[email protected]>
Date: 2015-01-22T14:37:58Z
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/tajo into
TAJO-1311
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
