[
https://issues.apache.org/jira/browse/TAJO-574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13888450#comment-13888450
]
Tajo QA commented on TAJO-574:
------------------------------
{color:red}*-1 overall.*{color} Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12626448/TAJO-574.patch
against master revision d516fc4.
{color:green}+1 @author.{color} The patch does not contain any @author
tags.
{color:green}+1 tests included.{color} The patch appears to include 1 new
or modified test files.
{color:green}+1 javac.{color} The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc.{color} The applied patch does not increase the
total number of javadoc warnings.
{color:green}+1 checkstyle.{color} The patch generated 0 code style errors.
{color:red}-1 findbugs.{color} The patch appears to introduce 204 new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit.{color} The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests.{color} The patch passed unit tests in
tajo-catalog/tajo-catalog-common tajo-core/tajo-core-backend.
Test results: https://builds.apache.org/job/PreCommit-TAJO-Build/95//testReport/
Findbugs warnings:
https://builds.apache.org/job/PreCommit-TAJO-Build/95//artifact/incubator-tajo/patchprocess/newPatchFindbugsWarningstajo-catalog-common.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-TAJO-Build/95//artifact/incubator-tajo/patchprocess/newPatchFindbugsWarningstajo-core-backend.html
Console output: https://builds.apache.org/job/PreCommit-TAJO-Build/95//console
This message is automatically generated.
> Add a sort-based physical executor for column partition store
> -------------------------------------------------------------
>
> Key: TAJO-574
> URL: https://issues.apache.org/jira/browse/TAJO-574
> Project: Tajo
> Issue Type: New Feature
> Components: physical operator
> Reporter: Hyunsik Choi
> Assignee: Hyunsik Choi
> Fix For: 0.8-incubating
>
> Attachments: TAJO-574.patch
>
>
> ColumnPartitionStoreExec keeps numerous open files while it is storing all
> data. In addition, it's random write gives burden to HDFS namenode.
> To solve this problem, I would like to propose a sort-based physical executor
> for column partition store. It assumes that input tuples are sorted in an
> ascending or descending order of partition keys. It means that it needs extra
> sort operation. But, it opens only one file simultaneously. It writes all
> data sequentially. In many cases, it would be the best choice for column
> partition store.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
