[
https://issues.apache.org/jira/browse/TAJO-672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923812#comment-13923812
]
Hyunsik Choi commented on TAJO-672:
-----------------------------------
+1
Thank you for quick bug fix. Essentially, this bug is caused by wrong
computation in shuffle phase. Since writing partitioned tables take long time,
this bug may be produced. Thanks again. I just verified mvn clean install. I'll
commit it.
> Wrong progress status when overwrites to partition table
> --------------------------------------------------------
>
> Key: TAJO-672
> URL: https://issues.apache.org/jira/browse/TAJO-672
> Project: Tajo
> Issue Type: Bug
> Components: data shuffle
> Affects Versions: 0.8-incubating, 1.0-incubating
> Reporter: hyoungjunkim
> Assignee: hyoungjunkim
> Priority: Trivial
> Attachments: TAJO-672.patch
>
>
> I ran next query in cli. Progress is over 100% and then down to 97%. But
> finally finished at 100%.
> {code}
> create table orders_partition (
> o_orderkey INT8,
> o_custkey INT8,
> o_orderstatus TEXT,
> o_totalprice FLOAT8,
> o_orderdate TEXT,
> o_orderpriority TEXT,
> o_clerk TEXT,
> o_shippriority INT4,
> o_comment TEXT)
> partition by column (o_year text, o_month text);
> insert overwrite into orders_partition
> select o_orderkey, o_custkey, o_orderstatus, o_totalprice,
> o_orderdate, o_orderpriority, o_clerk, o_shippriority, o_comment,
> substr(o_orderdate, 1, 4), substr(o_orderdate , 6, 2)
> from orders;
> {code}
> {code}
> Progress: 95%, response time: 73.572 sec
> Progress: 95%, response time: 74.573 sec
> Progress: 95%, response time: 75.574 sec
> Progress: 96%, response time: 76.576 sec
> Progress: 96%, response time: 77.578 sec
> Progress: 96%, response time: 78.58 sec
> Progress: 100%, response time: 79.581 sec
> Progress: 100%, response time: 80.582 sec
> Progress: 101%, response time: 81.584 sec
> Progress: 101%, response time: 82.586 sec
> Progress: 101%, response time: 83.587 sec
> Progress: 101%, response time: 84.589 sec
> Progress: 101%, response time: 85.591 sec
> Progress: 101%, response time: 86.593 sec
> Progress: 102%, response time: 87.595 sec
> Progress: 102%, response time: 88.596 sec
> Progress: 102%, response time: 89.598 sec
> Progress: 102%, response time: 90.601 sec
> Progress: 102%, response time: 91.603 sec
> Progress: 102%, response time: 92.605 sec
> Progress: 102%, response time: 93.607 sec
> Progress: 97%, response time: 94.608 sec
> Progress: 97%, response time: 95.61 sec
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
