[
https://issues.apache.org/jira/browse/HIVE-18918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugene Koifman updated HIVE-18918:
----------------------------------
Description:
{noformat}
rj.waitForCompletion();
if (!rj.isSuccessful()) {
throw new IOException(compactionType == CompactionType.MAJOR ? "Major"
: "Minor" +
" compactor job failed for " + jobName + "! Hadoop JobId: " +
rj.getID());
}
{noformat}
produces no useful info in case of Major compaction
{noformat}
2018-02-28 00:59:16,416 ERROR [gdpr1-61]: compactor.Worker
(Worker.java:run(191)) - Caught exception while trying to compact
id:38602,dbname:audit,tableName:COMP_ENTRY_AF_A,partN\
ame:partition_dt=2017-04-11,state:^@,type:MAJOR,properties:null,runAs:null,tooManyAborts:false,highestTxnId:0.
Marking failed to avoid repeated failures, java.io.IOException: Ma\
jor
at
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR.launchCompactionJob(CompactorMR.java:314)
at
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR.run(CompactorMR.java:269)
at org.apache.hadoop.hive.ql.txn.compactor.Worker$1.run(Worker.java:175)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869)
at org.apache.hadoop.hive.ql.txn.compactor.Worker.run(Worker.java:172)
{noformat}
was:
{noformat}
rj.waitForCompletion();
if (!rj.isSuccessful()) {
throw new IOException(compactionType == CompactionType.MAJOR ? "Major"
: "Minor" +
" compactor job failed for " + jobName + "! Hadoop JobId: " +
rj.getID());
}
{noformat}
produces no useful info in case of Major compaction
> Bad error message in CompactorMR.lanuchCompactionJob()
> ------------------------------------------------------
>
> Key: HIVE-18918
> URL: https://issues.apache.org/jira/browse/HIVE-18918
> Project: Hive
> Issue Type: Bug
> Components: Transactions
> Affects Versions: 1.2.2
> Reporter: Eugene Koifman
> Assignee: Eugene Koifman
> Priority: Major
> Attachments: HIVE-18918.01.patch
>
>
> {noformat}
> rj.waitForCompletion();
> if (!rj.isSuccessful()) {
> throw new IOException(compactionType == CompactionType.MAJOR ?
> "Major" : "Minor" +
> " compactor job failed for " + jobName + "! Hadoop JobId: " +
> rj.getID());
> }
> {noformat}
> produces no useful info in case of Major compaction
> {noformat}
> 2018-02-28 00:59:16,416 ERROR [gdpr1-61]: compactor.Worker
> (Worker.java:run(191)) - Caught exception while trying to compact
> id:38602,dbname:audit,tableName:COMP_ENTRY_AF_A,partN\
> ame:partition_dt=2017-04-11,state:^@,type:MAJOR,properties:null,runAs:null,tooManyAborts:false,highestTxnId:0.
> Marking failed to avoid repeated failures, java.io.IOException: Ma\
> jor
> at
> org.apache.hadoop.hive.ql.txn.compactor.CompactorMR.launchCompactionJob(CompactorMR.java:314)
> at
> org.apache.hadoop.hive.ql.txn.compactor.CompactorMR.run(CompactorMR.java:269)
> at
> org.apache.hadoop.hive.ql.txn.compactor.Worker$1.run(Worker.java:175)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869)
> at org.apache.hadoop.hive.ql.txn.compactor.Worker.run(Worker.java:172)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
