[
https://issues.apache.org/jira/browse/HBASE-19006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204247#comment-16204247
]
Ted Yu commented on HBASE-19006:
--------------------------------
{code}
2017-10-13 13:55:56,703 WARN [Thread-881] mapred.LocalJobRunner$Job(590):
job_local876554327_0004
java.io.IOException: Inconsistent sequence file: current chunk file
org.apache.hadoop.tools.CopyListingFileStatus@e44de415{hdfs://localhost:62602/user/vrodionov/test-data/
6b218856-adc9-4659-ad15-868aa83e6c48/data/ns1/test-1507928111932/95d195f6a91639b50388e50fc8751d69/f/7e45c3c177964f0cb315c8d2456b8b90_SeqId_205_
length = 5100 aclEntries = null, xAttrs = null} doesnt match prior entry
org.apache.hadoop.tools.CopyListingFileStatus@a91b2cdf{hdfs://localhost:62602/user/vrodionov/test-data/6b218856-adc9-4659-ad15-
868aa83e6c48/data/ns1/test-1507928111932/95d195f6a91639b50388e50fc8751d69/f/615e1b7549ff47b68a9d599ae7f6832f_SeqId_205_
length = 5142 aclEntries = null, xAttrs = null}
at
org.apache.hadoop.tools.mapred.CopyCommitter.concatFileChunks(CopyCommitter.java:269)
at
org.apache.hadoop.tools.mapred.CopyCommitter.commitJob(CopyCommitter.java:96)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:567)
...
2017-10-13 13:55:56,830 ERROR [main] tools.DistCp(167): Exception encountered
java.lang.Exception: DistCp job-id: job_local876554327_0004 failed
at
org.apache.hadoop.hbase.backup.mapreduce.MapReduceBackupCopyJob$BackupDistCp.execute(MapReduceBackupCopyJob.java:248)
at org.apache.hadoop.tools.DistCp.run(DistCp.java:153)
at
org.apache.hadoop.hbase.backup.mapreduce.MapReduceBackupCopyJob.copy(MapReduceBackupCopyJob.java:407)
at
org.apache.hadoop.hbase.backup.impl.IncrementalTableBackupClient.incrementalCopyHFiles(IncrementalTableBackupClient.java:300)
{code}
Interesting - the first stack trace was at WARN and second stack trace didn't
reveal cause ...
> Fix TestIncrementalBackupWithBulkLoad under hadoop3
> ---------------------------------------------------
>
> Key: HBASE-19006
> URL: https://issues.apache.org/jira/browse/HBASE-19006
> Project: HBase
> Issue Type: Bug
> Reporter: Vladimir Rodionov
> Assignee: Vladimir Rodionov
> Priority: Critical
> Fix For: 2.0.0-beta-2
>
> Attachments:
> org.apache.hadoop.hbase.backup.TestIncrementalBackupWithBulkLoad-output.txt.gz
>
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
