[
https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15511653#comment-15511653
]
Jerry He commented on HBASE-16672:
----------------------------------
Also there is another place that needs to be taken care of, in the
SecureBulkLoadListener where we move or copy the files to staging dir. In the
secure bulk load case, that is the place to decide copy or rename.
> Add option for bulk load to copy hfile(s) instead of renaming
> -------------------------------------------------------------
>
> Key: HBASE-16672
> URL: https://issues.apache.org/jira/browse/HBASE-16672
> Project: HBase
> Issue Type: Improvement
> Reporter: Ted Yu
> Assignee: Ted Yu
> Attachments: 16672.v1.txt, 16672.v2.txt, 16672.v3.txt, 16672.v4.txt
>
>
> While working on HBASE-14417, I found that taking full backup of table which
> received bulk loaded hfiles and later gone through incremental restore failed
> with the following exception:
> {code}
> 2016-09-21 11:33:06,340 WARN [member: '10.22.9.171,53915,1474482617015'
> subprocedure-pool7-thread-1]
> snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(347): Got
> Exception in SnapshotSubprocedurePool
> java.util.concurrent.ExecutionException: java.io.FileNotFoundException: File
> does not exist:
> hdfs://localhost:53901/user/tyu/test-data/48928d44-9757-4923-af29-60288fb8a553/data/ns1/test-1474482646700/
>
> d1a93d05a75c596533ba4331a378fb3a/f/3dfb3a37cf6b4b519769b3116d8ab35a_SeqId_205_
> at java.util.concurrent.FutureTask.report(FutureTask.java:122)
> at java.util.concurrent.FutureTask.get(FutureTask.java:192)
> at
> org.apache.hadoop.hbase.regionserver.snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool.waitForOutstandingTasks(RegionServerSnapshotManager.java:323)
> at
> org.apache.hadoop.hbase.regionserver.snapshot.FlushSnapshotSubprocedure.flushSnapshot(FlushSnapshotSubprocedure.java:139)
> at
> org.apache.hadoop.hbase.regionserver.snapshot.FlushSnapshotSubprocedure.insideBarrier(FlushSnapshotSubprocedure.java:159)
> {code}
> The cause was that the bulk loaded hfiles in source table were renamed during
> bulk load step of incremental restore.
> To support incrementally restoring to multiple destinations, this issue adds
> option which would always copy hfile(s) during bulk load.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
