Ujjawal Kumar created HBASE-30501:
-------------------------------------
Summary: LoadIncrementalHFiles (during bulk load) restart isn't
safe during hfile splitting
Key: HBASE-30501
URL: https://issues.apache.org/jira/browse/HBASE-30501
Project: HBase
Issue Type: Bug
Reporter: Ujjawal Kumar
LoadIncrementalHFiles automatically splits an HFile that crosses region
boundaries into .bottom and .top files under .tmp and tracks them in an
in-memory queue. If the invocation
fails after splitting but before loading—for example, due to the maximum
HFiles-per-region/family limit—the queue is lost. A new invocation may not
rediscover .tmp files, while the original HFile may already have been deleted.
Update the retry behavior to preserve the original HFile until the split
outputs are successfully loaded, or persist and rediscover split outputs across
invocations. Add tests covering failure after splitting followed by a fresh
LoadIncrementalHFiles retry.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
