HLogSplitter should handle missing HLogs
----------------------------------------
Key: HBASE-3412
URL: https://issues.apache.org/jira/browse/HBASE-3412
Project: HBase
Issue Type: Bug
Reporter: Jean-Daniel Cryans
Priority: Critical
Fix For: 0.90.0
In build #48 (https://hudson.apache.org/hudson/job/hbase-0.90/48/),
TestReplication failed because of missing rows on the slave cluster. The reason
is that a region server that was killed was able to archive a log at the same
time the master was trying to recover it:
{noformat}
[MASTER_META_SERVER_OPERATIONS-vesta.apache.org:47907-0] util.FSUtils(625):
Recovering file
hdfs://localhost:50121/user/hudson/.logs/vesta.apache.org,58598,1294117333857/vesta.apache.org%3A58598.1294117406909
...
[RegionServer:0;vesta.apache.org,58598,1294117333857.logRoller] wal.HLog(740):
moving old hlog file
/user/hudson/.logs/vesta.apache.org,58598,1294117333857/vesta.apache.org%3A58598.1294117406909
whose highest sequenceid is 422 to
/user/hudson/.oldlogs/vesta.apache.org%3A58598.1294117406909
...
[MASTER_META_SERVER_OPERATIONS-vesta.apache.org:47907-0]
master.MasterFileSystem(204):
Failed splitting
hdfs://localhost:50121/user/hudson/.logs/vesta.apache.org,58598,1294117333857
java.io.IOException: Failed to open
hdfs://localhost:50121/user/hudson/.logs/vesta.apache.org,58598,1294117333857/vesta.apache.org%3A58598.1294117406909
for append
Caused by: org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException:
org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException:
No lease on
/user/hudson/.logs/vesta.apache.org,58598,1294117333857/vesta.apache.org%3A58598.1294117406909
File does not exist. [Lease. Holder: DFSClient_-986975908, pendingcreates: 1]
{noformat}
We should probably just handle the fact that a file could have been archived
(maybe even check in .oldlogs to be sure) and move on to the next log.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
