[
https://issues.apache.org/jira/browse/HDFS-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405025#comment-13405025
]
amith commented on HDFS-3584:
-----------------------------
Here I can see client1 are not able to get the lease renewed with in soft limit
period and client2 try to trigger lease recovery
I can see this from the exception @ client
Client log
{noformat}
2012-06-28 19:40:56,452 INFO hdfs.TestHDFSAPI
(TestHDFSAPI.java:writeFile(168)) - Writing File with client
DFS[DFSClient[clientName=DFSClient_clientIDD36655341694508_139393306_1,
ugi=B00902108 (auth:SIMPLE)]] File = /home/test/writefile_36673810701636
2012-06-28 19:41:04,619 INFO hdfs.TestHDFSAPI
(TestHDFSAPI.java:writeFile(179)) - Creating File with client
DFS[DFSClient[clientName=DFSClient_clientIDD36655341694508_139393306_1,
ugi=B00902108 (auth:SIMPLE)]] File = /home/test/writefile_36673810701636
2012-06-28 19:42:28,004 INFO hdfs.TestHDFSAPI
(TestHDFSAPI.java:writeFile(186)) - Closing File with client
DFS[DFSClient[clientName=DFSClient_clientIDD36655341694508_139393306_1,
ugi=B00902108 (auth:SIMPLE)]] File = /home/test/writefile_36673810701636 file
size= 524288
2012-06-28 19:42:32,680 INFO hdfs.TestHDFSAPI
(TestHDFSAPI.java:appendFile(76)) - Going Append File with client
DFS[DFSClient[clientName=DFSClient_clientIDD36661058974201_139393306_1,
ugi=B00902108 (auth:SIMPLE)]]File = /home/test/writefile_36673810701636file
size= 524288
org.apache.hadoop.hdfs.protocol.RecoveryInProgressException: Failed to close
file /home/test/writefile_36673810701636. Lease recovery is in progress. Try
again later.
{noformat}
> Blocks are getting marked as corrupt with append operation under high load.
> ---------------------------------------------------------------------------
>
> Key: HDFS-3584
> URL: https://issues.apache.org/jira/browse/HDFS-3584
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: name-node
> Affects Versions: 2.0.1-alpha
> Reporter: Brahma Reddy Battula
>
> Scenario:
> =========
> 1. There are 2 clients cli1 and cli2 cli1 write a file F1 and not closed
> 2. The cli2 will call append on unclosed file and triggers a leaserecovery
> 3. Cli1 is closed
> 4. Lease recovery is completed and with updated GS in DN and got BlockReport
> since there is a mismatch in GS the block got corrupted
> 5. Now we got a CommitBlockSync this will also fail since the File is already
> closed by cli1 and state in NN is Finalized
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
