[
https://issues.apache.org/jira/browse/HDFS-11711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040031#comment-16040031
]
Yiqun Lin commented on HDFS-11711:
----------------------------------
Thanks [~brahmareddy] for the updated patch.
Found two nits:
{code}
try {
+ new BlockSender(b, 0, -1, false, true, true,
+ cluster.getDataNodes().get(0), null,
+ CachingStrategy.newDefaultStrategy());
+ fail("Must throw File not found");
+ } catch (FileNotFoundException fe) {
+ assertTrue("Should throw too many open",
+ fe.getMessage().contains("Too many open files"));
+ }
{code}
{{Must throw File not found}} would be better updated to {{Must throw
FileNotFoundException}},
{{Should throw too many open}} would be better updated to {{Should throw too
many open files}}
You can just update this while committing, :). Thanks
> DN should not delete the block On "Too many open files" Exception
> -----------------------------------------------------------------
>
> Key: HDFS-11711
> URL: https://issues.apache.org/jira/browse/HDFS-11711
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: datanode
> Reporter: Brahma Reddy Battula
> Assignee: Brahma Reddy Battula
> Priority: Critical
> Attachments: HDFS-11711-002.patch, HDFS-11711-003.patch,
> HDFS-11711-004.patch, HDFS-11711-branch-2-002.patch, HDFS-11711.patch
>
>
> *Seen the following scenario in one of our customer environment*
> * while jobclient writing {{"job.xml"}} there are pipeline failures and
> written to only one DN.
> * when mapper reading the {{"job.xml"}}, DN got {{"Too many open files"}} (as
> system exceed limit) and block got deleted. Hence mapper failed to read and
> job got failed.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
