[
https://issues.apache.org/jira/browse/HDFS-11711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16039085#comment-16039085
]
Yiqun Lin commented on HDFS-11711:
----------------------------------
Hi [~brahmareddy], just one comment from me:
The third param vaule should be more than the second param in
{{GenericTestUtils#waitFor(Supplier<Boolean> check,
int checkEveryMillis, int waitForMillis)}}, now 600ms < 1000ms, maybe you
just want to use 6000 here?
{code}
+ private void verifyBlockLocations(DistributedFileSystem fs, Path p,
+ int expected) throws IOException, TimeoutException, InterruptedException
{
+ final LocatedBlock lb =
+ fs.getClient().getLocatedBlocks(p.toString(), 0).get(0);
+ GenericTestUtils.waitFor(new Supplier<Boolean>() {
+ @Override
+ public Boolean get() {
+ return lb.getLocations().length == expected;
+ }
+ }, 1000, 600);
{code}
> DN should not delete the block On "Too many open files" Exception
> -----------------------------------------------------------------
>
> Key: HDFS-11711
> URL: https://issues.apache.org/jira/browse/HDFS-11711
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: datanode
> Reporter: Brahma Reddy Battula
> Assignee: Brahma Reddy Battula
> Priority: Critical
> Attachments: HDFS-11711-002.patch, HDFS-11711-003.patch,
> HDFS-11711-branch-2-002.patch, HDFS-11711.patch
>
>
> *Seen the following scenario in one of our customer environment*
> * while jobclient writing {{"job.xml"}} there are pipeline failures and
> written to only one DN.
> * when mapper reading the {{"job.xml"}}, DN got {{"Too many open files"}} (as
> system exceed limit) and block got deleted. Hence mapper failed to read and
> job got failed.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
