[ 
https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated HDFS-12711:
------------------------------------
    Resolution: Incomplete
        Status: Resolved  (was: Patch Available)

I think I'm going to close this as incomplete. Yetus 0.7.0 and up appear to be 
successfully preventing HDFS unit tests from killing nodes. It does not, 
however, make the HDFS unit tests work. They are still wildly unreliable (e.g., 
HDFS-12512).

There are two remediations that need to happen, both of which are out of my 
purview:

1. The Hadoop PMC needs to push on INFRA-15685 to get the max task count 
raised. Doing so raises the thread count, but that's only a *temporary* 
solution until HDFS is pushed over the edge again.

2. hadoop-hdfs-project either needs to get refactored into multiple maven 
modules or the simultaneous thread counts need to get greatly reduced. e.g., 
just changing the unit test's DN RPC thread count may work.



> deadly hdfs test
> ----------------
>
>                 Key: HDFS-12711
>                 URL: https://issues.apache.org/jira/browse/HDFS-12711
>             Project: Hadoop HDFS
>          Issue Type: Test
>    Affects Versions: 2.9.0, 2.8.2
>            Reporter: Allen Wittenauer
>            Priority: Critical
>         Attachments: HDFS-12711.branch-2.00.patch, fakepatch.branch-2.txt
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to