Allen Wittenauer commented on HDFS-12512:

bq.  do you have any idea on what might be the issue?

This is basically HDFS-12711 (still) 

The HDFS unit tests are completely unreliable on the ASF infrastructure.  You 
can go to pretty much any HDFS patch and see this happening.

bq.  No idea how to get around this.

Break hadoop-hdfs into multiple modules is the full fix. Turning off 
parallelization would be a temporary workaround but that just means the tests 
run 4 hours instead of 1 hour, which would just break the ASF infrastructure in 
other ways.  But other than that, no idea.  In the end, there are too many 
large tests with too many threads running at once. They hit the upper process 
count limits and will actually crash nodes if let loose.  

Just to make matters worse, Jenkins, Yetus, etc, can't report the failures 
because surefire doesn't report them properly either (SUREFIRE-1447).  I've 
been contemplating workarounds in YETUS-587, but since Hadoop isn't a priority 
of my volunteer time, I haven't spent a lot of effort on it.

> RBF: Add WebHDFS
> ----------------
>                 Key: HDFS-12512
>                 URL: https://issues.apache.org/jira/browse/HDFS-12512
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: fs
>            Reporter: Íñigo Goiri
>            Assignee: Wei Yan
>            Priority: Major
>              Labels: RBF
>         Attachments: HDFS-12512.000.patch, HDFS-12512.001.patch, 
> HDFS-12512.002.patch, HDFS-12512.003.patch, HDFS-12512.004.patch, 
> HDFS-12512.005.patch, HDFS-12512.006.patch
> The Router currently does not support WebHDFS. It needs to implement 
> something similar to {{NamenodeWebHdfsMethods}}.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to