[
https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16351032#comment-16351032
]
Allen Wittenauer commented on HDFS-12512:
-----------------------------------------
bq. do you have any idea on what might be the issue?
This is basically HDFS-12711 (still)
The HDFS unit tests are completely unreliable on the ASF infrastructure. You
can go to pretty much any HDFS patch and see this happening.
bq. No idea how to get around this.
Break hadoop-hdfs into multiple modules is the full fix. Turning off
parallelization would be a temporary workaround but that just means the tests
run 4 hours instead of 1 hour, which would just break the ASF infrastructure in
other ways. But other than that, no idea. In the end, there are too many
large tests with too many threads running at once. They hit the upper process
count limits and will actually crash nodes if let loose.
Just to make matters worse, Jenkins, Yetus, etc, can't report the failures
because surefire doesn't report them properly either (SUREFIRE-1447). I've
been contemplating workarounds in YETUS-587, but since Hadoop isn't a priority
of my volunteer time, I haven't spent a lot of effort on it.
> RBF: Add WebHDFS
> ----------------
>
> Key: HDFS-12512
> URL: https://issues.apache.org/jira/browse/HDFS-12512
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: fs
> Reporter: Íñigo Goiri
> Assignee: Wei Yan
> Priority: Major
> Labels: RBF
> Attachments: HDFS-12512.000.patch, HDFS-12512.001.patch,
> HDFS-12512.002.patch, HDFS-12512.003.patch, HDFS-12512.004.patch,
> HDFS-12512.005.patch, HDFS-12512.006.patch
>
>
> The Router currently does not support WebHDFS. It needs to implement
> something similar to {{NamenodeWebHdfsMethods}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
