[
https://issues.apache.org/jira/browse/HADOOP-15475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16503607#comment-16503607
]
Íñigo Goiri commented on HADOOP-15475:
--------------------------------------
bq. One thing which would be good would be for some official ASF windows libs
to ship. I do the set on github, but that's not quite the same as the ASF
blessing. Even without all the tests passing, we can at least include the
native binaries as signed artifacts
I guess that now that we switched the way winutils are built, we should be able
to build them from Linux, right?
In that case, it should be fairly easy for the release manager to add the
windows native libs.
For the progress, we cut a bunch and we are pretty much caught up (242 in
trunk) with our internal branch-2.9 runs (~230 in our internal run).
The status right now is:
||Run||Date||Total||Skipped||Failed||Passed||
|[459|https://builds.apache.org/job/hadoop-trunk-win/459/testReport/]|2018/05/06|19386|1465|846|17075|
|[460|https://builds.apache.org/job/hadoop-trunk-win/460/testReport/]|2018/05/07|16906|1418|754|14734|
|[463|https://builds.apache.org/job/hadoop-trunk-win/463/testReport/]|2018/05/10|19252|1472|540|17240|
|[467|https://builds.apache.org/job/hadoop-trunk-win/467/testReport/]|2018/05/14|19317|1472|573|17272|
|[469|https://builds.apache.org/job/hadoop-trunk-win/469/testReport/]|2018/05/16|19326|1472|516|17388|
|[476|https://builds.apache.org/job/hadoop-trunk-win/476/testReport/]|2018/05/23|19355|1473|446|17436|
|[479|https://builds.apache.org/job/hadoop-trunk-win/479/testReport/]|2018/05/26|19384|1473|375|17536|
|[481|https://builds.apache.org/job/hadoop-trunk-win/481/testReport/]|2018/05/23|19409|1472|405|17532|
|[483|https://builds.apache.org/job/hadoop-trunk-win/483/testReport/]|2018/05/30|19390|1473|348|17569|
|[484|https://builds.apache.org/job/hadoop-trunk-win/484/testReport/]|2018/05/31|19390|1473|288|17629|
|[485|https://builds.apache.org/job/hadoop-trunk-win/484/testReport/]|2018/06/01|19173|1473|270|17430|
|[489|https://builds.apache.org/job/hadoop-trunk-win/489/testReport/]|2018/06/05|19394|1482|242|17670|
In HDFS we have fixed a bunch by using the randomized path per test case but we
haven't really fixed the root causes.
There is still a bunch of timeouts which we think are because of poll0 being
very slow at the beginning.
For MapReduce there are a bunch that should be fixable and we can cut the
number substantially.
In YARN, there a lot of failures but the fixes are not trivial (we still have
the Linux tests ignore pending from YARN-8359).
> Fix broken unit tests on Windows
> --------------------------------
>
> Key: HADOOP-15475
> URL: https://issues.apache.org/jira/browse/HADOOP-15475
> Project: Hadoop Common
> Issue Type: Test
> Affects Versions: 3.1.0, 2.9.1
> Reporter: Anbang Hu
> Assignee: Anbang Hu
> Priority: Minor
> Labels: Windows
>
> There are hundreds of unit tests that fail on Windows. This JIRA tracks the
> effort to fix them.
> The main reasons for unit test failures on Windows are:
> * Windows/Linux path formats (e.g., HDFS-10256).
> * Line separator.
> * Locked files: Windows locks files when opening them.
> ** The typical trigger is not cleaning MiniDFSCluster leaves files locked
> when a test times out; they need to be cleaned using After.
> * Memory lock size.
> * Slow DNS resolution (e.g., HDFS-13569).
> * Locked ports (e.g., HDFS-11700)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
