[
https://issues.apache.org/jira/browse/SPARK-14914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261979#comment-15261979
]
Fuzhou Chen commented on SPARK-14914:
-------------------------------------
As per suggested by Sean, let me explain the background of this check-in.
Tao LI and I are both working in Microsoft. Our team is working on a project to
host Spark + Hadoop cluster on Windows servers. In order to support
development, we want to enable tests on Windows. During the process, Tao found
and fixed a lot of problems that make the existing test failed on Windows. So
we think it a good idea to contribute his change back to community.
We are looking for help to push forward for this effort.
We know the fix can be big and scattered. And we should be able to break the
big PR into smaller, more specific pieces so it can be easy to review for
developers. I will check with Tao later for a better proposal.
> Test Cases fail on Windows
> --------------------------
>
> Key: SPARK-14914
> URL: https://issues.apache.org/jira/browse/SPARK-14914
> Project: Spark
> Issue Type: Test
> Reporter: Tao LI
>
> There are lots of test failure on windows. Mainly for the following reasons:
> 1. resources (e.g., temp files) haven't been properly closed after using,
> thus IOException raised while deleting the temp directory.
> 2. Command line too long on windows.
> 3. File path problems caused by the drive label and back slash on absolute
> windows path.
> 4. Simply java bug on windows
> a. setReadable doesn't work on windows for directories.
> b. setWritable doesn't work on windows
> c. Memory-mapped file can't be read at the same time.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
