GitHub user JoshRosen opened a pull request:
https://github.com/apache/spark/pull/2165
[SPARK-3061] Fix Maven build under Windows
The Maven build was failing on Windows because it tried to call the unix
`unzip` utility to extract the Py4J files into core's build directory. I've
fixed this issue by using the `maven-antrun-plugin` to perform the unzipping.
I also fixed an issue that prevented tests from running under Windows:
In the Maven ScalaTest plugin, the filename listed in <filereports> is
placed under the <reportsDirectory>; the current code places it in a
subdirectory of reportsDirectory, e.g.
```
${project.build.directory}/surefire-reports/${project.build.directory}/SparkTestSuite.txt
```
This caused problems under Windows because it would try to create a
subdirectory named "c:\\".
Note that the tests still fail under Windows (for other reasons); this PR
just allows them to run and fail rather than crash when trying to create the
test reports directory.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/JoshRosen/spark windows-support
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/2165.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2165
----
commit 4994af1a168656f910a236a8b95dd02ae17b2e44
Author: Josh Rosen <[email protected]>
Date: 2014-08-26T00:10:51Z
[SPARK-3061] Use maven-antrun-plugin to unzip Py4J.
This fixes the Maven build on Windows.
commit e347668f5ae522b267966fd98a097eb9ca6e302a
Author: Josh Rosen <[email protected]>
Date: 2014-08-26T05:41:28Z
Fix Maven scalatest filereports path:
The filename listed in <filereports> is placed under the <reportsDirectory>;
the current code places it in a subdirectory of reportsDirectory, e.g.
${project.build.directory}/surefire-reports/${project.build.directory}/SparkTestSuite.txt
This caused problems under Windows because it would try to create
a subdirectory with a colon in its name.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
