GitHub user mateiz opened a pull request:
https://github.com/apache/spark/pull/819
[SPARK-1876] Windows fixes to deal with latest distribution layout changes
- Look for JARs in the right place
- Launch examples the same way as on Unix
- Load datanucleus JARs if they exist
- Don't attempt to parse local paths as URIs in SparkSubmit, since paths
with C:\ are not valid URIs
- Also fixed POM exclusion rules for datanucleus (it wasn't properly
excluding it, whereas SBT was)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mateiz/spark win-fixes
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/819.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #819
----
commit 144af84f727cb11befc11723152e65e5e84cbb16
Author: Matei Zaharia <[email protected]>
Date: 2014-05-18T23:44:26Z
Update Windows scripts to match latest binary package layout
Also fixed an issues where SparkSubmit was trying to parse local files
as URLs, which fails on Windows because they contain backslashes. We
didn't need to treat those as URLs to check if a file exists.
commit d3b71c7611e5d52519fecb4e9268b0ec362ad65d
Author: Matei Zaharia <[email protected]>
Date: 2014-05-19T00:16:40Z
Properly exclude datanucleus files in Maven assembly
They are excluded in SBT, but the rule added in Maven didn't actually
remove the files from the JAR. The JARs built still worked despite this,
but it's better to remove them than have 2 copies on the classpath.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
