GitHub user brkyvz opened a pull request:
https://github.com/apache/spark/pull/5892
[SPARK-7224] mock repository generator for --packages tests without nio.Path
The previous PR for SPARK-7224 (#5790) broke JDK 6, because it used
java.nio.Path, which was in jdk 7, and not in 6. This PR uses Guava's `Files`
to handle directory creation, and etc...
The description from the previous PR:
> This patch contains an `IvyTestUtils` file, which dynamically generates
jars and pom files to test the `--packages` feature without having to rely on
the internet, and Maven Central.
cc @pwendell
I also rand the flaky test about 20 times locally, it didn't fail a single
time, but I think it may fail like once every 100 builds? I still haven't
figured the cause yet, but the test before it, `--jars` was also failing after
we turned off the `--packages` test in `SparkSubmitSuite`. It may be related to
the launch of SparkSubmit.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/brkyvz/spark maven-utils
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/5892.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #5892
----
commit 05cd0ded4e892368232ca60fec75464287492044
Author: Burak Yavuz <[email protected]>
Date: 2015-04-29T21:46:36Z
added mock repository generator
use Ivy format
address comments v0.1
addressed comments v0.2
new fix not using nio.Path
commit 22eea62f110fe53456866e45bb9c16cc978f05a9
Author: Burak Yavuz <[email protected]>
Date: 2015-05-04T18:14:07Z
Merge branch 'master' of github.com:apache/spark into maven-utils
commit 9ef1408910666e5b5aa6f99aed8ad5cd7509e251
Author: Burak Yavuz <[email protected]>
Date: 2015-05-04T18:14:45Z
re-enable --packages test
commit e632381b2cfcc77ea4b198d036463649c2a87c69
Author: Burak Yavuz <[email protected]>
Date: 2015-05-04T18:49:51Z
fix ignore
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
