GitHub user JoshRosen opened a pull request:
https://github.com/apache/spark/pull/9503
[SPARK-9818] Re-enable Docker tests for JDBC data source
This patch re-enables tests for the Docker JDBC data source. These tests
were reverted in #4872 due to transitive dependency conflicts introduced by the
`docker-client` library. This patch should avoid those problems by using a
version of `docker-client` which shades its transitive dependencies.
In addition, I significantly refactored the tests to simplify the setup and
teardown code and to fix several Docker networking issues which caused problems
when running in `boot2docker`.
Closes #8101.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/JoshRosen/spark docker-jdbc-tests
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/9503.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #9503
----
commit 4b82a2cb92722c27fa958412f578f5e659319de0
Author: Yijie Shen <[email protected]>
Date: 2015-08-11T07:00:23Z
Import yjshen's PR.
commit eddcc470c91ec3c32d7fa7657786de53cec0324d
Author: Josh Rosen <[email protected]>
Date: 2015-10-19T01:02:57Z
Use newer shaded docker-client artifact
commit 8bb62ea45dc9dd88c167f9ba930d0319ec72ddcc
Author: Josh Rosen <[email protected]>
Date: 2015-10-19T01:24:14Z
Use map for setting environment variables.
commit 23443a5f708518e9df678b6dd1a14d732d44b872
Author: Josh Rosen <[email protected]>
Date: 2015-10-19T01:24:40Z
Ensure that Docker container is cleaned up after error.
commit e6c7709cfde47c87f995b7e55786c59360039bf7
Author: Josh Rosen <[email protected]>
Date: 2015-11-05T19:48:20Z
Remove a bunch of layers of indirection / abstraction.
commit d06847bf4b6b893a5a49bde56ca5e0441eac80d2
Author: Josh Rosen <[email protected]>
Date: 2015-11-05T20:20:15Z
Fix networking for boot2docker.
commit 93bcf453e957619ae2195a43e4dcf4f56a937b68
Author: Josh Rosen <[email protected]>
Date: 2015-11-05T20:22:35Z
Log warning in case container cleanup fails
commit bf98ae00cc19d019dc2ca654119b4ad4b75e4bd9
Author: Josh Rosen <[email protected]>
Date: 2015-11-05T20:26:41Z
Rename class and freeze image versions
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
