GitHub user gilv opened a pull request:
https://github.com/apache/spark/pull/1010
SPARK-938 - Openstack Swift object storage support
This is very initial commit to initiate discussion about Spark and
OpenStack Swift integration.
At this point I provided information how to setup standalone Spark cluster
and connect it to Swift using Hadoop 2.3.0. Current patch can be used by all to
experiment integration between Swift and Spark.
I am working to extend this patch and future patches will contain
information how to configure Spark with previous Hadoop versions and how to
configure Swift for other cluster deployment of Spark.
Will glad to hear all remarks / suggestion / comments from the community.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gilv/spark master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/1010.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1010
----
commit b6c37ef5a28dfa0ed07f6ab8f154fcd43a2131af
Author: Gil Vernik <[email protected]>
Date: 2014-06-08T07:23:41Z
Openstack Swift support
commit ce483d76a1d524800859764b967c8b5a98fbd9ea
Author: Gil Vernik <[email protected]>
Date: 2014-06-08T07:34:04Z
SPARK-938 - Openstack Swift object storage support
This is initial documentation describing how to integrate Spark with
Swift. This commit contains documentation for stand alone cluster.
Next patches will contain details how to integrate Swift in other
deployment of Spark.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
