[
https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated SPARK-7481:
----------------------------------
Description:
To keep the s3n classpath right, to add s3a, swift & azure, the dependencies of
spark in a 2.6+ profile need to add the relevant object store packages
(hadoop-aws, hadoop-openstack, hadoop-azure)
was:
To keep the s3n classpath right, to add s3a, swift & azure, the dependencies of
spark in a 2.6+ profile need to add the relevant object store packages
(hadoop-aws, hadoop-openstack, hadoop-azure)
this adds more stuff to the client bundle, but will mean a single spark package
can talk to all of the stores.
Summary: Add spark-cloud module to pull in object store support (was:
Add spark-cloud module to pull in object store support; test)
> Add spark-cloud module to pull in object store support
> ------------------------------------------------------
>
> Key: SPARK-7481
> URL: https://issues.apache.org/jira/browse/SPARK-7481
> Project: Spark
> Issue Type: Improvement
> Components: Build
> Affects Versions: 1.3.1
> Reporter: Steve Loughran
>
> To keep the s3n classpath right, to add s3a, swift & azure, the dependencies
> of spark in a 2.6+ profile need to add the relevant object store packages
> (hadoop-aws, hadoop-openstack, hadoop-azure)
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
