[
https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982587#comment-15982587
]
Steven Rand commented on SPARK-7481:
------------------------------------
What happened to https://github.com/apache/spark/pull/12004? It doesn't look
like there were any concrete objections to the changes made there -- was it
just closed for lack of a reviewer?
As someone who has spent several tens of hours (and counting!) debugging
classpath issues for Spark applications that read from and write to an object
store, I think this change is hugely valuable. I suspect that the large number
of votes and watchers indicates that others think this as well, so it'd be
pretty depressing if it didn't happen just because no one will review the
patch. Unfortunately I'm not qualified to review it myself, but I'd be quite
grateful if someone more competent were to do so.
> Add spark-hadoop-cloud module to pull in object store support
> -------------------------------------------------------------
>
> Key: SPARK-7481
> URL: https://issues.apache.org/jira/browse/SPARK-7481
> Project: Spark
> Issue Type: Improvement
> Components: Build
> Affects Versions: 2.1.0
> Reporter: Steve Loughran
>
> To keep the s3n classpath right, to add s3a, swift & azure, the dependencies
> of spark in a 2.6+ profile need to add the relevant object store packages
> (hadoop-aws, hadoop-openstack, hadoop-azure)
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
