Github user nchammas commented on the issue:

    https://github.com/apache/spark/pull/12004
  
    As a dumb end-user, and as the maintainer of 
[Flintrock](https://github.com/nchammas/flintrock), my interest in this PR 
stems from the hope that we will be able to get builds of Spark against the 
latest version of Hadoop that can interact with S3 out of the box.
    
    Because Spark builds against Hadoop 2.6 and 2.7 don't have that support, 
many Flintrock users [opt to use Spark built against Hadoop 
2.4](https://github.com/nchammas/flintrock/issues/88) since S3 support was 
still bundled in with those versions. Many users don't know that they can get 
S3 support at runtime with the right call to `--packages`.
    
    Given that Spark and S3 are very commonly used together, I hope there is 
some way we can address the out-of-the-box use case here.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to