[ https://issues.apache.org/jira/browse/SPARK-17945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15578064#comment-15578064 ]
Jeff Schobelock commented on SPARK-17945: ----------------------------------------- That's true enough. The use case on my end is that we use s3 object Metadata to get things like file delimiters, etc when we process files. > Writing to S3 should allow setting object metadata > -------------------------------------------------- > > Key: SPARK-17945 > URL: https://issues.apache.org/jira/browse/SPARK-17945 > Project: Spark > Issue Type: New Feature > Components: Spark Core > Affects Versions: 2.0.1 > Reporter: Jeff Schobelock > Priority: Minor > > I can't find any possible way to use Spark to write to S3 and set user object > metadata. This seems like such a simple thing that I feel I must be missing > somewhere how to do it....but I have yet to find anything. > I don't know what all work adding this would entail. My idea would be that > there is something like: > rdd.saveAsTextFile(s3://testbucket/file).withMetadata(Map<String,String> > data). -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org