[
https://issues.apache.org/jira/browse/SPARK-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321570#comment-14321570
]
Yanbo Liang commented on SPARK-5774:
------------------------------------
[~srowen]
Thank you for your replay. Your opinion is reasonable.
I have found that RDD.saveAsTextFile(path) will store the RDD in a directory
whose name is "path".
And the RDD is stored as part-***** like files that each file comes from each
partition of the RDD.
The directory represents the whole RDD.
> Support save RDD append to file
> -------------------------------
>
> Key: SPARK-5774
> URL: https://issues.apache.org/jira/browse/SPARK-5774
> Project: Spark
> Issue Type: New Feature
> Components: Spark Core
> Affects Versions: 1.3.0
> Reporter: Yanbo Liang
>
> Now RDD.saveAsTextFile only support writing to a file which is empty. In some
> cases, we need to save RDD append to an existing file. For example, when
> execute SQL command "INSERT INTO ...", we need to append the RDD to an
> existing file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
