[
https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14057954#comment-14057954
]
Hari Shreedharan commented on SPARK-2345:
-----------------------------------------
If I have to write the data out as say Avro or any other format, there is no
easy way to do this. saveAsHadoop currently does only Sequence Files AFAIK.
Adding support for a a dstream that can run the function on executors without
the implementor worrying about it would enable this.
> ForEachDStream should have an option of running the foreachfunc on Spark
> ------------------------------------------------------------------------
>
> Key: SPARK-2345
> URL: https://issues.apache.org/jira/browse/SPARK-2345
> Project: Spark
> Issue Type: Bug
> Components: Streaming
> Reporter: Hari Shreedharan
>
> Today the Job generated simply calls the foreachfunc, but does not run it on
> spark itself using the sparkContext.runJob method.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
