[
https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056843#comment-14056843
]
Tathagata Das commented on SPARK-2345:
--------------------------------------
Doesnt the following solve the problem
dstream.foreachRDD((rdd: RDD[T], time: Time) => {
rdd.foreachPartition(...)
}
This does require you call sparkContext, and just deal with the RDD directly.
If there is sufficient requirement, then it may definitely be worth adding a
function DStream.foreachRDDPartition(...)
> ForEachDStream should have an option of running the foreachfunc on Spark
> ------------------------------------------------------------------------
>
> Key: SPARK-2345
> URL: https://issues.apache.org/jira/browse/SPARK-2345
> Project: Spark
> Issue Type: Bug
> Components: Streaming
> Reporter: Hari Shreedharan
>
> Today the Job generated simply calls the foreachfunc, but does not run it on
> spark itself using the sparkContext.runJob method.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
