[jira] [Updated] (SPARK-25639) Add documentation on foreachBatch, and multiple watermark policy

2018-10-28 Thread Xiao Li (JIRA)


 [ 
https://issues.apache.org/jira/browse/SPARK-25639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xiao Li updated SPARK-25639:

Fix Version/s: (was: 2.4.1)
   2.4.0

> Add documentation on foreachBatch, and multiple watermark policy
> 
>
> Key: SPARK-25639
> URL: https://issues.apache.org/jira/browse/SPARK-25639
> Project: Spark
>  Issue Type: Improvement
>  Components: Documentation
>Affects Versions: 2.4.0
>Reporter: Tathagata Das
>Assignee: Tathagata Das
>Priority: Blocker
> Fix For: 2.4.0
>
>
> Things to add
> - Python foreach
> - Scala, Java and Python foreachBatch
> - Multiple watermark policy
> - The semantics of what changes are allowed to the streaming between restarts.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-25639) Add documentation on foreachBatch, and multiple watermark policy

2018-10-06 Thread Sean Owen (JIRA)


 [ 
https://issues.apache.org/jira/browse/SPARK-25639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sean Owen updated SPARK-25639:
--
Priority: Blocker  (was: Major)

This appears to be something we need to get into 2.4.0 to go along with the 
functionality. Please update per PR comments

> Add documentation on foreachBatch, and multiple watermark policy
> 
>
> Key: SPARK-25639
> URL: https://issues.apache.org/jira/browse/SPARK-25639
> Project: Spark
>  Issue Type: Improvement
>  Components: Documentation
>Affects Versions: 2.4.0
>Reporter: Tathagata Das
>Priority: Blocker
>
> Things to add
> - Python foreach
> - Scala, Java and Python foreachBatch
> - Multiple watermark policy
> - The semantics of what changes are allowed to the streaming between restarts.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org