[jira] [Commented] (SPARK-18905) Potential Issue of Semantics of BatchCompleted

[ https://issues.apache.org/jira/browse/SPARK-18905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266655#comment-16266655 ] Apache Spark commented on SPARK-18905: -- User 'victor-wong' has created a pull request for this

[jira] [Commented] (SPARK-18905) Potential Issue of Semantics of BatchCompleted

[ https://issues.apache.org/jira/browse/SPARK-18905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816646#comment-15816646 ] Apache Spark commented on SPARK-18905: -- User 'CodingCat' has created a pull request for this issue:

[jira] [Commented] (SPARK-18905) Potential Issue of Semantics of BatchCompleted

[ https://issues.apache.org/jira/browse/SPARK-18905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815815#comment-15815815 ] Shixiong Zhu commented on SPARK-18905: -- Sure. Please go ahead. > Potential Issue of Semantics of

[jira] [Commented] (SPARK-18905) Potential Issue of Semantics of BatchCompleted

[ https://issues.apache.org/jira/browse/SPARK-18905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813632#comment-15813632 ] Nan Zhu commented on SPARK-18905: - [~zsxwing] If you agree on the conclusion above, I will file a PR >

[jira] [Commented] (SPARK-18905) Potential Issue of Semantics of BatchCompleted

[ https://issues.apache.org/jira/browse/SPARK-18905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813560#comment-15813560 ] Nan Zhu commented on SPARK-18905: - eat my words... when we have queued up batches, we do need

[jira] [Commented] (SPARK-18905) Potential Issue of Semantics of BatchCompleted

[ https://issues.apache.org/jira/browse/SPARK-18905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813459#comment-15813459 ] Nan Zhu commented on SPARK-18905: - yeah, but the downTime including all batches from "checkpoint time" to

[jira] [Commented] (SPARK-18905) Potential Issue of Semantics of BatchCompleted

[ https://issues.apache.org/jira/browse/SPARK-18905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813455#comment-15813455 ] Shixiong Zhu commented on SPARK-18905: -- [~CodingCat] I think `pendingTime` is the jobs that have

[jira] [Commented] (SPARK-18905) Potential Issue of Semantics of BatchCompleted

[ https://issues.apache.org/jira/browse/SPARK-18905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813434#comment-15813434 ] Nan Zhu commented on SPARK-18905: - Hi, [~zsxwing] Thanks for the reply, After testing in our

[jira] [Commented] (SPARK-18905) Potential Issue of Semantics of BatchCompleted

[ https://issues.apache.org/jira/browse/SPARK-18905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813405#comment-15813405 ] Shixiong Zhu commented on SPARK-18905: -- Sorry for the late reply. Yeah, good catch. However, even if