[jira] [Commented] (SPARK-27330) ForeachWriter is not being closed once a batch is aborted

2019-08-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914321#comment-16914321 ] Dongjoon Hyun commented on SPARK-27330: --- Thank you, [~eyalzit]. You are added to the Apache Spark

[jira] [Commented] (SPARK-27330) ForeachWriter is not being closed once a batch is aborted

2019-04-16 Thread Eyal Zituny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819054#comment-16819054 ] Eyal Zituny commented on SPARK-27330: - [~gsomogyi] i've submitted a PR > ForeachWriter is not being

[jira] [Commented] (SPARK-27330) ForeachWriter is not being closed once a batch is aborted

2019-04-15 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16817926#comment-16817926 ] Gabor Somogyi commented on SPARK-27330: --- Cool, ping me if you need review... > ForeachWriter is

[jira] [Commented] (SPARK-27330) ForeachWriter is not being closed once a batch is aborted

2019-04-15 Thread Eyal Zituny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16817918#comment-16817918 ] Eyal Zituny commented on SPARK-27330: - [~gsomogyi] yes, almost done with it > ForeachWriter is not

[jira] [Commented] (SPARK-27330) ForeachWriter is not being closed once a batch is aborted

2019-04-15 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16817902#comment-16817902 ] Gabor Somogyi commented on SPARK-27330: --- [~eyalzit] are you working on this? Happy to file a PR if

[jira] [Commented] (SPARK-27330) ForeachWriter is not being closed once a batch is aborted

2019-04-01 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807316#comment-16807316 ] Hyukjin Kwon commented on SPARK-27330: -- (I think {{close()}} should be idempotent and documented as

[jira] [Commented] (SPARK-27330) ForeachWriter is not being closed once a batch is aborted

2019-04-01 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806659#comment-16806659 ] Gabor Somogyi commented on SPARK-27330: --- Now I see the point and makes sense from my perspective.

[jira] [Commented] (SPARK-27330) ForeachWriter is not being closed once a batch is aborted

2019-04-01 Thread Eyal Zituny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806654#comment-16806654 ] Eyal Zituny commented on SPARK-27330: - I have updated the description, eventually i have tasks which

[jira] [Commented] (SPARK-27330) ForeachWriter is not being closed once a batch is aborted

2019-04-01 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806638#comment-16806638 ] Gabor Somogyi commented on SPARK-27330: --- If processing throws any kind of exception then

[jira] [Commented] (SPARK-27330) ForeachWriter is not being closed once a batch is aborted

2019-03-31 Thread Eyal Zituny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806086#comment-16806086 ] Eyal Zituny commented on SPARK-27330: - guys, let me know if my fix suggestion is make sense and i