[GitHub] spark issue #16980: [SPARK-19617][SS]fix structured streaming restart bug

Github user gf53520 commented on the issue: https://github.com/apache/spark/pull/16980 @zsxwing okay, I will submit a PR to fix it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16980: [SPARK-19617][SS]fix structured streaming restart bug

Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16980 Good catch. Could you submit a follow up PR to fix it? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #16980: [SPARK-19617][SS]fix structured streaming restart bug

Github user gf53520 commented on the issue: https://github.com/apache/spark/pull/16980 @zsxwing no problem, But I think that PR exists an small problem that a tmp file of delta file is still reserved in hdfs. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #16980: [SPARK-19617][SS]fix structured streaming restart bug

Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16980 @gf53520 SPARK-19617 is a different issue. I guess you meant SPARK-19645. Thanks a lot for doing this. However, I merged #17012 as the approach is better and it has a unit test to cover this issue.

[GitHub] spark issue #16980: [SPARK-19617][SS]fix structured streaming restart bug

Github user gf53520 commented on the issue: https://github.com/apache/spark/pull/16980 @uncleGen The JIRA ID is 19617. But JIRA 19677 is same problem with this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #16980: [SPARK-19617][SS]fix structured streaming restart bug

Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/16980 The JIRA ID is not SPARK-19645? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16980: [SPARK-19617][SS]fix structured streaming restart bug

Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/16980 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16980: [SPARK-19617][SS]fix structured streaming restart bug

Github user gf53520 commented on the issue: https://github.com/apache/spark/pull/16980 test this please" --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #16980: [SPARK-19617][SS]fix structured streaming restart bug

Github user gf53520 commented on the issue: https://github.com/apache/spark/pull/16980 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #16980: [SPARK-19617][SS]fix structured streaming restart bug

Github user gf53520 commented on the issue: https://github.com/apache/spark/pull/16980 cc @zsxwing --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #16980: [SPARK-19617][SS]fix structured streaming restart bug

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16980 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this