[jira] [Commented] (SPARK-29995) Structured Streaming file-sink log grow indefinitely

2020-02-25 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045009#comment-17045009 ] Jungtaek Lim commented on SPARK-29995: -- [~zhangliming] Hi, if you're open to try out something on

[jira] [Commented] (SPARK-29995) Structured Streaming file-sink log grow indefinitely

2019-11-25 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16981406#comment-16981406 ] Jungtaek Lim commented on SPARK-29995: -- The thing is, "exactly-once" on file stream sink is

[jira] [Commented] (SPARK-29995) Structured Streaming file-sink log grow indefinitely

2019-11-22 Thread zhang liming (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979997#comment-16979997 ] zhang liming commented on SPARK-29995: -- May I delete the previous contents of the latest .compact

[jira] [Commented] (SPARK-29995) Structured Streaming file-sink log grow indefinitely

2019-11-21 Thread zhang liming (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979888#comment-16979888 ] zhang liming commented on SPARK-29995: -- Ok,thanks for your reply. > Structured Streaming file-sink

[jira] [Commented] (SPARK-29995) Structured Streaming file-sink log grow indefinitely

2019-11-21 Thread zhang liming (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979886#comment-16979886 ] zhang liming commented on SPARK-29995: -- 好的,谢谢你的回复 > Structured Streaming file-sink log grow

[jira] [Commented] (SPARK-29995) Structured Streaming file-sink log grow indefinitely

2019-11-21 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979870#comment-16979870 ] Jungtaek Lim commented on SPARK-29995: -- Btw, SPARK-27188 is the approach to solve this issue what I

[jira] [Commented] (SPARK-29995) Structured Streaming file-sink log grow indefinitely

2019-11-21 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979869#comment-16979869 ] Jungtaek Lim commented on SPARK-29995: -- Removing myself in Shepherd - that's mostly used for SPIP