[jira] [Commented] (SPARK-44884) Spark doesn't create SUCCESS file in Spark 3.3.0+ when partitionOverwriteMode is dynamic

2023-08-31 Thread Igor Dvorzhak (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760977#comment-17760977 ] Igor Dvorzhak commented on SPARK-44884: --- Is this a duplicate of the

[jira] [Commented] (SPARK-44884) Spark doesn't create SUCCESS file in Spark 3.3.0+ when partitionOverwriteMode is dynamic

2023-08-25 Thread Dipayan Dev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759065#comment-17759065 ] Dipayan Dev commented on SPARK-44884: - Right, the behaviour is same in Spark 2 and 3. However, in

[jira] [Commented] (SPARK-44884) Spark doesn't create SUCCESS file in Spark 3.3.0+ when partitionOverwriteMode is dynamic

2023-08-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759063#comment-17759063 ] Steve Loughran commented on SPARK-44884: so using insert overwrite. yes, what happens there is

[jira] [Commented] (SPARK-44884) Spark doesn't create SUCCESS file in Spark 3.3.0+ when partitionOverwriteMode is dynamic

2023-08-25 Thread Dipayan Dev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758879#comment-17758879 ] Dipayan Dev commented on SPARK-44884: - I am able to narrow down the problem. This issue is happening