rezasafi commented on issue #26159: [SPARK-29506][SQL] Use dynamicPartitionOverwrite in FileCommitProtocol when insert into hive table URL: https://github.com/apache/spark/pull/26159#issuecomment-547554077 > @rezasafi thanks for referring that. Is it specified to enabling dynamicPartitionOverwrite? As the task id was fixed in setupJob, I think it is also happened without this patch? Hi @viirya, yeah that issue happens when dynamicPartitionOverwrite is enabled. It seems that after your fix is merged if people there would be more cases that hit SPARK-27194. So was just wondering whether it is better to fix that first before suggesting to use it in more scenarios. I haven't looked at @turboFei fix.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
