wangshuo128 commented on pull request #30901: URL: https://github.com/apache/spark/pull/30901#issuecomment-749975050
AFAIK, when `spark.sql.sources.partitionOverwriteMode` is set to `DYNAMIC`, Spark will replace partitions in runtime, instead of deleting relevant partitions paths ahead. So we can use `DYNAMIC` overwrite mode if we overwrite a static partition. Gentle ping @cloud-fan @viirya, would help to review this? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
