YuzhouSun edited a comment on pull request #32207:
URL: https://github.com/apache/spark/pull/32207#issuecomment-840224412
Hello, about “we should only run Block 2 in the dynamicPartitionOverwrite ==
false case”: the Block 2 is actually meant for custom partition paths (i.e.
absolute partitions), in both dynamic partition overwrite or static partition
overwrite cases. That’s probably the reason why InsertSuite.test("SPARK-20236:
dynamic partition overwrite with custom partition path") failed with the
changes.
The fix could be re-creating the parent directories when required. We
created another PR for this jira.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
