SparksFyz edited a comment on pull request #35608:
URL: https://github.com/apache/spark/pull/35608#issuecomment-1062841092


   ```
   if (overwrite && !insertCommand.dynamicPartitionOverwrite) {
         DDLUtils.verifyNotReadPath(actualQuery, outputPath)
   }
   ```
   DynamicPartitionOverwrite does not delete data before job begin, so it will 
not encountered verify problem.
   
   Since we use directly outputCommitter to write files. For the case `Insert 
overwrite static partition from data read from same table's partition`, we just 
tune `insertCommand.dynamicPartitionOverwrite` to true to avoid delete 
partition data before read.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to