Udbhav30 commented on pull request #29319: URL: https://github.com/apache/spark/pull/29319#issuecomment-667125399
> > Instead of directly deleting the data, we can provide flexibility to move data to the trash and then delete it permanently. > > hm, we need to move data into a trash even though users intend to OVERWRITE it with this command? Probably, you need to describe more about what's a benefit for users. A similar jira was raised for truncate table also SPARK-32481, I think it is just to be safe to first move it to trash first and it also provides the flexibility to user if they want to refer the deleted data. To not force this implementation I have added a configuration also to disable this. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
