Tagar commented on pull request #29387: URL: https://github.com/apache/spark/pull/29387#issuecomment-681078916
@Udbhav30 generally, one user can have multiple trash directories. The default one `fs.getHomeDirectory() + ".Trash"` as you mentioned, and there could be multiple non-default ones - one per [encryption zone](https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html#:~:text=An%20encryption%20zone%20is%20a,when%20the%20zone%20is%20created.). So each encryption zone's trash directory is encrypted with the same key and files can be moved to trash without reencryption. For GDPR/ CCPA use cases we had some tables with PII created in an HDFS encryption zone and those couldn't use default trash location. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
