[
https://issues.apache.org/jira/browse/IMPALA-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joe McDonnell reassigned IMPALA-12389:
--------------------------------------
Assignee: Joe McDonnell
> Use -skipTrash for hdfs_util.py's HadoopFsCommandLineClient::delete_file_dir
> ----------------------------------------------------------------------------
>
> Key: IMPALA-12389
> URL: https://issues.apache.org/jira/browse/IMPALA-12389
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 4.3.0
> Reporter: Joe McDonnell
> Assignee: Joe McDonnell
> Priority: Major
>
> When tests use unique databases, there is some logic to clean up the database
> directory when the test is done. This logic uses delete_file_dir. On some
> filesystem types like S3, this is implemented with HadoopFsCommandLineClient.
> {noformat}
> def delete_file_dir(self, path, recursive=False):
> """Delete the file or directory given by the specified path. Recursive
> must be true
> for directories."""
> rm_command = ['-rm', path]
> if recursive:
> rm_command = ['-rm', '-r', path]
> (status, stdout, stderr) = self._hadoop_fs_shell(rm_command)
> return status == 0{noformat}
> We should change this to add "-skipTrash" to avoid accumulating files in the
> trash directory. This is particularly important for S3, because the trash
> directory is currently not cleaned up by
> bin/jenkins/release_cloud_resources.sh.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
