[
https://issues.apache.org/jira/browse/HDDS-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mingchao zhao updated HDDS-3286:
--------------------------------
Description:
Currently delete file is to get all the keys in the directory, and then
delete one by one. And the same with rename. This makes for poor performance.
By tested the deletion path with 100,000 files, which took 3718.70 sec. And
rename it took 7327.936.
We plan to change this part to a batch operation to improve performance.
was:
Currently delete file is to get all the keys in the directory, and then delete
one by one. This makes for poor performance. By tested the deletion path with
100,000 files, which took 7320.964 sec.
We plan to change this part to a batch operation to improve performance.
> Support batchDelete and batchRename when use BasicOzoneFileSystem
> -----------------------------------------------------------------
>
> Key: HDDS-3286
> URL: https://issues.apache.org/jira/browse/HDDS-3286
> Project: Hadoop Distributed Data Store
> Issue Type: Improvement
> Components: Ozone Filesystem
> Reporter: mingchao zhao
> Priority: Major
>
> Currently delete file is to get all the keys in the directory, and then
> delete one by one. And the same with rename. This makes for poor performance.
> By tested the deletion path with 100,000 files, which took 3718.70 sec.
> And rename it took 7327.936.
> We plan to change this part to a batch operation to improve performance.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
