Implement Background deletion
-----------------------------
Key: HDFS-1143
URL: https://issues.apache.org/jira/browse/HDFS-1143
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Dmytro Molkov
Assignee: Scott Chen
Right now if you try to delete massive number of files from the namenode it
will freeze (sometimes for minutes). Most of the time is spent going through
the blocks map and invalidating all the blocks.
This can probably be improved by having a background GC process. The deletion
will basically just remove the inode being deleted and then give the subtree
that was just deleted to the background thread running cleanup.
This way the namenode becomes available for the clients soon after deletion,
and all the heavy operations are done in the background.
Thoughts?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
