Walter Su created HDFS-7784:
-------------------------------
Summary: load fsimage in parallel
Key: HDFS-7784
URL: https://issues.apache.org/jira/browse/HDFS-7784
Project: Hadoop HDFS
Issue Type: Improvement
Components: namenode
Reporter: Walter Su
When single Namenode has huge amount of files, without using federation, the
startup/restart speed is slow. The fsimage loading step takes the most of the
time. fsimage loading can seperate to two parts, deserialization and object
construction(mostly map insertion). Deserialization takes the most of CPU time.
So we can do deserialization in parallel, and add to hashmap in parallel. It
will significantly reduce the NN start time.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
