Kihwal Lee created HDFS-5070:
--------------------------------
Summary: Do not initialize the replications queues in the middle
of block report processing
Key: HDFS-5070
URL: https://issues.apache.org/jira/browse/HDFS-5070
Project: Hadoop HDFS
Issue Type: Bug
Components: namenode
Affects Versions: 0.23.9, 2.1.0-beta
Reporter: Kihwal Lee
While processing an initial block report in the start-up safe mode, namenode
can reach the safe block threshold in the middle of processing the report. This
is noticed when checkMode() is called and it causes the replication queues to
be initialized.
The safe mode monitor will try to check and leave the safe mode, but can be far
behind the write lock, if the initialization takes long (e.g. large number of
blocks) and more block reports come in and get queued before it. In this state
(replication queue initialized but still in startup safe mode), block report
processing can take a long time. In one instance, 4 block report processing
took 13 minutes.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira