[
https://issues.apache.org/jira/browse/HDFS-15185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040576#comment-17040576
]
Konstantin Shvachko commented on HDFS-15185:
--------------------------------------------
New segments are added via {{StartupProgress.setTotal()}}, which adds steps
even though the phase is complete. {{setTotal()}} is called in
{{FSEditLogLoader.loadEditRecords()}} while tailing edits through
{{EditLogTailer.doTailEdits()}} after the {{LOADING_EDITS}} phase ended.
> StartupProgress reports edits segments until the entire startup completes
> -------------------------------------------------------------------------
>
> Key: HDFS-15185
> URL: https://issues.apache.org/jira/browse/HDFS-15185
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: namenode
> Affects Versions: 2.10.0
> Reporter: Konstantin Shvachko
> Assignee: Konstantin Shvachko
> Priority: Major
> Attachments: HDFS-15185.001.patch
>
>
> Startup Progress page keeps reporting edits segments after the {{LOAD_EDITS}}
> stage is complete. New steps are added to StartupProgress while journal
> tailing until all startup phases are completed. This adds a lot of edits
> steps, since {{SAFEMODE}} phase can take a long time on a large cluster.
> With fast tailing the segments are small, but the number of them is large -
> 160K. This makes the page load forever.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
