[
https://issues.apache.org/jira/browse/HDFS-15185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040562#comment-17040562
]
Konstantin Shvachko commented on HDFS-15185:
--------------------------------------------
HDFS-14500 tried to fix it, but it is still happening. Most of the excessive
segments look like this:
{code}
ByteStringEditLog[406685107236, 406685108346] 203.99 KB (0/1111) 100%
ByteStringEditLog[406685108347, 406685110031] 348.07 KB (0/1685) 100%
ByteStringEditLog[406685110032, 406685111308] 277.39 KB (0/1277) 100%
ByteStringEditLog[406685111309, 406685112369] 239.67 KB (0/1061) 100%
ByteStringEditLog[406685112370, 406685113032] 129.18 KB (0/663) 100%
{code}
> StartupProgress reports edits segments until the entire startup completes
> -------------------------------------------------------------------------
>
> Key: HDFS-15185
> URL: https://issues.apache.org/jira/browse/HDFS-15185
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: namenode
> Affects Versions: 2.10.0
> Reporter: Konstantin Shvachko
> Assignee: Konstantin Shvachko
> Priority: Major
>
> Startup Progress page keeps reporting edits segments after the {{LOAD_EDITS}}
> stage is complete. New steps are added to StartupProgress while journal
> tailing until all startup phases are completed. This adds a lot of edits
> steps, since {{SAFEMODE}} phase can take a long time on a large cluster.
> With fast tailing the segments are small, but the number of them is large -
> 160K. This makes the page load forever.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
