[
https://issues.apache.org/jira/browse/HADOOP-19390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sungdong Kim resolved HADOOP-19390.
-----------------------------------
Resolution: Duplicate
> Progress percentage grows discontinuous when fsimage loading
> ------------------------------------------------------------
>
> Key: HADOOP-19390
> URL: https://issues.apache.org/jira/browse/HADOOP-19390
> Project: Hadoop Common
> Issue Type: Improvement
> Affects Versions: 3.4.1
> Reporter: Sungdong Kim
> Priority: Minor
> Fix For: 3.5.0
>
>
> When the name node is restarted with dfs.image.parallel.load enabled, the
> progress percentage(at namenode web) is reflacted after each thread finished
> after fsimage loading.
> For example, if dfs.image.parallel.target.sections=12(default), the
> percentage increases by 0% -> 8.3% (1/12) -> 16.6% (2/12) ->.... -> 100%.
> This is because each thread uses a separate counter.
> According docs of org. apache. hadoop.hdfs.server.namenode.
> startupprogress.getCounter, the counter guarantees thread-safe, so it seems
> that each fimage loading thread can use the same counter.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
