[
https://issues.apache.org/jira/browse/HADOOP-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12620086#action_12620086
]
Robert Chansler commented on HADOOP-2816:
-----------------------------------------
Consensus recommendation from M, K, A, H, S, R:
Allocation and management algorithms will not change, but reporting on the Name
Node home page should be modified:
In the node table, four statistics will be reported:
"Configured Capacity" is the sum over all volumes V named in
config:dfs.data.dir that exist of (df.Size V - config:dfs.datanode.du.reserved)
"Present Capacity" is df.Size V - MAX{df.Used V - [space used to store
block and metadata files], config:dfs.datanode.du.reserved)
"Used (%)" is the ratio of [space used to store block and metadata files]
and Present Capacity (the little gauge reflects this value)
"Remaining" is the difference Present Capacity - [space used to store block
and metadata files]
The "cluster summary" will report 5 statistics:
"Configured Capacity" is the sum over all data nodes D of
d.ConfiguredCapacity
"Present Capacity" is the sum over all data nodes of D of D.PresentCapacity
"Used" is the sum over all data nodes of D of D.[space used to store block
and metadata files]
"Remaining" is the difference Present Capacity - Used
"Used %" is the ratio of Used to Present Capacity
A key will explain these calculations for the user.
> Cluster summary at name node web has confusing report for space utilization
> ---------------------------------------------------------------------------
>
> Key: HADOOP-2816
> URL: https://issues.apache.org/jira/browse/HADOOP-2816
> Project: Hadoop Core
> Issue Type: Improvement
> Components: dfs
> Affects Versions: 0.15.3
> Reporter: Robert Chansler
>
> In one example:
> Cluster Summary
> Capacity : 1.15 PB
> DFS Remaining : 192 TB
> DFS Used : 717 TB
> DFS Used% : 62 %
> Why is Capacity not equal Used plus Remaining?
> (The answer is that there is an estimated reserve for local files.)
> The presentation should be easily understood by the user.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
