[ 
https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177060#comment-15177060
 ] 

Arpit Agarwal edited comment on HDFS-9038 at 3/3/16 2:57 AM:
-------------------------------------------------------------

Hi [~brahmareddy], I am sorry this patch is stuck after all the effort you put 
into it.

There is a disagreement on the definition of non-DFS used space. Quoting 
[~cnauroth]:
bq. Essentially, it's a question of whether this metric means "Raw Non-DFS 
Used" or "Unplanned Non-DFS Used".

I don't see any harm in starting a discussion on hdfs-dev. I will think about 
this some more.


was (Author: arpitagarwal):
Hi [~brahmareddy], I am sorry this patch is stuck after all the effort you put 
into it.

There is a disagreement on what the definition of non-DFS used space. Quoting 
[~cnauroth]:
bq. Essentially, it's a question of whether this metric means "Raw Non-DFS 
Used" or "Unplanned Non-DFS Used".

I don't see any harm in starting a discussion on hdfs-dev. I will think about 
this some more.

> DFS reserved space is erroneously counted towards non-DFS used.
> ---------------------------------------------------------------
>
>                 Key: HDFS-9038
>                 URL: https://issues.apache.org/jira/browse/HDFS-9038
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode
>    Affects Versions: 2.7.1
>            Reporter: Chris Nauroth
>            Assignee: Brahma Reddy Battula
>         Attachments: GetFree.java, HDFS-9038-002.patch, HDFS-9038-003.patch, 
> HDFS-9038-004.patch, HDFS-9038-005.patch, HDFS-9038-006.patch, 
> HDFS-9038-007.patch, HDFS-9038.patch
>
>
> HDFS-5215 changed the DataNode volume available space calculation to consider 
> the reserved space held by the {{dfs.datanode.du.reserved}} configuration 
> property.  As a side effect, reserved space is now counted towards non-DFS 
> used.  I don't believe it was intentional to change the definition of non-DFS 
> used.  This issue proposes restoring the prior behavior: do not count 
> reserved space towards non-DFS used.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to