[
https://issues.apache.org/jira/browse/HDFS-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405664#comment-16405664
]
Virajith Jalaparti edited comment on HDFS-13283 at 3/20/18 1:00 AM:
--------------------------------------------------------------------
[~lukmajercak] -- I think we need better documentation for this. In
hdfs-default.xml
bq. The basic calculators are Absolute, Percentage, Conservative and Aggressive.
This should be ReservedSpaceCalculatorAbsolute,
ReservedSpaceCalculatorPercentage, etc. Including a reference to this JIRA will
be useful (would be good to change the description from using the Enums to the
classes that can be configured).
Also, adding a note that the "dfs.datanode.du.reserved.pct" parameter will be
used by these calculators will be helpful.
Once this is fixed, I am +1 on the patch.
was (Author: virajith):
[~lukmajercak] -- I think we need better documentation for this. In
hdfs-default.xml
bq. The basic calculators are Absolute, Percentage, Conservative and Aggressive.
I think this should be ReservedSpaceCalculatorAbsolute,
ReservedSpaceCalculatorPercentage, etc. Including a reference to this JIRA will
be useful (would be good to change the description from using the Enums to the
classes that can be configured).
Also, adding a note that the "dfs.datanode.du.reserved.pct" parameter will be
used by these calculators will be helpful.
Once this is fixed, I am +1 on the patch.
> Percentage based Reserved Space Calculation for DataNode
> --------------------------------------------------------
>
> Key: HDFS-13283
> URL: https://issues.apache.org/jira/browse/HDFS-13283
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: datanode, hdfs
> Reporter: Lukas Majercak
> Assignee: Lukas Majercak
> Priority: Major
> Attachments: HDFS-13283.000.patch, HDFS-13283.001.patch,
> HDFS-13283.002.patch, HDFS-13283.003.patch
>
>
> Currently, the only way to configure reserved disk space for non-HDFS data on
> a DataNode is a constant value via {{dfs.datanode.du.reserved}}. This can be
> an issue in non-heterogeneous clusters where size of DNs can differ. The
> proposed solution is to allow percentage based configuration (and their
> combination):
> # ABSOLUTE
> ** based on absolute number of reserved space
> # PERCENTAGE
> ** based on percentage of total capacity in the storage
> # CONSERVATIVE
> ** calculates both of the above and takes the one that will yield more
> reserved space
> # AGGRESSIVE
> ** calculates 1. 2. and takes the one that will yield less reserved space
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
