[
https://issues.apache.org/jira/browse/YARN-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14909043#comment-14909043
]
zhihai xu commented on YARN-3943:
---------------------------------
I attached a new patch YARN-3943.001.patch for review. The new patch will keep
backward compatibility by using the old configuration
"yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage"
as high water mark threshold for disk-full detection and creating a new
configuration
"yarn.nodemanager.disk-health-checker.disk-utilization-watermark-low-per-disk-percentage"
as low water mark threshold for disk-not-full detection. It also makes both
configurations use same default value and if low water mark threshold is more
than high water mark threshold, it will be set to the same value as high water
mark threshold.
> Use separate threshold configurations for disk-full detection and
> disk-not-full detection.
> ------------------------------------------------------------------------------------------
>
> Key: YARN-3943
> URL: https://issues.apache.org/jira/browse/YARN-3943
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: nodemanager
> Reporter: zhihai xu
> Assignee: zhihai xu
> Priority: Critical
> Attachments: YARN-3943.000.patch, YARN-3943.001.patch
>
>
> Use separate threshold configurations to check when disks become full and
> when disks become good. Currently the configuration
> "yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage"
> and "yarn.nodemanager.disk-health-checker.min-free-space-per-disk-mb" are
> used to check both when disks become full and when disks become good. It will
> be better to use two configurations: one is used when disks become full from
> not-full and the other one is used when disks become not-full from full. So
> we can avoid oscillating frequently.
> For example: we can set the one for disk-full detection higher than the one
> for disk-not-full detection.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
