[
https://issues.apache.org/jira/browse/HDFS-13092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376702#comment-17376702
]
Ahmed Hussein commented on HDFS-13092:
--------------------------------------
Hi [~msingh], thanks for providing the patch.
We observed the same behavior on our internal cluster running branch-2.10.
The frequency of triggering those checks is a little bit concerning. Do you
have a clue what would trigger the check on a single volume that frequently?
> Reduce verbosity for ThrottledAsyncChecker.java:schedule
> --------------------------------------------------------
>
> Key: HDFS-13092
> URL: https://issues.apache.org/jira/browse/HDFS-13092
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode
> Affects Versions: 3.0.0
> Reporter: Mukul Kumar Singh
> Assignee: Mukul Kumar Singh
> Priority: Minor
> Fix For: 3.1.0, 3.0.1
>
> Attachments: HDFS-13092.001.patch
>
>
> ThrottledAsyncChecker.java:schedule prints a log message every time a disk
> check is scheduled. However if the previous check was triggered lesser than
> the frequency at "minMsBetweenChecks" then the task is not scheduled. This
> jira will reduce the log verbosity by printing the message only when the task
> will be scheduled.
> {code}
> 2018-01-29 00:51:44,467 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/2/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,470 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/2/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,477 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/4/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,480 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/4/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,486 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/11/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,501 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/13/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,507 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/11/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,533 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/2/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,536 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/12/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,543 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/10/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,544 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/2/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,548 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/3/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,549 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/5/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,550 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/6/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,551 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/2/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,552 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/10/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,552 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/8/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,552 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/12/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,554 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/9/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,555 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/8/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,555 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/14/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,560 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/12/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,560 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/12/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,564 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/5/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,564 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/12/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,570 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/5/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,576 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/8/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,586 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/2/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,591 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/12/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,600 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/6/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,628 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/9/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,653 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/5/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,653 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/3/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,668 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/9/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,687 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/6/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,694 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/5/hadoop/hdfs/data/current
> 2018-01-29 00:51:44,707 INFO checker.ThrottledAsyncChecker
> (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for
> /grid/6/hadoop/hdfs/data/current
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
