Attila Doroszlai created HDDS-2267:
--------------------------------------
Summary: Container metadata scanner interval mismatch
Key: HDDS-2267
URL: https://issues.apache.org/jira/browse/HDDS-2267
Project: Hadoop Distributed Data Store
Issue Type: Bug
Components: Ozone Datanode
Reporter: Attila Doroszlai
Assignee: Attila Doroszlai
Container metadata scanner can be configured to run at specific time intervals,
eg. hourly ({{hdds.containerscrub.metadata.scan.interval}}). However, the
actual run interval does not match the configuration. After a datanode
restart, it runs in quick succession, later it runs at apparently random
intervals.
{noformat:title=sample log}
datanode_1 | 2019-10-08 14:05:30 INFO ContainerMetadataScanner:88 - Completed
an iteration of container metadata scrubber in 0 minutes. Number of iterations
(since the data-node restart) : 1, Number of containers scanned in this
iteration : 0, Number of unhealthy containers found in this iteration : 0
datanode_1 | 2019-10-08 14:09:33 INFO ContainerMetadataScanner:88 - Completed
an iteration of container metadata scrubber in 0 minutes. Number of iterations
(since the data-node restart) : 1, Number of containers scanned in this
iteration : 6, Number of unhealthy containers found in this iteration : 0
...
datanode_1 | 2019-10-08 14:09:33 INFO ContainerMetadataScanner:88 - Completed
an iteration of container metadata scrubber in 0 minutes. Number of iterations
(since the data-node restart) : 28, Number of containers scanned in this
iteration : 6, Number of unhealthy containers found in this iteration : 0
datanode_1 | 2019-10-08 14:21:01 INFO ContainerMetadataScanner:88 - Completed
an iteration of container metadata scrubber in 0 minutes. Number of iterations
(since the data-node restart) : 29, Number of containers scanned in this
iteration : 6, Number of unhealthy containers found in this iteration : 0
datanode_1 | 2019-10-08 14:21:01 INFO ContainerMetadataScanner:88 - Completed
an iteration of container metadata scrubber in 0 minutes. Number of iterations
(since the data-node restart) : 30, Number of containers scanned in this
iteration : 6, Number of unhealthy containers found in this iteration : 0
datanode_1 | 2019-10-08 15:30:38 INFO ContainerMetadataScanner:88 - Completed
an iteration of container metadata scrubber in 0 minutes. Number of iterations
(since the data-node restart) : 31, Number of containers scanned in this
iteration : 6, Number of unhealthy containers found in this iteration : 0
datanode_1 | 2019-10-08 16:45:01 INFO ContainerMetadataScanner:88 - Completed
an iteration of container metadata scrubber in 0 minutes. Number of iterations
(since the data-node restart) : 32, Number of containers scanned in this
iteration : 6, Number of unhealthy containers found in this iteration : 0
{noformat}
The problem is that time elapsed is measured in nanoseconds, while the
configuration is in milliseconds.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
