Ethan Rose created HDDS-9005:
--------------------------------
Summary: Container scanner continues to scan deleted container
Key: HDDS-9005
URL: https://issues.apache.org/jira/browse/HDDS-9005
Project: Apache Ozone
Issue Type: Sub-task
Reporter: George Huang
The following was observed in the log of a datanode running the container
scanner:
{code}
2023-07-12 06:04:39,049
[ContainerDataScanner(/data/2/hadoop-ozone/datanode/data/hdds)] ERROR
org.apache.hadoop.ozone.container.common.helpers.ContainerUtils: Chunks dir
/data/2/hadoop-ozone/datanode/data/hdds/CID-c4cbea3d-ac0b-4956-a8cc-6fd5f3a55ec4/current/containerDir2/1104/chunks
does not exist
2023-07-12 06:04:39,061
[ContainerDataScanner(/data/2/hadoop-ozone/datanode/data/hdds)] ERROR
org.apache.hadoop.ozone.container.common.helpers.ContainerUtils: Chunks dir
/data/2/hadoop-ozone/datanode/data/hdds/CID-c4cbea3d-ac0b-4956-a8cc-6fd5f3a55ec4/current/containerDir2/1104/chunks
does not exist
2023-07-12 06:04:39,062
[ContainerDataScanner(/data/2/hadoop-ozone/datanode/data/hdds)] ERROR
org.apache.hadoop.ozone.container.common.helpers.ContainerUtils: Chunks dir
/data/2/hadoop-ozone/datanode/data/hdds/CID-c4cbea3d-ac0b-4956-a8cc-6fd5f3a55ec4/current/containerDir2/1104/chunks
does not exist
2023-07-12 06:04:39,063
[ContainerDataScanner(/data/2/hadoop-ozone/datanode/data/hdds)] ERROR
org.apache.hadoop.ozone.container.common.helpers.ContainerUtils: Chunks dir
/data/2/hadoop-ozone/datanode/data/hdds/CID-c4cbea3d-ac0b-4956-a8cc-6fd5f3a55ec4/current/containerDir2/1104/chunks
does not exist
2023-07-12 06:04:39,064
[ContainerDataScanner(/data/2/hadoop-ozone/datanode/data/hdds)] ERROR
org.apache.hadoop.ozone.container.common.helpers.ContainerUtils: Chunks dir
/data/2/hadoop-ozone/datanode/data/hdds/CID-c4cbea3d-ac0b-4956-a8cc-6fd5f3a55ec4/current/containerDir2/1104/chunks
does not exist
2023-07-12 06:04:39,065
[ContainerDataScanner(/data/2/hadoop-ozone/datanode/data/hdds)] ERROR
org.apache.hadoop.ozone.container.common.helpers.ContainerUtils: Chunks dir
/data/2/hadoop-ozone/datanode/data/hdds/CID-c4cbea3d-ac0b-4956-a8cc-6fd5f3a55ec4/current/containerDir2/1104/chunks
does not exist
2023-07-12 06:04:39,066
[ContainerDataScanner(/data/2/hadoop-ozone/datanode/data/hdds)] ERROR
org.apache.hadoop.ozone.container.common.helpers.ContainerUtils: Chunks dir
/data/2/hadoop-ozone/datanode/data/hdds/CID-c4cbea3d-ac0b-4956-a8cc-6fd5f3a55ec4/current/containerDir2/1104/chunks
does not exist
2023-07-12 06:04:39,066
[ContainerDataScanner(/data/2/hadoop-ozone/datanode/data/hdds)] WARN
org.apache.hadoop.ozone.container.ozoneimpl.ContainerController: Container 1104
not found, may be deleted, skip update DataScanTimestamp
{code}
{{ozone admin container info}} showed that the container replica was no longer
present on the datanode that logged these messages. The replica was likely
deleted due to over-replication while the scanner was running.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
