[
https://issues.apache.org/jira/browse/HDDS-9090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aswin Shakil updated HDDS-9090:
-------------------------------
Description:
{code:java}
2023-07-19 03:44:51,971 [Under Replicated Processor] INFO
org.apache.hadoop.hdds.scm.container.replication.ReplicationManager: Sending
command [reconstructECContainersCommand: containerID: 1, replicationConfig:
EC{rs-3-2-1024k}, sources:
[c5922b88-86bf-4e6e-9102-5d350feaf970(quasar-narsad-7.quasar-narsad.root.hwx.site/172.27.201.16)
replicaIndex: 2,
1fda4a9f-ce2f-486a-9830-aa69ea34d5f1(quasar-narsad-6.quasar-narsad.root.hwx.site/172.27.193.1)
replicaIndex: 3,
bb75dfdc-844d-41b9-82d8-d0eb86ca23d9(quasar-narsad-1.quasar-narsad.root.hwx.site/172.27.112.134)
replicaIndex: 4], targets:
[2f76339e-f697-4c67-b761-99263d2e727c(quasar-narsad-4.quasar-narsad.root.hwx.site/172.27.205.199)],
missingIndexes: [1]] for container ContainerInfo{id=#1, state=CLOSED,
stateEnterTime=2023-07-19T03:29:21.571511Z,
pipelineID=PipelineID=35d0063c-9b5a-49bf-ad1c-a719fe89ded0, owner=om1546336088}
to
2f76339e-f697-4c67-b761-99263d2e727c(quasar-narsad-4.quasar-narsad.root.hwx.site/172.27.205.199)
with datanode deadline 1689738861970 and scm deadline 1689738891970 2023-07-19
03:44:51,971 [Under Replicated Processor] ERROR
org.apache.hadoop.hdds.scm.container.replication.UnhealthyReplicationProcessor:
Error processing Health result of class: class
org.apache.hadoop.hdds.scm.container.replication.ContainerHealthResult$UnderReplicatedHealthResult
for container ContainerInfo{id=#1, state=CLOSED,
stateEnterTime=2023-07-19T03:29:21.571511Z,
pipelineID=PipelineID=35d0063c-9b5a-49bf-ad1c-a719fe89ded0, owner=om1546336088}
java.lang.NullPointerException at
org.apache.hadoop.hdds.scm.container.replication.ECUnderReplicationHandler.processMissingIndexes(ECUnderReplicationHandler.java:378)
at
org.apache.hadoop.hdds.scm.container.replication.ECUnderReplicationHandler.processAndSendCommands(ECUnderReplicationHandler.java:162)
at
org.apache.hadoop.hdds.scm.container.replication.ReplicationManager.processUnderReplicatedContainer(ReplicationManager.java:773)
at
org.apache.hadoop.hdds.scm.container.replication.UnderReplicatedProcessor.sendDatanodeCommands(UnderReplicatedProcessor.java:60)
at
org.apache.hadoop.hdds.scm.container.replication.UnderReplicatedProcessor.sendDatanodeCommands(UnderReplicatedProcessor.java:29)
at
org.apache.hadoop.hdds.scm.container.replication.UnhealthyReplicationProcessor.processContainer(UnhealthyReplicationProcessor.java:156)
at
org.apache.hadoop.hdds.scm.container.replication.UnhealthyReplicationProcessor.processAll(UnhealthyReplicationProcessor.java:116)
at
org.apache.hadoop.hdds.scm.container.replication.UnhealthyReplicationProcessor.run(UnhealthyReplicationProcessor.java:165)
at java.base/java.lang.Thread.run(Thread.java:834){code}
ReplicationManagerMetrics is initialized only after initlaizing
ECUnderReplicationHandler, So metrics for ECUnderReplicationHandler is null.
was:
{code:java}
2023-07-19 03:44:51,971 [Under Replicated Processor] INFO
org.apache.hadoop.hdds.scm.container.replication.ReplicationManager: Sending
command [reconstructECContainersCommand: containerID: 1, replicationConfig:
EC{rs-3-2-1024k}, sources:
[c5922b88-86bf-4e6e-9102-5d350feaf970(quasar-narsad-7.quasar-narsad.root.hwx.site/172.27.201.16)
replicaIndex: 2,
1fda4a9f-ce2f-486a-9830-aa69ea34d5f1(quasar-narsad-6.quasar-narsad.root.hwx.site/172.27.193.1)
replicaIndex: 3,
bb75dfdc-844d-41b9-82d8-d0eb86ca23d9(quasar-narsad-1.quasar-narsad.root.hwx.site/172.27.112.134)
replicaIndex: 4], targets:
[2f76339e-f697-4c67-b761-99263d2e727c(quasar-narsad-4.quasar-narsad.root.hwx.site/172.27.205.199)],
missingIndexes: [1]] for container ContainerInfo{id=#1, state=CLOSED,
stateEnterTime=2023-07-19T03:29:21.571511Z,
pipelineID=PipelineID=35d0063c-9b5a-49bf-ad1c-a719fe89ded0, owner=om1546336088}
to
2f76339e-f697-4c67-b761-99263d2e727c(quasar-narsad-4.quasar-narsad.root.hwx.site/172.27.205.199)
with datanode deadline 1689738861970 and scm deadline 1689738891970 2023-07-19
03:44:51,971 [Under Replicated Processor] ERROR
org.apache.hadoop.hdds.scm.container.replication.UnhealthyReplicationProcessor:
Error processing Health result of class: class
org.apache.hadoop.hdds.scm.container.replication.ContainerHealthResult$UnderReplicatedHealthResult
for container ContainerInfo{id=#1, state=CLOSED,
stateEnterTime=2023-07-19T03:29:21.571511Z,
pipelineID=PipelineID=35d0063c-9b5a-49bf-ad1c-a719fe89ded0, owner=om1546336088}
java.lang.NullPointerException at
org.apache.hadoop.hdds.scm.container.replication.ECUnderReplicationHandler.processMissingIndexes(ECUnderReplicationHandler.java:378)
at
org.apache.hadoop.hdds.scm.container.replication.ECUnderReplicationHandler.processAndSendCommands(ECUnderReplicationHandler.java:162)
at
org.apache.hadoop.hdds.scm.container.replication.ReplicationManager.processUnderReplicatedContainer(ReplicationManager.java:773)
at
org.apache.hadoop.hdds.scm.container.replication.UnderReplicatedProcessor.sendDatanodeCommands(UnderReplicatedProcessor.java:60)
at
org.apache.hadoop.hdds.scm.container.replication.UnderReplicatedProcessor.sendDatanodeCommands(UnderReplicatedProcessor.java:29)
at
org.apache.hadoop.hdds.scm.container.replication.UnhealthyReplicationProcessor.processContainer(UnhealthyReplicationProcessor.java:156)
at
org.apache.hadoop.hdds.scm.container.replication.UnhealthyReplicationProcessor.processAll(UnhealthyReplicationProcessor.java:116)
at
org.apache.hadoop.hdds.scm.container.replication.UnhealthyReplicationProcessor.run(UnhealthyReplicationProcessor.java:165)
at java.base/java.lang.Thread.run(Thread.java:834){code}
> NullPointerException thrown by ReplicationManagerMetrics because of the order
> of initialization
> -----------------------------------------------------------------------------------------------
>
> Key: HDDS-9090
> URL: https://issues.apache.org/jira/browse/HDDS-9090
> Project: Apache Ozone
> Issue Type: Bug
> Reporter: Aswin Shakil
> Assignee: Aswin Shakil
> Priority: Major
>
> {code:java}
> 2023-07-19 03:44:51,971 [Under Replicated Processor] INFO
> org.apache.hadoop.hdds.scm.container.replication.ReplicationManager: Sending
> command [reconstructECContainersCommand: containerID: 1, replicationConfig:
> EC{rs-3-2-1024k}, sources:
> [c5922b88-86bf-4e6e-9102-5d350feaf970(quasar-narsad-7.quasar-narsad.root.hwx.site/172.27.201.16)
> replicaIndex: 2,
> 1fda4a9f-ce2f-486a-9830-aa69ea34d5f1(quasar-narsad-6.quasar-narsad.root.hwx.site/172.27.193.1)
> replicaIndex: 3,
> bb75dfdc-844d-41b9-82d8-d0eb86ca23d9(quasar-narsad-1.quasar-narsad.root.hwx.site/172.27.112.134)
> replicaIndex: 4], targets:
> [2f76339e-f697-4c67-b761-99263d2e727c(quasar-narsad-4.quasar-narsad.root.hwx.site/172.27.205.199)],
> missingIndexes: [1]] for container ContainerInfo{id=#1, state=CLOSED,
> stateEnterTime=2023-07-19T03:29:21.571511Z,
> pipelineID=PipelineID=35d0063c-9b5a-49bf-ad1c-a719fe89ded0,
> owner=om1546336088} to
> 2f76339e-f697-4c67-b761-99263d2e727c(quasar-narsad-4.quasar-narsad.root.hwx.site/172.27.205.199)
> with datanode deadline 1689738861970 and scm deadline 1689738891970
> 2023-07-19 03:44:51,971 [Under Replicated Processor] ERROR
> org.apache.hadoop.hdds.scm.container.replication.UnhealthyReplicationProcessor:
> Error processing Health result of class: class
> org.apache.hadoop.hdds.scm.container.replication.ContainerHealthResult$UnderReplicatedHealthResult
> for container ContainerInfo{id=#1, state=CLOSED,
> stateEnterTime=2023-07-19T03:29:21.571511Z,
> pipelineID=PipelineID=35d0063c-9b5a-49bf-ad1c-a719fe89ded0,
> owner=om1546336088} java.lang.NullPointerException at
> org.apache.hadoop.hdds.scm.container.replication.ECUnderReplicationHandler.processMissingIndexes(ECUnderReplicationHandler.java:378)
> at
> org.apache.hadoop.hdds.scm.container.replication.ECUnderReplicationHandler.processAndSendCommands(ECUnderReplicationHandler.java:162)
> at
> org.apache.hadoop.hdds.scm.container.replication.ReplicationManager.processUnderReplicatedContainer(ReplicationManager.java:773)
> at
> org.apache.hadoop.hdds.scm.container.replication.UnderReplicatedProcessor.sendDatanodeCommands(UnderReplicatedProcessor.java:60)
> at
> org.apache.hadoop.hdds.scm.container.replication.UnderReplicatedProcessor.sendDatanodeCommands(UnderReplicatedProcessor.java:29)
> at
> org.apache.hadoop.hdds.scm.container.replication.UnhealthyReplicationProcessor.processContainer(UnhealthyReplicationProcessor.java:156)
> at
> org.apache.hadoop.hdds.scm.container.replication.UnhealthyReplicationProcessor.processAll(UnhealthyReplicationProcessor.java:116)
> at
> org.apache.hadoop.hdds.scm.container.replication.UnhealthyReplicationProcessor.run(UnhealthyReplicationProcessor.java:165)
> at java.base/java.lang.Thread.run(Thread.java:834){code}
> ReplicationManagerMetrics is initialized only after initlaizing
> ECUnderReplicationHandler, So metrics for ECUnderReplicationHandler is null.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
