Sammi Chen created HDDS-6024:
--------------------------------
Summary: Reduce log numbers caused by unhealthy follower
Key: HDDS-6024
URL: https://issues.apache.org/jira/browse/HDDS-6024
Project: Apache Ozone
Issue Type: Improvement
Reporter: Sammi Chen
Assignee: Sammi Chen
Attachments: Screen Shot 2021-11-18 at 2.51.55 PM.png
There are 1GB logs created in 1 minutes on leader DN once a follower DN is
down.
2021-11-18 14:44:16,616
[018597a3-66ef-4fd6-910b-2c775b12b2db@group-9846FC6FCBF4->37d8d751-5fef-4dd5-a5b7-43e5663b03e7-GrpcLogAppender-LogAppenderDaemon]
ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=e59a05cf-dca5-428f-81b5-9846fc6fcbf4.Reason :
018597a3-66ef-4fd6-910b-2c775b12b2db has not seen follower/s
37d8d751-5fef-4dd5-a5b7-43e5663b03e7 for 558715ms
2021-11-18 14:44:16,616
[018597a3-66ef-4fd6-910b-2c775b12b2db@group-9846FC6FCBF4->37d8d751-5fef-4dd5-a5b7-43e5663b03e7-GrpcLogAppender-LogAppenderDaemon]
ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=e59a05cf-dca5-428f-81b5-9846fc6fcbf4.Reason :
018597a3-66ef-4fd6-910b-2c775b12b2db has not seen follower/s
37d8d751-5fef-4dd5-a5b7-43e5663b03e7 for 558715ms
2021-11-18 14:44:16,616
[018597a3-66ef-4fd6-910b-2c775b12b2db@group-9846FC6FCBF4->37d8d751-5fef-4dd5-a5b7-43e5663b03e7-GrpcLogAppender-LogAppenderDaemon]
ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=e59a05cf-dca5-428f-81b5-9846fc6fcbf4.Reason :
018597a3-66ef-4fd6-910b-2c775b12b2db has not seen follower/s
37d8d751-5fef-4dd5-a5b7-43e5663b03e7 for 558715ms
2021-11-18 14:44:16,616
[018597a3-66ef-4fd6-910b-2c775b12b2db@group-9846FC6FCBF4->37d8d751-5fef-4dd5-a5b7-43e5663b03e7-GrpcLogAppender-LogAppenderDaemon]
ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=e59a05cf-dca5-428f-81b5-9846fc6fcbf4.Reason :
018597a3-66ef-4fd6-910b-2c775b12b2db has not seen follower/s
37d8d751-5fef-4dd5-a5b7-43e5663b03e7 for 558715ms
2021-11-18 14:44:16,616
[018597a3-66ef-4fd6-910b-2c775b12b2db@group-9846FC6FCBF4->37d8d751-5fef-4dd5-a5b7-43e5663b03e7-GrpcLogAppender-LogAppenderDaemon]
ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=e59a05cf-dca5-428f-81b5-9846fc6fcbf4.Reason :
018597a3-66ef-4fd6-910b-2c775b12b2db has not seen follower/s
37d8d751-5fef-4dd5-a5b7-43e5663b03e7 for 558715ms
2021-11-18 14:44:16,616
[018597a3-66ef-4fd6-910b-2c775b12b2db@group-9846FC6FCBF4->37d8d751-5fef-4dd5-a5b7-43e5663b03e7-GrpcLogAppender-LogAppenderDaemon]
ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=e59a05cf-dca5-428f-81b5-9846fc6fcbf4.Reason :
018597a3-66ef-4fd6-910b-2c775b12b2db has not seen follower/s
37d8d751-5fef-4dd5-a5b7-43e5663b03e7 for 558715ms
2021-11-18 14:44:16,616
[018597a3-66ef-4fd6-910b-2c775b12b2db@group-9846FC6FCBF4->37d8d751-5fef-4dd5-a5b7-43e5663b03e7-GrpcLogAppender-LogAppenderDaemon]
ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=e59a05cf-dca5-428f-81b5-9846fc6fcbf4.Reason :
018597a3-66ef-4fd6-910b-2c775b12b2db has not seen follower/s
37d8d751-5fef-4dd5-a5b7-43e5663b03e7 for 558715ms
2021-11-18 14:44:16,616
[018597a3-66ef-4fd6-910b-2c775b12b2db@group-9846FC6FCBF4->37d8d751-5fef-4dd5-a5b7-43e5663b03e7-GrpcLogAppender-LogAppenderDaemon]
ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=e59a05cf-dca5-428f-81b5-9846fc6fcbf4.Reason :
018597a3-66ef-4fd6-910b-2c775b12b2db has not seen follower/s
37d8d751-5fef-4dd5-a5b7-43e5663b03e7 for 558715ms
2021-11-18 14:44:16,616
[018597a3-66ef-4fd6-910b-2c775b12b2db@group-9846FC6FCBF4->37d8d751-5fef-4dd5-a5b7-43e5663b03e7-GrpcLogAppender-LogAppenderDaemon]
ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=e59a05cf-dca5-428f-81b5-9846fc6fcbf4.Reason :
018597a3-66ef-4fd6-910b-2c775b12b2db has not seen follower/s
37d8d751-5fef-4dd5-a5b7-43e5663b03e7 for 558715ms
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
