Sammi Chen created HDDS-11141:
---------------------------------
Summary: Pipeline Action CLOSE log floods in datanode
XceiverServerRatis
Key: HDDS-11141
URL: https://issues.apache.org/jira/browse/HDDS-11141
Project: Apache Ozone
Issue Type: Improvement
Reporter: Sammi Chen
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
2024-06-26 19:28:29,198 ERROR
org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis:
pipeline Action CLOSE on pipeline
PipelineID=af802a5f-7ad2-4665-9e3b-cac97e640502.Reason :
2b7b0b00-a65f-427b-877a-203ffa09142b has not seen follower/s
a24855d4-7942-4811-ac1e-59c943431dcd for 303899ms
Datanode log files are full of above messages, which makes the useful messages
are removed because of log file rolling over.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
