[
https://issues.apache.org/jira/browse/HDFS-17244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17780875#comment-17780875
]
ASF GitHub Bot commented on HDFS-17244:
---------------------------------------
alexkingli opened a new pull request, #6237:
URL: https://github.com/apache/hadoop/pull/6237
… exceptions occur
Sometimes it will checkpoint repeatedly on our cluster with multiple
SNNS（hdfs verison ：3.2.1）. We check the codes， and find that it will send
fsimage file to all other namenode. When it sends the fimage file to the other
snns， it will fail because of other snns will refuse to receive the file。 It
will affect the whole login of checkpointing。For example， we check the result
of transfering fsimage to snn by feature‘s geting method， and it will throw
the IOException and don't update the lastUploadTime and the
lastCheckpointTime，then it will checkpoint repeatedly.
I think that the snn node should only transfers the fsimage to active nn ,
so it is ok if sending the fsiamge to the other nodes unsuccessfully.
### Description of PR
### How was this patch tested?
### For code changes:
- [ ] Does the title or this PR starts with the corresponding JIRA issue id
(e.g. 'HADOOP-17799. Your PR title ...')?
- [ ] Object storage: have the integration tests been executed and the
endpoint declared according to the connector-specific documentation?
- [ ] If adding new dependencies to the code, are these dependencies
licensed in a way that is compatible for inclusion under [ASF
2.0](http://www.apache.org/legal/resolved.html#category-a)?
- [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`,
`NOTICE-binary` files?
> Avoid affecting the overall logic of checkpoint when I/O exceptions occur
> -------------------------------------------------------------------------
>
> Key: HDFS-17244
> URL: https://issues.apache.org/jira/browse/HDFS-17244
> Project: Hadoop HDFS
> Issue Type: New Feature
> Affects Versions: 3.2.1
> Reporter: liying
> Priority: Major
> Attachments: image-2023-10-30-15-27-47-567.png,
> image-2023-10-30-15-28-14-552.png
>
>
> Sometimes it will checkpoint repeatedly on our cluster with multiple
> SNNS（hdfs verison ：3.2.1）. We check the codes， and find that it will send
> fsimage file to all other namenode. When it sends the fimage file to the
> other snns， it will fail because of other snns will refuse to receive the
> file。 It will affect the whole login of checkpointing。For example， we check
> the result of transfering fsimage to snn by feature‘s geting method， and it
> will throw the IOException and don't update the lastUploadTime and the
> lastCheckpointTime，then it will checkpoint repeatedly.
> !image-2023-10-30-15-27-47-567.png!
> !image-2023-10-30-15-28-14-552.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
