[
https://issues.apache.org/jira/browse/HDFS-7123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated HDFS-7123:
--------------------------
Attachment: HDFS-7123.patch
Checkpoint is a CPU bound process. Standby NN is mostly idle. Tested on a
machine with several CPUs and config legacy image checkpoint to write to the
same disk as one of PB image checkpoint disks; the overall checkpoint duration
is cut almost by half.
> Run legacy fsimage checkpoint in parallel with PB fsimage checkpoint
> --------------------------------------------------------------------
>
> Key: HDFS-7123
> URL: https://issues.apache.org/jira/browse/HDFS-7123
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Ming Ma
> Attachments: HDFS-7123.patch
>
>
> HDFS-7097 will address the checkpoint and BR issue. In addition, it might
> still be useful to reduce the overall checkpoint duration, given it blocks
> edit log replay. If there is large volume of edit log to catch up and NN fail
> overs, it will impact the availability.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
