[
https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17389923#comment-17389923
]
Stephen O'Donnell commented on HDFS-16147:
------------------------------------------
It is important that OIV can read these images.
If you create a parallel compressed image with this patch, and then try to load
it in a NN without this patch and parallel loading disabled, is the NN still
able to load it? I suspect it won't as there are multiple compressed sections,
so it cannot read a single compressed stream from end to end.
{quote}
It can load 300M Fsimage with compression and parallelization , which can
improve 50% loading time.
{quote}
Is the 50% improvement measured against a compressed single threaded load
verses parallel compressed loading?
How are the load times between "parallel not compressed " vs "parallel
compressed"?
> load fsimage with parallelization and compression
> -------------------------------------------------
>
> Key: HDFS-16147
> URL: https://issues.apache.org/jira/browse/HDFS-16147
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: namanode
> Affects Versions: 3.3.0
> Reporter: liuyongpan
> Priority: Minor
> Attachments: HDFS-16147.001.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
