[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Attachment: compress_not parallel.png > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch, HDFS-16147.002.patch, compress_not > parallel.png, compress_parallel.png, subsection.svg > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Attachment: compress_parallel.png > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch, HDFS-16147.002.patch, compress_not > parallel.png, compress_parallel.png, subsection.svg > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Attachment: (was: subsection.svg) > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch, HDFS-16147.002.patch, > subsection.svg > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Attachment: subsection.svg > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch, HDFS-16147.002.patch, > subsection.svg > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Attachment: (was: subsection.svg) > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch, HDFS-16147.002.patch, > subsection.svg > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Attachment: subsection.svg > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch, HDFS-16147.002.patch, > subsection.svg > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Attachment: subsection.svg > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch, HDFS-16147.002.patch, > subsection.svg > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Release Note: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. The idea of this patch is to compress each section separately. 1、At this patch, when compression and parallel are turned on at the same time, oiv can still work normally. Although each section is split into multiple sections and compressed, it can still be parsed correctly. 2、If you create a parallel compressed image with this patch, and then try to load it in a NN without this patch and parallel loading disabled, NN is still able to load it. Both of these may sound incorrect, but it works. This may happen because the decompressed code can splits each section correctly. was: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. 1、At this patch, when compression and parallel are turned on at the same time, oiv can still work normally. Although each section is split into multiple sections and compressed, it can still be parsed correctly. 2、If you create a parallel compressed image with this patch, and then try to load it in a NN without this patch and parallel loading disabled, NN is still able to load it. Both of these may sound crazy, but it works. This may happen because the decompressed code can splits each section correctly. > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch, HDFS-16147.002.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Release Note: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. 1、At this patch, when compression and parallel are turned on at the same time, oiv can still work normally. Although each section is split into multiple sections and compressed, it can still be parsed correctly. 2、If you create a parallel compressed image with this patch, and then try to load it in a NN without this patch and parallel loading disabled, NN is still able to load it. Both of these may sound crazy, but it works. This may happen because the decompressed code can splits each section correctly. was: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. 1、When compression and parallel are turned on at the same time, oiv can still work normally. Although each section is split into multiple sections and compressed, it can still be parsed correctly. 2、If you create a parallel compressed image with this patch, and then try to load it in a NN without this patch and parallel loading disabled, NN is still able to load it. Both of these may sound crazy, but it works. This may happen because the decompressed code can splits each section correctly. > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch, HDFS-16147.002.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Release Note: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. 1、When compression and parallel are turned on at the same time, oiv can still work normally. Although each section is split into multiple sections and compressed, it can still be parsed correctly. 2、If you create a parallel compressed image with this patch, and then try to load it in a NN without this patch and parallel loading disabled, NN is still able to load it. Both of these may sound crazy, but it works. This may happen because the decompressed code can splits each section correctly. was: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. 1、When compression and parallel are turned on at the same time, oiv can still work normally. Although each section is split into multiple sections and compressed, it can still be parsed correctly. 2、If you create a parallel compressed image with this patch, and then try to load it in a NN without this patch and parallel loading disabled, NN is still able to load it. Both of these may sound crazy, but it works. This may happen because the decompressed code can splits each section correctly > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch, HDFS-16147.002.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Release Note: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. 1、When compression and parallel are turned on at the same time, oiv can still work normally. Although each section is split into multiple sections and compressed, it can still be parsed correctly. 2、If you create a parallel compressed image with this patch, and then try to load it in a NN without this patch and parallel loading disabled, NN is still able to load it. Both of these may sound crazy, but it works. This may happen because the decompressed code can splits each section correctly was: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. 1、When compression and parallel are turned on at the same time, oiv can still work normally. Although each section is split into multiple sections and compressed, it can still be parsed correctly. 2、If you create a parallel compressed image with this patch, and then try to load it in a NN without this patch and parallel loading disabled, NN is still able to load it. > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch, HDFS-16147.002.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Release Note: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. 1、When compression and parallel are turned on at the same time, oiv can still work normally. Although each section is split into multiple sections and compressed, it can still be parsed correctly. 2、If you create a parallel compressed image with this patch, and then try to load it in a NN without this patch and parallel loading disabled, NN is still able to load it. was: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. 1、When compression and parallel are turned on at the same time, oiv can still work normally. Although each section is split into multiple sections and compressed, it can still be parsed correctly. 2、If you create a parallel compressed image with this patch, and then try to load it in a NN without this patch and parallel loading disabled, NN is still able to load it. 3、 > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch, HDFS-16147.002.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Release Note: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. 1、When compression and parallel are turned on at the same time, oiv can still work normally. Although each section is split into multiple sections and compressed, it can still be parsed correctly. 2、If you create a parallel compressed image with this patch, and then try to load it in a NN without this patch and parallel loading disabled, NN is still able to load it. 3、 was: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. 1、Even if compression and parallel are turned on at the same time, oiv can still work normally. 2、If you create a parallel compressed image with this patch, and then try to load it in a NN without this patch and parallel loading disabled, NN is still able to load it. 3、 > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch, HDFS-16147.002.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Release Note: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. 1、Even if compression and parallel are turned on at the same time, oiv can still work normally. 2、If you create a parallel compressed image with this patch, and then try to load it in a NN without this patch and parallel loading disabled, NN is still able to load it. 3、 was: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. 1、oiv can work normally. 2、If you create a parallel compressed image with this patch, and then try to load it in a NN without this patch and parallel loading disabled, NN is still able to load it. > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch, HDFS-16147.002.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Release Note: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. 1、oiv can work normally. 2、If you create a parallel compressed image with this patch, and then try to load it in a NN without this patch and parallel loading disabled, NN is still able to load it. was: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. 1、oiv can work normally. 2、The new FsImage can be read . > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch, HDFS-16147.002.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Release Note: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. 1、oiv can work normally. 2、The new FsImage can be read . was: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. 1、oiv can work normally. 2、 > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch, HDFS-16147.002.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Release Note: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. 1、oiv can work normally. 2、 was: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. 1、oiv can work normally > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch, HDFS-16147.002.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Release Note: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. 1、oiv can work normally was:In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch, HDFS-16147.002.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Attachment: HDFS-16147.002.patch > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch, HDFS-16147.002.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-16147: Fix Version/s: (was: 3.3.0) > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-16147: Target Version/s: (was: 3.3.0) > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Attachments: HDFS-16147.001.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Release Note: In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect. Description: (was:In HDFS-14617, it allows the inode and inode directory sections of the fsimage to be loaded in parallel. But it can't turn on parallelism and compression at the same time. I fixed this defect.) > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Fix For: 3.3.0 > > Attachments: HDFS-16147.001.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-16147) load fsimage with parallelization and compression
[ https://issues.apache.org/jira/browse/HDFS-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyongpan updated HDFS-16147: -- Attachment: HDFS-16147.001.patch Status: Patch Available (was: Open) > load fsimage with parallelization and compression > - > > Key: HDFS-16147 > URL: https://issues.apache.org/jira/browse/HDFS-16147 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namanode >Affects Versions: 3.3.0 >Reporter: liuyongpan >Priority: Minor > Fix For: 3.3.0 > > Attachments: HDFS-16147.001.patch > > >In HDFS-14617, it allows the inode and inode directory sections of > the fsimage to be loaded in parallel. But it can't turn on parallelism and > compression at the same time. I fixed this defect. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
