[jira] [Assigned] (HDFS-15590) namenode fails to start when ordered snapshot deletion feature is disabled

[ https://issues.apache.org/jira/browse/HDFS-15590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDFS-15590: -- Assignee: Shashikant Banerjee > namenode fails to start when ordered snapshot

[jira] [Created] (HDFS-15590) namenode fails to start when ordered snapshot deletion feature is disabled

Shashikant Banerjee created HDFS-15590: -- Summary: namenode fails to start when ordered snapshot deletion feature is disabled Key: HDFS-15590 URL: https://issues.apache.org/jira/browse/HDFS-15590

[jira] [Commented] (HDFS-15456) TestExternalStoragePolicySatisfier fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199808#comment-17199808 ] Leon Gao commented on HDFS-15456: - [~ayushtkn] Yeah it fails in almost all of the recent PRs:

[jira] [Commented] (HDFS-15456) TestExternalStoragePolicySatisfier fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199790#comment-17199790 ] Ayush Saxena commented on HDFS-15456: - I tried this up but couldn't reproduce this at my local. Do

[jira] [Work logged] (HDFS-15554) RBF: force router check file existence in destinations before adding/updating mount points

[ https://issues.apache.org/jira/browse/HDFS-15554?focusedWorklogId=487847=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-487847 ] ASF GitHub Bot logged work on HDFS-15554: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15589) Huge PostponedMisreplicatedBlocks can't decrease immediately when start namenode after datanode

[ https://issues.apache.org/jira/browse/HDFS-15589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199786#comment-17199786 ] Ayush Saxena commented on HDFS-15589: - Yeps, that is true. For this only there was a proposal

[jira] [Work logged] (HDFS-15557) Log the reason why a storage log file can't be deleted

[ https://issues.apache.org/jira/browse/HDFS-15557?focusedWorklogId=487737=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-487737 ] ASF GitHub Bot logged work on HDFS-15557: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15557) Log the reason why a storage log file can't be deleted

[ https://issues.apache.org/jira/browse/HDFS-15557?focusedWorklogId=487626=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-487626 ] ASF GitHub Bot logged work on HDFS-15557: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

[ https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=487831=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-487831 ] ASF GitHub Bot logged work on HDFS-15548: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15025) Applying NVDIMM storage media to HDFS

[ https://issues.apache.org/jira/browse/HDFS-15025?focusedWorklogId=487562=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-487562 ] ASF GitHub Bot logged work on HDFS-15025: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15516) Add info for create flags in NameNode audit logs

[ https://issues.apache.org/jira/browse/HDFS-15516?focusedWorklogId=487644=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-487644 ] ASF GitHub Bot logged work on HDFS-15516: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15554) RBF: force router check file existence in destinations before adding/updating mount points

[ https://issues.apache.org/jira/browse/HDFS-15554?focusedWorklogId=487919=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-487919 ] ASF GitHub Bot logged work on HDFS-15554: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15589) Huge PostponedMisreplicatedBlocks can't decrease immediately when start namenode after datanode

[ https://issues.apache.org/jira/browse/HDFS-15589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199750#comment-17199750 ] zhengchenyu commented on HDFS-15589: [~ayushtkn] I know the postpone block's logical. I encounter a

[jira] [Work logged] (HDFS-15557) Log the reason why a storage log file can't be deleted

[ https://issues.apache.org/jira/browse/HDFS-15557?focusedWorklogId=487467=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-487467 ] ASF GitHub Bot logged work on HDFS-15557: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15025) Applying NVDIMM storage media to HDFS

[ https://issues.apache.org/jira/browse/HDFS-15025?focusedWorklogId=487465=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-487465 ] ASF GitHub Bot logged work on HDFS-15025: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

[ https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=487441=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-487441 ] ASF GitHub Bot logged work on HDFS-15548: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15582) Reduce NameNode audit log

[ https://issues.apache.org/jira/browse/HDFS-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199739#comment-17199739 ] Jinglun commented on HDFS-15582: Re-upload v02 as v03. > Reduce NameNode audit log >

[jira] [Updated] (HDFS-15582) Reduce NameNode audit log

[ https://issues.apache.org/jira/browse/HDFS-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15582: --- Attachment: HDFS-15582.003.patch > Reduce NameNode audit log > - > >

[jira] [Commented] (HDFS-15569) Speed up the Storage#doRecover during datanode rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-15569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199698#comment-17199698 ] Hadoop QA commented on HDFS-15569: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15583) Backport DirectoryScanner improvements HDFS-14476, HDFS-14751 and HDFS-15048 to branch 3.2 and 3.1

[ https://issues.apache.org/jira/browse/HDFS-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199694#comment-17199694 ] Wei-Chiu Chuang commented on HDFS-15583: +1 > Backport DirectoryScanner improvements HDFS-14476,

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199693#comment-17199693 ] Wei-Chiu Chuang commented on HDFS-15415: +1. Sorry I reviewed but forgot to comment here. >

[jira] [Comment Edited] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199691#comment-17199691 ] Stephen O'Donnell edited comment on HDFS-15415 at 9/21/20, 10:27 PM: -

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199691#comment-17199691 ] Stephen O'Donnell commented on HDFS-15415: -- I will commit the branch-3.3 patch tomorrow if there

[jira] [Commented] (HDFS-15456) TestExternalStoragePolicySatisfier fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199685#comment-17199685 ] Leon Gao commented on HDFS-15456: - Hi [~ayushtkn] , Any other thoughts on this? >

[jira] [Work logged] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

[ https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=487294=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-487294 ] ASF GitHub Bot logged work on HDFS-15548: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15543) RBF: Write Should allow, when a subcluster is unavailable for RANDOM mount points with fault Tolerance enabled.

[ https://issues.apache.org/jira/browse/HDFS-15543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199669#comment-17199669 ] Hadoop QA commented on HDFS-15543: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15554) RBF: force router check file existence in destinations before adding/updating mount points

[ https://issues.apache.org/jira/browse/HDFS-15554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199561#comment-17199561 ] Fengnan Li commented on HDFS-15554: --- Thanks [~ayushtkn] [~elgoiri] ! > RBF: force router check file

[jira] [Updated] (HDFS-15554) RBF: force router check file existence in destinations before adding/updating mount points

[ https://issues.apache.org/jira/browse/HDFS-15554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15554: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Work logged] (HDFS-15554) RBF: force router check file existence in destinations before adding/updating mount points

[ https://issues.apache.org/jira/browse/HDFS-15554?focusedWorklogId=487133=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-487133 ] ASF GitHub Bot logged work on HDFS-15554: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15554) RBF: force router check file existence in destinations before adding/updating mount points

[ https://issues.apache.org/jira/browse/HDFS-15554?focusedWorklogId=487123=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-487123 ] ASF GitHub Bot logged work on HDFS-15554: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15557) Log the reason why a storage log file can't be deleted

[ https://issues.apache.org/jira/browse/HDFS-15557?focusedWorklogId=487119=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-487119 ] ASF GitHub Bot logged work on HDFS-15557: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15557) Log the reason why a storage log file can't be deleted

[ https://issues.apache.org/jira/browse/HDFS-15557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15557: --- Status: Patch Available (was: Open) > Log the reason why a storage log file can't be deleted >

[jira] [Updated] (HDFS-15569) Speed up the Storage#doRecover during datanode rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-15569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hemanth Boyina updated HDFS-15569: -- Attachment: HDFS-15569.003.patch > Speed up the Storage#doRecover during datanode rolling

[jira] [Commented] (HDFS-15569) Speed up the Storage#doRecover during datanode rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-15569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199503#comment-17199503 ] Hemanth Boyina commented on HDFS-15569: --- thanks for the review [~weichiu] {quote}and why log

[jira] [Commented] (HDFS-15543) RBF: Write Should allow, when a subcluster is unavailable for RANDOM mount points with fault Tolerance enabled.

[ https://issues.apache.org/jira/browse/HDFS-15543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199501#comment-17199501 ] Hemanth Boyina commented on HDFS-15543: --- thanks for the review [~elgoiri] {quote}The failed tests

[jira] [Updated] (HDFS-15543) RBF: Write Should allow, when a subcluster is unavailable for RANDOM mount points with fault Tolerance enabled.

[ https://issues.apache.org/jira/browse/HDFS-15543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hemanth Boyina updated HDFS-15543: -- Attachment: HDFS-15543.005.patch > RBF: Write Should allow, when a subcluster is unavailable

[jira] [Commented] (HDFS-15589) Huge PostponedMisreplicatedBlocks can't decrease immediately when start namenode after datanode

[ https://issues.apache.org/jira/browse/HDFS-15589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199432#comment-17199432 ] Ayush Saxena commented on HDFS-15589: - Do you mean to say that the blocks doesn't get deleted post a

[jira] [Updated] (HDFS-15589) Huge PostponedMisreplicatedBlocks can't decrease immediately when start namenode after datanode

[ https://issues.apache.org/jira/browse/HDFS-15589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengchenyu updated HDFS-15589: --- Description: In our test cluster, I restart my namenode. Then I found many 

[jira] [Updated] (HDFS-15589) Huge PostponedMisreplicatedBlocks can't decrease immediately when start namenode after datanode

[ https://issues.apache.org/jira/browse/HDFS-15589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengchenyu updated HDFS-15589: --- Description: In our test cluster, I restart my namenode. Then I found many 

[jira] [Created] (HDFS-15589) Huge PostponedMisreplicatedBlocks can't decrease immediately when start namenode after datanode

zhengchenyu created HDFS-15589: -- Summary: Huge PostponedMisreplicatedBlocks can't decrease immediately when start namenode after datanode Key: HDFS-15589 URL: https://issues.apache.org/jira/browse/HDFS-15589

[jira] [Commented] (HDFS-15582) Reduce NameNode audit log

[ https://issues.apache.org/jira/browse/HDFS-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199356#comment-17199356 ] Hadoop QA commented on HDFS-15582: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15442) Image upload may fail if dfs.image.transfer.chunksize wrongly set to negative value

[ https://issues.apache.org/jira/browse/HDFS-15442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199350#comment-17199350 ] AMC-team commented on HDFS-15442: - [~ayushtkn] Thanks for reminding. Upload the patch again. > Image

[jira] [Commented] (HDFS-15442) Image upload may fail if dfs.image.transfer.chunksize wrongly set to negative value

[ https://issues.apache.org/jira/browse/HDFS-15442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199341#comment-17199341 ] Hadoop QA commented on HDFS-15442: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15582) Reduce NameNode audit log

[ https://issues.apache.org/jira/browse/HDFS-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199309#comment-17199309 ] Jinglun commented on HDFS-15582: Upload v02, fix checkstyle and whitespace. The failed tests run well on

[jira] [Updated] (HDFS-15582) Reduce NameNode audit log

[ https://issues.apache.org/jira/browse/HDFS-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15582: --- Attachment: HDFS-15582.002.patch > Reduce NameNode audit log > - > >

[jira] [Commented] (HDFS-15442) Image upload may fail if dfs.image.transfer.chunksize wrongly set to negative value

[ https://issues.apache.org/jira/browse/HDFS-15442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199299#comment-17199299 ] Hadoop QA commented on HDFS-15442: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15442) Image upload may fail if dfs.image.transfer.chunksize wrongly set to negative value

[ https://issues.apache.org/jira/browse/HDFS-15442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AMC-team updated HDFS-15442: Status: Open (was: Patch Available) > Image upload may fail if dfs.image.transfer.chunksize wrongly set

[jira] [Updated] (HDFS-15442) Image upload may fail if dfs.image.transfer.chunksize wrongly set to negative value

[ https://issues.apache.org/jira/browse/HDFS-15442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AMC-team updated HDFS-15442: Attachment: HDFS-15442.000.patch Assignee: AMC-team Status: Patch Available (was: Open) >

[jira] [Updated] (HDFS-15442) Image upload may fail if dfs.image.transfer.chunksize wrongly set to negative value

[ https://issues.apache.org/jira/browse/HDFS-15442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AMC-team updated HDFS-15442: Attachment: (was: HDFS-15442.000.patch) > Image upload may fail if dfs.image.transfer.chunksize

[jira] [Updated] (HDFS-15442) Image upload may fail if dfs.image.transfer.chunksize wrongly set to negative value

[ https://issues.apache.org/jira/browse/HDFS-15442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AMC-team updated HDFS-15442: Attachment: HDFS-15442.000.patch > Image upload may fail if dfs.image.transfer.chunksize wrongly set to

[jira] [Updated] (HDFS-15442) Image upload may fail if dfs.image.transfer.chunksize wrongly set to negative value

[ https://issues.apache.org/jira/browse/HDFS-15442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AMC-team updated HDFS-15442: Attachment: (was: HDFS-15442.000.patch) > Image upload may fail if dfs.image.transfer.chunksize

[jira] [Work logged] (HDFS-15025) Applying NVDIMM storage media to HDFS

[ https://issues.apache.org/jira/browse/HDFS-15025?focusedWorklogId=486810=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-486810 ] ASF GitHub Bot logged work on HDFS-15025: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15025) Applying NVDIMM storage media to HDFS

[ https://issues.apache.org/jira/browse/HDFS-15025?focusedWorklogId=486809=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-486809 ] ASF GitHub Bot logged work on HDFS-15025: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15025) Applying NVDIMM storage media to HDFS

[ https://issues.apache.org/jira/browse/HDFS-15025?focusedWorklogId=486806=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-486806 ] ASF GitHub Bot logged work on HDFS-15025: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

[ https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=486799=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-486799 ] ASF GitHub Bot logged work on HDFS-15548: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15557) Log the reason why a storage log file can't be deleted

[ https://issues.apache.org/jira/browse/HDFS-15557?focusedWorklogId=486780=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-486780 ] ASF GitHub Bot logged work on HDFS-15557: - Author: ASF GitHub Bot