[jira] [Work logged] (HDFS-15616) [SBN] Disable Observers to trigger edit log roll

[ https://issues.apache.org/jira/browse/HDFS-15616?focusedWorklogId=497774=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-497774 ] ASF GitHub Bot logged work on HDFS-15616: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

[ https://issues.apache.org/jira/browse/HDFS-15620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15620: - Parent: HDFS-14603 Issue Type: Sub-task (was: Bug) > RBF: Fix test failures after

[jira] [Commented] (HDFS-7343) HDFS smart storage management

[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17210639#comment-17210639 ] Feilong He commented on HDFS-7343: -- Hi Brahma, currently we have no plan to merge this feature to

[jira] [Created] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

Akira Ajisaka created HDFS-15620: Summary: RBF: Fix test failures after HADOOP-17281 Key: HDFS-15620 URL: https://issues.apache.org/jira/browse/HDFS-15620 Project: Hadoop HDFS Issue Type:

[jira] [Work logged] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

[ https://issues.apache.org/jira/browse/HDFS-15620?focusedWorklogId=497919=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-497919 ] ASF GitHub Bot logged work on HDFS-15620: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

[ https://issues.apache.org/jira/browse/HDFS-15620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211122#comment-17211122 ] Steve Loughran commented on HDFS-15620: --- aah, sorry. We'd deliberately added a blank line in the

[jira] [Created] (HDFS-15623) Respect configured values of rpc.engine

Hector Sandoval Chaverri created HDFS-15623: --- Summary: Respect configured values of rpc.engine Key: HDFS-15623 URL: https://issues.apache.org/jira/browse/HDFS-15623 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-15601) Batch listing: gracefully fallback to use non-batched listing when NameNode doesn't support the feature

[ https://issues.apache.org/jira/browse/HDFS-15601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu reassigned HDFS-15601: --- Assignee: (was: Aihua Xu) > Batch listing: gracefully fallback to use non-batched listing when

[jira] [Commented] (HDFS-15601) Batch listing: gracefully fallback to use non-batched listing when NameNode doesn't support the feature

[ https://issues.apache.org/jira/browse/HDFS-15601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211161#comment-17211161 ] Aihua Xu commented on HDFS-15601: - Seems I won't have time to work on this. Assign back. > Batch

[jira] [Work logged] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

[ https://issues.apache.org/jira/browse/HDFS-15620?focusedWorklogId=498639=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498639 ] ASF GitHub Bot logged work on HDFS-15620: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15618) Improve datanode shutdown latency

[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211241#comment-17211241 ] Hadoop QA commented on HDFS-15618: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15622) Deleted blocks linger in the replications queue

[ https://issues.apache.org/jira/browse/HDFS-15622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15622: - Attachment: HDFS-15622.001.patch Status: Patch Available (was: In Progress) > Deleted

[jira] [Work started] (HDFS-15622) Deleted blocks linger in the replications queue

[ https://issues.apache.org/jira/browse/HDFS-15622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15622 started by Ahmed Hussein. > Deleted blocks linger in the replications queue >

[jira] [Commented] (HDFS-15622) Deleted blocks linger in the replications queue

[ https://issues.apache.org/jira/browse/HDFS-15622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211500#comment-17211500 ] Hadoop QA commented on HDFS-15622: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15468) Active namenode crashed when no edit recover

[ https://issues.apache.org/jira/browse/HDFS-15468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211561#comment-17211561 ] Ayush Saxena commented on HDFS-15468: - Thanx [~kpalanisamy] for the report. Not sure it is related to

[jira] [Created] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

YaYun Wang created HDFS-15624: - Summary: Fix the SetQuotaByStorageTypeOp problem after updating hadoop Key: HDFS-15624 URL: https://issues.apache.org/jira/browse/HDFS-15624 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-15468) Active namenode crashed when no edit recover

[ https://issues.apache.org/jira/browse/HDFS-15468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211561#comment-17211561 ] Ayush Saxena edited comment on HDFS-15468 at 10/10/20, 5:50 AM: Thanx

[jira] [Updated] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

[ https://issues.apache.org/jira/browse/HDFS-15620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15620: - Target Version/s: 3.3.1, 3.4.0 > RBF: Fix test failures after HADOOP-17281 >

[jira] [Commented] (HDFS-13293) RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer

[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17210722#comment-17210722 ] Hui Fei commented on HDFS-13293: Merged. [~maobaolong] Thanks for report, [~aajisaka] [~elgoiri] Thanks

[jira] [Updated] (HDFS-13293) RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer

[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-13293: --- Fix Version/s: 3.4. Resolution: Fixed Status: Resolved (was: Patch Available) > RBF: The

[jira] [Updated] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

[ https://issues.apache.org/jira/browse/HDFS-15620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-15620: -- Labels: pull-request-available (was: ) > RBF: Fix test failures after HADOOP-17281 >

[jira] [Work logged] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

[ https://issues.apache.org/jira/browse/HDFS-15620?focusedWorklogId=497860=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-497860 ] ASF GitHub Bot logged work on HDFS-15620: - Author: ASF GitHub Bot

[jira] [Assigned] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

[ https://issues.apache.org/jira/browse/HDFS-15620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned HDFS-15620: Assignee: Akira Ajisaka > RBF: Fix test failures after HADOOP-17281 >

[jira] [Work logged] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

[ https://issues.apache.org/jira/browse/HDFS-15614?focusedWorklogId=497874=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-497874 ] ASF GitHub Bot logged work on HDFS-15614: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

[ https://issues.apache.org/jira/browse/HDFS-15614?focusedWorklogId=497873=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-497873 ] ASF GitHub Bot logged work on HDFS-15614: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-13293) RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer

[ https://issues.apache.org/jira/browse/HDFS-13293?focusedWorklogId=497810=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-497810 ] ASF GitHub Bot logged work on HDFS-13293: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-13293) RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer

[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-13293: --- Fix Version/s: (was: 3.4.) 3.4.0 > RBF: The RouterRPCServer should transfer client IP

[jira] [Work logged] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

[ https://issues.apache.org/jira/browse/HDFS-15620?focusedWorklogId=498418=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498418 ] ASF GitHub Bot logged work on HDFS-15620: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-13293) RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer

[ https://issues.apache.org/jira/browse/HDFS-13293?focusedWorklogId=498005=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498005 ] ASF GitHub Bot logged work on HDFS-13293: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-13293) RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer

[ https://issues.apache.org/jira/browse/HDFS-13293?focusedWorklogId=498088=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498088 ] ASF GitHub Bot logged work on HDFS-13293: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15610) Reduce datanode upgrade/hardlink thread

[ https://issues.apache.org/jira/browse/HDFS-15610?focusedWorklogId=498226=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498226 ] ASF GitHub Bot logged work on HDFS-15610: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

[ https://issues.apache.org/jira/browse/HDFS-15614?focusedWorklogId=498264=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498264 ] ASF GitHub Bot logged work on HDFS-15614: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-13293) RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer

[ https://issues.apache.org/jira/browse/HDFS-13293?focusedWorklogId=498284=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498284 ] ASF GitHub Bot logged work on HDFS-13293: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15616) [SBN] Disable Observers to trigger edit log roll

[ https://issues.apache.org/jira/browse/HDFS-15616?focusedWorklogId=498365=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498365 ] ASF GitHub Bot logged work on HDFS-15616: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

[ https://issues.apache.org/jira/browse/HDFS-15614?focusedWorklogId=498029=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498029 ] ASF GitHub Bot logged work on HDFS-15614: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-13293) RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer

[ https://issues.apache.org/jira/browse/HDFS-13293?focusedWorklogId=498034=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498034 ] ASF GitHub Bot logged work on HDFS-13293: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15610) Reduce datanode upgrade/hardlink thread

[ https://issues.apache.org/jira/browse/HDFS-15610?focusedWorklogId=498258=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498258 ] ASF GitHub Bot logged work on HDFS-15610: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-13293) RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer

[ https://issues.apache.org/jira/browse/HDFS-13293?focusedWorklogId=498313=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498313 ] ASF GitHub Bot logged work on HDFS-13293: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

[ https://issues.apache.org/jira/browse/HDFS-15614?focusedWorklogId=498316=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498316 ] ASF GitHub Bot logged work on HDFS-15614: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15616) [SBN] Disable Observers to trigger edit log roll

[ https://issues.apache.org/jira/browse/HDFS-15616?focusedWorklogId=498401=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498401 ] ASF GitHub Bot logged work on HDFS-15616: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15621) Datanode DirectoryScanner uses excessive memory

[ https://issues.apache.org/jira/browse/HDFS-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211086#comment-17211086 ] Stephen O'Donnell commented on HDFS-15621: -- [~belugabehr] That is a good idea. I wonder if it

[jira] [Work logged] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

[ https://issues.apache.org/jira/browse/HDFS-15614?focusedWorklogId=498500=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498500 ] ASF GitHub Bot logged work on HDFS-15614: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15621) Datanode DirectoryScanner uses excessive memory

[ https://issues.apache.org/jira/browse/HDFS-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15621: - Attachment: Screenshot 2020-10-09 at 14.11.36.png > Datanode DirectoryScanner uses

[jira] [Created] (HDFS-15621) Datanode DirectoryScanner uses excessive memory

Stephen O'Donnell created HDFS-15621: Summary: Datanode DirectoryScanner uses excessive memory Key: HDFS-15621 URL: https://issues.apache.org/jira/browse/HDFS-15621 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15618) Improve datanode shutdown latency

[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211046#comment-17211046 ] Ahmed Hussein commented on HDFS-15618: -- I added a configuration key

[jira] [Updated] (HDFS-15621) Datanode DirectoryScanner uses excessive memory

[ https://issues.apache.org/jira/browse/HDFS-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15621: - Attachment: Screenshot 2020-10-09 at 15.20.56.png > Datanode DirectoryScanner uses

[jira] [Comment Edited] (HDFS-15618) Improve datanode shutdown latency

[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211046#comment-17211046 ] Ahmed Hussein edited comment on HDFS-15618 at 10/9/20, 2:23 PM: I added a

[jira] [Created] (HDFS-15622) Deleted blocks linger in the replications queue

Ahmed Hussein created HDFS-15622: Summary: Deleted blocks linger in the replications queue Key: HDFS-15622 URL: https://issues.apache.org/jira/browse/HDFS-15622 Project: Hadoop HDFS Issue

[jira] [Work logged] (HDFS-15620) RBF: Fix test failures after HADOOP-17281

[ https://issues.apache.org/jira/browse/HDFS-15620?focusedWorklogId=498555=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-498555 ] ASF GitHub Bot logged work on HDFS-15620: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15618) Improve datanode shutdown latency

[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15618: - Status: Patch Available (was: In Progress) > Improve datanode shutdown latency >

[jira] [Commented] (HDFS-15621) Datanode DirectoryScanner uses excessive memory

[ https://issues.apache.org/jira/browse/HDFS-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211069#comment-17211069 ] David Mollitor commented on HDFS-15621: --- Another option would be to multi-thread the operation and