[jira] [Commented] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218709#comment-17218709 ] Chengwei Wang commented on HDFS-15630: -- [~ferhui] [~elgoiri], thanks for comments.

[jira] [Commented] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218746#comment-17218746 ] Hadoop QA commented on HDFS-15630: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Work logged] (HDFS-15616) Disable Observer NameNode to trigger edit log roll

[ https://issues.apache.org/jira/browse/HDFS-15616?focusedWorklogId=503525=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503525 ] ASF GitHub Bot logged work on HDFS-15616: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218581#comment-17218581 ] Hadoop QA commented on HDFS-15644: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15618) Improve datanode shutdown latency

[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218578#comment-17218578 ] Hadoop QA commented on HDFS-15618: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15623) Respect configured values of rpc.engine

[ https://issues.apache.org/jira/browse/HDFS-15623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218606#comment-17218606 ] Hector Sandoval Chaverri commented on HDFS-15623: - Thanks [~shv], I can add the

[jira] [Updated] (HDFS-15616) Disable Observer NameNode to trigger edit log roll

[ https://issues.apache.org/jira/browse/HDFS-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janus Chow updated HDFS-15616: -- Attachment: HDFS-15616.003.patch > Disable Observer NameNode to trigger edit log roll >

[jira] [Updated] (HDFS-15616) Disable Observer NameNode to trigger edit log roll

[ https://issues.apache.org/jira/browse/HDFS-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janus Chow updated HDFS-15616: -- Summary: Disable Observer NameNode to trigger edit log roll (was: [SBN] Disable Observers to trigger

[jira] [Work logged] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

[ https://issues.apache.org/jira/browse/HDFS-15624?focusedWorklogId=503471=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503471 ] ASF GitHub Bot logged work on HDFS-15624: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

[ https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=503431=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503431 ] ASF GitHub Bot logged work on HDFS-15548: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengwei Wang updated HDFS-15630: - Attachment: HDFS-15630.006.patch > RBF: Fix wrong client IP info in CallerContext when requests

[jira] [Commented] (HDFS-15622) Deleted blocks linger in the replications queue

[ https://issues.apache.org/jira/browse/HDFS-15622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218484#comment-17218484 ] Hadoop QA commented on HDFS-15622: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15553) Improve NameNode RPC throughput with ReadWriteRpcCallQueue

[ https://issues.apache.org/jira/browse/HDFS-15553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218440#comment-17218440 ] Xiaoyu Yao commented on HDFS-15553: --- bq. Do you see the queue overflow message in the NN log? The fixed

[jira] [Comment Edited] (HDFS-15553) Improve NameNode RPC throughput with ReadWriteRpcCallQueue

[ https://issues.apache.org/jira/browse/HDFS-15553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218440#comment-17218440 ] Xiaoyu Yao edited comment on HDFS-15553 at 10/21/20, 5:32 PM: -- bq. Do you

[jira] [Work logged] (HDFS-15616) [SBN] Disable Observers to trigger edit log roll

[ https://issues.apache.org/jira/browse/HDFS-15616?focusedWorklogId=503346=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503346 ] ASF GitHub Bot logged work on HDFS-15616: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218512#comment-17218512 ] Íñigo Goiri commented on HDFS-15630: Agreed, this looks clear. Can we make the javadoc in

[jira] [Commented] (HDFS-15623) Respect configured values of rpc.engine

[ https://issues.apache.org/jira/browse/HDFS-15623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218558#comment-17218558 ] Konstantin Shvachko commented on HDFS-15623: IIUC {{NameNodeRpcServer}} breaks plugability of

[jira] [Commented] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218141#comment-17218141 ] Jinglun commented on HDFS-15640: Hi [~linyiqun], thanks your nice comments ! During the final distcp

[jira] [Commented] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218221#comment-17218221 ] Yiqun Lin commented on HDFS-15640: -- {quote} Only a little problem is it might not be easy to know how

[jira] [Commented] (HDFS-15618) Improve datanode shutdown latency

[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218127#comment-17218127 ] Kihwal Lee commented on HDFS-15618: --- I've committed this to trunk, but the patch does not work in

[jira] [Updated] (HDFS-15618) Improve datanode shutdown latency

[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-15618: -- Fix Version/s: 3.4.0 > Improve datanode shutdown latency > - > >

[jira] [Commented] (HDFS-15459) TestBlockTokenWithDFSStriped fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218329#comment-17218329 ] Ahmed Hussein commented on HDFS-15459: -- {quote}  For the fix itself, the other option would be for

[jira] [Commented] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218324#comment-17218324 ] Hui Fei commented on HDFS-15630: [^HDFS-15630.005.patch] looks good. It is much clear and simple. Good

[jira] [Work logged] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

[ https://issues.apache.org/jira/browse/HDFS-15624?focusedWorklogId=503248=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-503248 ] ASF GitHub Bot logged work on HDFS-15624: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15616) [SBN] Disable Observers to trigger edit log roll

[ https://issues.apache.org/jira/browse/HDFS-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janus Chow updated HDFS-15616: -- Attachment: HDFS-15616.002.patch > [SBN] Disable Observers to trigger edit log roll >

[jira] [Commented] (HDFS-15616) [SBN] Disable Observers to trigger edit log roll

[ https://issues.apache.org/jira/browse/HDFS-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218211#comment-17218211 ] Janus Chow commented on HDFS-15616: --- Updated a new patch with unit tests. > [SBN] Disable Observers to

[jira] [Updated] (HDFS-15622) Deleted blocks linger in the replications queue

[ https://issues.apache.org/jira/browse/HDFS-15622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15622: - Attachment: HDFS-15622.002.patch > Deleted blocks linger in the replications queue >

[jira] [Commented] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218259#comment-17218259 ] Jinglun commented on HDFS-15640: Hi [~linyiqun], thanks your nice comments and clear explanation !  I

[jira] [Updated] (HDFS-15645) DatanodeManager.getNumOfDataNodes should consider the include set of host config.

[ https://issues.apache.org/jira/browse/HDFS-15645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15645: --- Attachment: HDFS-15645.001.patch Status: Patch Available (was: Open) >

[jira] [Created] (HDFS-15645) DatanodeManager.getNumOfDataNodes should consider the include set of host config.

Jinglun created HDFS-15645: -- Summary: DatanodeManager.getNumOfDataNodes should consider the include set of host config. Key: HDFS-15645 URL: https://issues.apache.org/jira/browse/HDFS-15645 Project: Hadoop

[jira] [Commented] (HDFS-15645) DatanodeManager.getNumOfDataNodes should consider the include set of host config.

[ https://issues.apache.org/jira/browse/HDFS-15645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218274#comment-17218274 ] Jinglun commented on HDFS-15645: Hi [~knanasi] [~hexiaoqiao] [~leosun08] , do you have time to take a

[jira] [Comment Edited] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218255#comment-17218255 ] Chengwei Wang edited comment on HDFS-15630 at 10/21/20, 12:00 PM: --

[jira] [Updated] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15640: --- Attachment: HDFS-15640.002.patch > RBF: Add fast distcp threshold to FedBalance. >

[jira] [Updated] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15640: --- Attachment: (was: HDFS-15640.002.patch) > RBF: Add fast distcp threshold to FedBalance. >

[jira] [Updated] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15640: --- Attachment: HDFS-15640.002.patch > RBF: Add fast distcp threshold to FedBalance. >

[jira] [Assigned] (HDFS-15645) DatanodeManager.getNumOfDataNodes should consider the include set of host config.

[ https://issues.apache.org/jira/browse/HDFS-15645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reassigned HDFS-15645: -- Assignee: Jinglun > DatanodeManager.getNumOfDataNodes should consider the include set of host >

[jira] [Commented] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218287#comment-17218287 ] Hadoop QA commented on HDFS-15630: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218293#comment-17218293 ] Hadoop QA commented on HDFS-15640: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengwei Wang updated HDFS-15630: - Attachment: HDFS-15630.005.patch > RBF: Fix wrong client IP info in CallerContext when requests

[jira] [Commented] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218255#comment-17218255 ] Chengwei Wang commented on HDFS-15630: -- [~elgoiri] [~ferhui], Thanks for comments. After careful

[jira] [Updated] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15644: - Attachment: HDFS-15644.002.patch > Failed volumes can cause DNs to stop block reporting >

[jira] [Commented] (HDFS-15618) Improve datanode shutdown latency

[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218375#comment-17218375 ] Ahmed Hussein commented on HDFS-15618: -- [~kihwal], HDFS-15618.004.patch can be applied to

[jira] [Commented] (HDFS-15645) DatanodeManager.getNumOfDataNodes should consider the include set of host config.

[ https://issues.apache.org/jira/browse/HDFS-15645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218379#comment-17218379 ] Hadoop QA commented on HDFS-15645: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15618) Improve datanode shutdown latency

[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15618: - Attachment: HDFS-15618-branch-3.3.004.patch > Improve datanode shutdown latency >

[jira] [Commented] (HDFS-15618) Improve datanode shutdown latency

[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218362#comment-17218362 ] Ahmed Hussein commented on HDFS-15618: -- Oh! that's because HADOOP-17288. Moving forward, all patches