[jira] [Commented] (HDFS-15555) RBF: Refresh cacheNS when SocketException occurs

2020-09-01 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188986#comment-17188986 ] Akira Ajisaka commented on HDFS-1: -- The following code refreshes the cache:

[jira] [Commented] (HDFS-13293) RBF: The RouterRPCServer should transfer CallerContext and client ip to NamenodeRpcServer

2020-09-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188977#comment-17188977 ] Hadoop QA commented on HDFS-13293: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Work logged] (HDFS-15554) RBF: force router check file existence in destinations before adding/updating mount points

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15554?focusedWorklogId=477610=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477610 ] ASF GitHub Bot logged work on HDFS-15554: - Author: ASF GitHub Bot

[jira] [Comment Edited] (HDFS-13293) RBF: The RouterRPCServer should transfer CallerContext and client ip to NamenodeRpcServer

2020-09-01 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188972#comment-17188972 ] Akira Ajisaka edited comment on HDFS-13293 at 9/2/20, 4:49 AM: --- Now I want

[jira] [Commented] (HDFS-13293) RBF: The RouterRPCServer should transfer CallerContext and client ip to NamenodeRpcServer

2020-09-01 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188972#comment-17188972 ] Akira Ajisaka commented on HDFS-13293: -- Now I want this feature for audit. We want to get the client

[jira] [Commented] (HDFS-15555) RBF: Refresh cacheNS when SocketException occurs

2020-09-01 Thread Janus Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188964#comment-17188964 ] Janus Chow commented on HDFS-1: --- I wonder why the new Active NN won't trigger the refresh of the

[jira] [Work logged] (HDFS-15555) RBF: Refresh cacheNS when SocketException occurs

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-1?focusedWorklogId=477601=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477601 ] ASF GitHub Bot logged work on HDFS-1: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15555) RBF: Refresh cacheNS when SocketException occurs

2020-09-01 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-1: - Status: Patch Available (was: Open) > RBF: Refresh cacheNS when SocketException occurs >

[jira] [Work logged] (HDFS-15555) RBF: Refresh cacheNS when SocketException occurs

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-1?focusedWorklogId=477598=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477598 ] ASF GitHub Bot logged work on HDFS-1: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15555) RBF: Refresh cacheNS when SocketException occurs

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-1: -- Labels: pull-request-available (was: ) > RBF: Refresh cacheNS when SocketException occurs >

[jira] [Commented] (HDFS-15555) RBF: Refresh cacheNS when SocketException occurs

2020-09-01 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188960#comment-17188960 ] Akira Ajisaka commented on HDFS-1: -- Yes, it helps. > RBF: Refresh cacheNS when SocketException

[jira] [Work logged] (HDFS-15554) RBF: force router check file existence in destinations before adding/updating mount points

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15554?focusedWorklogId=477590=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477590 ] ASF GitHub Bot logged work on HDFS-15554: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15555) RBF: Refresh cacheNS when SocketException occurs

2020-09-01 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188951#comment-17188951 ] Íñigo Goiri commented on HDFS-1: Would it help if we added SocketException to

[jira] [Updated] (HDFS-15555) RBF: Refresh cacheNS when SocketException occurs

2020-09-01 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-1: - Environment: HDFS 3.3.0, Java 11 > RBF: Refresh cacheNS when SocketException occurs >

[jira] [Commented] (HDFS-15555) RBF: Refresh cacheNS when SocketException occurs

2020-09-01 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188943#comment-17188943 ] Akira Ajisaka commented on HDFS-1: -- DFSRouter daemon log when restarting active NameNode:

[jira] [Work logged] (HDFS-15551) Tiny Improve for DeadNode detector

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15551?focusedWorklogId=477581=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477581 ] ASF GitHub Bot logged work on HDFS-15551: - Author: ASF GitHub Bot

[jira] [Created] (HDFS-15555) RBF: Refresh cacheNS when SocketException occurs

2020-09-01 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-1: Summary: RBF: Refresh cacheNS when SocketException occurs Key: HDFS-1 URL: https://issues.apache.org/jira/browse/HDFS-1 Project: Hadoop HDFS Issue

[jira] [Work logged] (HDFS-15551) Tiny Improve for DeadNode detector

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15551?focusedWorklogId=477566=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477566 ] ASF GitHub Bot logged work on HDFS-15551: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15554) RBF: force router check file existence in destinations before adding/updating mount points

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15554?focusedWorklogId=477552=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477552 ] ASF GitHub Bot logged work on HDFS-15554: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15554) RBF: force router check file existence in destinations before adding/updating mount points

2020-09-01 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-15554: -- Summary: RBF: force router check file existence in destinations before adding/updating mount points

[jira] [Commented] (HDFS-14703) NameNode Fine-Grained Locking via Metadata Partitioning

2020-09-01 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188871#comment-17188871 ] Konstantin Shvachko commented on HDFS-14703: Hey guys. Glad to hear of your interest in this

[jira] [Work logged] (HDFS-15554) RBF: force router check file existence before adding/updating mount points

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15554?focusedWorklogId=477516=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477516 ] ASF GitHub Bot logged work on HDFS-15554: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15554) RBF: force router check file existence before adding/updating mount points

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-15554: -- Labels: pull-request-available (was: ) > RBF: force router check file existence before

[jira] [Work logged] (HDFS-15554) RBF: force router check file existence before adding/updating mount points

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15554?focusedWorklogId=477488=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477488 ] ASF GitHub Bot logged work on HDFS-15554: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15554) RBF: force router check file existence before adding/updating mount points

2020-09-01 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188834#comment-17188834 ] Íñigo Goiri commented on HDFS-15554: Thanks [~fengnanli] for the JIRA, can you sync the title of the

[jira] [Updated] (HDFS-15554) RBF: force router check file existence before adding/updating mount points

2020-09-01 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HDFS-15554: -- Status: Patch Available (was: Open) > RBF: force router check file existence before adding/updating

[jira] [Created] (HDFS-15554) RBF: force router check file existence before adding/updating mount points

2020-09-01 Thread Fengnan Li (Jira)
Fengnan Li created HDFS-15554: - Summary: RBF: force router check file existence before adding/updating mount points Key: HDFS-15554 URL: https://issues.apache.org/jira/browse/HDFS-15554 Project: Hadoop

[jira] [Commented] (HDFS-15545) (S)Webhdfs will not use updated delegation tokens available in the ugi after the old ones expire

2020-09-01 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188775#comment-17188775 ] Chen Liang commented on HDFS-15545: --- Thanks for working on this [~ibuenros]! The change makes sense to

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188766#comment-17188766 ] Hadoop QA commented on HDFS-14694: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15543) RBF: Write Should allow, when a subcluster is unavailable for RANDOM mount points with fault Tolerance enabled.

2020-09-01 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188729#comment-17188729 ] Íñigo Goiri commented on HDFS-15543: Let's change the name of the method then to

[jira] [Commented] (HDFS-15543) RBF: Write Should allow, when a subcluster is unavailable for RANDOM mount points with fault Tolerance enabled.

2020-09-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188724#comment-17188724 ] Hadoop QA commented on HDFS-15543: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15543) RBF: Write Should allow, when a subcluster is unavailable for RANDOM mount points with fault Tolerance enabled.

2020-09-01 Thread Hemanth Boyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188645#comment-17188645 ] Hemanth Boyina commented on HDFS-15543: --- thanks for the review [~elgoiri] updated the patch ,

[jira] [Updated] (HDFS-15543) RBF: Write Should allow, when a subcluster is unavailable for RANDOM mount points with fault Tolerance enabled.

2020-09-01 Thread Hemanth Boyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hemanth Boyina updated HDFS-15543: -- Attachment: HDFS-15543.002.patch > RBF: Write Should allow, when a subcluster is unavailable

[jira] [Commented] (HDFS-15553) Improve NameNode RPC throughput with ReadWriteRpcCallQueue

2020-09-01 Thread Wang, Xinglong (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188628#comment-17188628 ] Wang, Xinglong commented on HDFS-15553: --- [~kihwal] Thank you for the comment. It is really helpful.

[jira] [Commented] (HDFS-13443) RBF: Update mount table cache immediately after changing (add/update/remove) mount table entries.

2020-09-01 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-13443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188607#comment-17188607 ] Íñigo Goiri commented on HDFS-13443: As discussed in parallel, adding a subcluster (a NameNode) to a

[jira] [Commented] (HDFS-15553) Improve NameNode RPC throughput with ReadWriteRpcCallQueue

2020-09-01 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188580#comment-17188580 ] Kihwal Lee commented on HDFS-15553: --- It is fine to reorder user requests in general. As [~suxingfate]

[jira] [Work logged] (HDFS-15551) Tiny Improve for DeadNode detector

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15551?focusedWorklogId=477285=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477285 ] ASF GitHub Bot logged work on HDFS-15551: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15484) Add new method batchRename for DistributedFileSystem and WebHdfsFileSystem

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15484?focusedWorklogId=477284=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477284 ] ASF GitHub Bot logged work on HDFS-15484: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15484) Add new method batchRename for DistributedFileSystem and WebHdfsFileSystem

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15484?focusedWorklogId=477282=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477282 ] ASF GitHub Bot logged work on HDFS-15484: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15484) Add new method batchRename for DistributedFileSystem and WebHdfsFileSystem

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15484?focusedWorklogId=477281=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477281 ] ASF GitHub Bot logged work on HDFS-15484: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15484) Add new method batchRename for DistributedFileSystem and WebHdfsFileSystem

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15484?focusedWorklogId=477279=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477279 ] ASF GitHub Bot logged work on HDFS-15484: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15484) Add new method batchRename for DistributedFileSystem and WebHdfsFileSystem

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15484?focusedWorklogId=477278=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477278 ] ASF GitHub Bot logged work on HDFS-15484: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-01 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14694: --- Attachment: HDFS-14694.008.patch > Call recoverLease on DFSOutputStream close exception >

[jira] [Work logged] (HDFS-15551) Tiny Improve for DeadNode detector

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15551?focusedWorklogId=477229=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477229 ] ASF GitHub Bot logged work on HDFS-15551: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15551) Tiny Improve for DeadNode detector

2020-09-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-15551: -- Labels: pull-request-available (was: ) > Tiny Improve for DeadNode detector >

[jira] [Commented] (HDFS-15553) Improve NameNode RPC throughput with ReadWriteRpcCallQueue

2020-09-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188476#comment-17188476 ] Xiaoqiao He commented on HDFS-15553: Thanks [~suxingfate] for your quick response. It makes sense to

[jira] [Commented] (HDFS-15553) Improve NameNode RPC throughput with ReadWriteRpcCallQueue

2020-09-01 Thread Wang, Xinglong (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188442#comment-17188442 ] Wang, Xinglong commented on HDFS-15553: --- Thank you for the commet [~hexiaoqiao] I think even in

[jira] [Commented] (HDFS-15553) Improve NameNode RPC throughput with ReadWriteRpcCallQueue

2020-09-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188422#comment-17188422 ] Xiaoqiao He commented on HDFS-15553: Thanks [~suxingfate] for your interesting proposal. The initial

[jira] [Updated] (HDFS-15551) Tiny Improve for DeadNode detector

2020-09-01 Thread dark_num (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dark_num updated HDFS-15551: External issue URL: https://github.com/apache/hadoop/pull/2265 > Tiny Improve for DeadNode detector >

[jira] [Commented] (HDFS-15553) Improve NameNode RPC throughput with ReadWriteRpcCallQueue

2020-09-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188406#comment-17188406 ] Xiaoqiao He commented on HDFS-15553: It seems to improve NameNode performance based on the proposal.

[jira] [Moved] (HDFS-15553) Improve NameNode RPC throughput with ReadWriteRpcCallQueue

2020-09-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He moved HADOOP-17237 to HDFS-15553: - Component/s: (was: rpc-server) namenode

[jira] [Created] (HDFS-15552) Let DeadNode Detector also work for EC cases

2020-09-01 Thread dark_num (Jira)
dark_num created HDFS-15552: --- Summary: Let DeadNode Detector also work for EC cases Key: HDFS-15552 URL: https://issues.apache.org/jira/browse/HDFS-15552 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-15551) Tiny Improve for DeadNode detector

2020-09-01 Thread dark_num (Jira)
dark_num created HDFS-15551: --- Summary: Tiny Improve for DeadNode detector Key: HDFS-15551 URL: https://issues.apache.org/jira/browse/HDFS-15551 Project: Hadoop HDFS Issue Type: Sub-task