[jira] [Updated] (HDFS-16073) Remove redundant RPC requests for getFileLinkInfo in ClientNamenodeProtocolTranslatorPB

2021-06-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-16073: Status: Patch Available (was: Open) > Remove redundant RPC requests for getFileLinkInfo in >

[jira] [Commented] (HDFS-16073) Remove redundant RPC requests for getFileLinkInfo in ClientNamenodeProtocolTranslatorPB

2021-06-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364053#comment-17364053 ] Ayush Saxena commented on HDFS-16073: - Yes, if it is redundant. We can get rid of it > Remove

[jira] [Commented] (HDFS-16073) Remove redundant RPC requests for getFileLinkInfo in ClientNamenodeProtocolTranslatorPB

2021-06-15 Thread lei w (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364049#comment-17364049 ] lei w commented on HDFS-16073: --  [~hexiaoqiao],  [~ayushsaxena], [~zhuqi] anyone have any suggestions? >

[jira] [Updated] (HDFS-16073) Remove redundant RPC requests for getFileLinkInfo in ClientNamenodeProtocolTranslatorPB

2021-06-15 Thread lei w (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lei w updated HDFS-16073: - Attachment: HDFS-16073.patch > Remove redundant RPC requests for getFileLinkInfo in >

[jira] [Created] (HDFS-16073) Remove redundant RPC requests for getFileLinkInfo in ClientNamenodeProtocolTranslatorPB

2021-06-15 Thread lei w (Jira)
lei w created HDFS-16073: Summary: Remove redundant RPC requests for getFileLinkInfo in ClientNamenodeProtocolTranslatorPB Key: HDFS-16073 URL: https://issues.apache.org/jira/browse/HDFS-16073 Project:

[jira] [Commented] (HDFS-15963) Unreleased volume references cause an infinite loop

2021-06-15 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364000#comment-17364000 ] Kihwal Lee commented on HDFS-15963: --- We hit this in 2.10 recently. I've cherry-picked it to branch-2.10

[jira] [Updated] (HDFS-15963) Unreleased volume references cause an infinite loop

2021-06-15 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-15963: -- Fix Version/s: 2.10.2 > Unreleased volume references cause an infinite loop >

[jira] [Commented] (HDFS-16067) Support Append API in NNThroughputBenchmark

2021-06-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363993#comment-17363993 ] Hadoop QA commented on HDFS-16067: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15150) Introduce read write lock to Datanode

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363926#comment-17363926 ] Ahmed Hussein commented on HDFS-15150: -- {quote}Are the above changes intentional? They seem to be

[jira] [Commented] (HDFS-15150) Introduce read write lock to Datanode

2021-06-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363921#comment-17363921 ] Hadoop QA commented on HDFS-15150: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15618) Improve datanode shutdown latency

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363910#comment-17363910 ] Ahmed Hussein commented on HDFS-15618: -- spotbugs errors can be ignored. Later, some suppress jiras

[jira] [Work logged] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?focusedWorklogId=611590=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-611590 ] ASF GitHub Bot logged work on HDFS-13671: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?focusedWorklogId=611588=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-611588 ] ASF GitHub Bot logged work on HDFS-13671: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15618) Improve datanode shutdown latency

2021-06-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363892#comment-17363892 ] Hadoop QA commented on HDFS-15618: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-16067) Support Append API in NNThroughputBenchmark

2021-06-15 Thread Renukaprasad C (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renukaprasad C updated HDFS-16067: -- Attachment: HDFS-16067.001.patch Status: Patch Available (was: Open) > Support Append

[jira] [Updated] (HDFS-15150) Introduce read write lock to Datanode

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15150: - Attachment: HDFS-15150-branch-2.10.003.patch > Introduce read write lock to Datanode >

[jira] [Updated] (HDFS-15618) Improve datanode shutdown latency

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15618: - Attachment: HDFS-15618-branch-2.10.003.patch > Improve datanode shutdown latency >

[jira] [Commented] (HDFS-16072) TestBlockRecovery fails consistently on Branch-2.10

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363814#comment-17363814 ] Ahmed Hussein commented on HDFS-16072: -- [~vjasani] Since you worked on HDFS-15940, Do you know if

[jira] [Commented] (HDFS-15150) Introduce read write lock to Datanode

2021-06-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363813#comment-17363813 ] Hadoop QA commented on HDFS-15150: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-16072) TestBlockRecovery fails consistently on Branch-2.10

2021-06-15 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HDFS-16072: Summary: TestBlockRecovery fails consistently on Branch-2.10 Key: HDFS-16072 URL: https://issues.apache.org/jira/browse/HDFS-16072 Project: Hadoop HDFS

[jira] [Updated] (HDFS-16071) TestJournalNodeRespectsBindHostKeys fails consistently on branch-2.10

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-16071: - Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) >

[jira] [Work logged] (HDFS-16070) DataTransfer block storm when datanode's io is busy.

2021-06-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16070?focusedWorklogId=611489=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-611489 ] ASF GitHub Bot logged work on HDFS-16070: - Author: ASF GitHub Bot

[jira] [Created] (HDFS-16071) TestJournalNodeRespectsBindHostKeys fails consistently on branch-2.10

2021-06-15 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HDFS-16071: Summary: TestJournalNodeRespectsBindHostKeys fails consistently on branch-2.10 Key: HDFS-16071 URL: https://issues.apache.org/jira/browse/HDFS-16071 Project: Hadoop

[jira] [Work logged] (HDFS-16070) DataTransfer block storm when datanode's io is busy.

2021-06-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16070?focusedWorklogId=611465=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-611465 ] ASF GitHub Bot logged work on HDFS-16070: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16065) RBF: Add metrics to record Router's operations

2021-06-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16065?focusedWorklogId=611466=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-611466 ] ASF GitHub Bot logged work on HDFS-16065: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15618) Improve datanode shutdown latency

2021-06-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363765#comment-17363765 ] Hadoop QA commented on HDFS-15618: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15940) Some tests in TestBlockRecovery are consistently failing

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15940: - Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) > Some tests in TestBlockRecovery

[jira] [Commented] (HDFS-15940) Some tests in TestBlockRecovery are consistently failing

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363698#comment-17363698 ] Ahmed Hussein commented on HDFS-15940: -- Thanks [~vjasani] and [~ayushtkn] for fixing the failures in

[jira] [Commented] (HDFS-15150) Introduce read write lock to Datanode

2021-06-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363696#comment-17363696 ] Stephen O'Donnell commented on HDFS-15150: -- [~ahussein] Thanks for backporting this to 2.10. I

[jira] [Commented] (HDFS-15618) Improve datanode shutdown latency

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363692#comment-17363692 ] Ahmed Hussein commented on HDFS-15618: -- Submitted [^HDFS-15618-branch-2.10.002.patch] to fix the

[jira] [Updated] (HDFS-15618) Improve datanode shutdown latency

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15618: - Attachment: HDFS-15618-branch-2.10.002.patch > Improve datanode shutdown latency >

[jira] [Work logged] (HDFS-16065) RBF: Add metrics to record Router's operations

2021-06-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16065?focusedWorklogId=611366=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-611366 ] ASF GitHub Bot logged work on HDFS-16065: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15150) Introduce read write lock to Datanode

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363677#comment-17363677 ] Ahmed Hussein commented on HDFS-15150: -- I uploaded to fix the two spotbugs errors

[jira] [Updated] (HDFS-15150) Introduce read write lock to Datanode

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15150: - Attachment: HDFS-15150-branch-2.10.002.patch > Introduce read write lock to Datanode >

[jira] [Work logged] (HDFS-16070) DataTransfer block storm when datanode's io is busy.

2021-06-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16070?focusedWorklogId=611284=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-611284 ] ASF GitHub Bot logged work on HDFS-16070: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16070) DataTransfer block storm when datanode's io is busy.

2021-06-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16070?focusedWorklogId=611270=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-611270 ] ASF GitHub Bot logged work on HDFS-16070: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16070) DataTransfer block storm when datanode's io is busy.

2021-06-15 Thread zhengchenyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengchenyu updated HDFS-16070: --- Description: When I speed up the decommission, I found that some datanode's io is busy, then I

[jira] [Work logged] (HDFS-16070) DataTransfer block storm when datanode's io is busy.

2021-06-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16070?focusedWorklogId=611266=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-611266 ] ASF GitHub Bot logged work on HDFS-16070: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16070) DataTransfer block storm when datanode's io is busy.

2021-06-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16070?focusedWorklogId=611259=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-611259 ] ASF GitHub Bot logged work on HDFS-16070: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16070) DataTransfer block storm when datanode's io is busy.

2021-06-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16070?focusedWorklogId=611257=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-611257 ] ASF GitHub Bot logged work on HDFS-16070: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16070) DataTransfer block storm when datanode's io is busy.

2021-06-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16070?focusedWorklogId=611255=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-611255 ] ASF GitHub Bot logged work on HDFS-16070: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13671?focusedWorklogId=611195=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-611195 ] ASF GitHub Bot logged work on HDFS-13671: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16070) DataTransfer block storm when datanode's io is busy.

2021-06-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16070?focusedWorklogId=611192=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-611192 ] ASF GitHub Bot logged work on HDFS-16070: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16068) WebHdfsFileSystem has a possible connection leak in connection with HttpFS

2021-06-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16068: Fix Version/s: 3.3.2 3.2.3 2.10.2 >

[jira] [Work logged] (HDFS-16068) WebHdfsFileSystem has a possible connection leak in connection with HttpFS

2021-06-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16068?focusedWorklogId=611185=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-611185 ] ASF GitHub Bot logged work on HDFS-16068: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16068) WebHdfsFileSystem has a possible connection leak in connection with HttpFS

2021-06-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16068?focusedWorklogId=611179=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-611179 ] ASF GitHub Bot logged work on HDFS-16068: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16068) WebHdfsFileSystem has a possible connection leak in connection with HttpFS

2021-06-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16068?focusedWorklogId=611177=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-611177 ] ASF GitHub Bot logged work on HDFS-16068: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16068) WebHdfsFileSystem has a possible connection leak in connection with HttpFS

2021-06-15 Thread Hemanth Boyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hemanth Boyina updated HDFS-16068: -- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Updated] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2021-06-15 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HDFS-16016: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: