[jira] [Commented] (HDFS-16045) FileSystem.CACHE memory leak

2021-05-27 Thread Xiangyi Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352937#comment-17352937 ] Xiangyi Zhu commented on HDFS-16045: [~hexiaoqiao]  Thank you very much for your comment. Presto uses

[jira] [Updated] (HDFS-16040) RpcQueueTime metric counts requeued calls as unique events.

2021-05-27 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-16040: --- Fix Version/s: 3.3.2 3.2.3 2.10.2

[jira] [Commented] (HDFS-16046) TestBalanceProcedureScheduler timeouts

2021-05-27 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352931#comment-17352931 ] Akira Ajisaka commented on HDFS-16046: -- !screenshot-1.png! After extending the timeout, it passed

[jira] [Updated] (HDFS-16046) TestBalanceProcedureScheduler timeouts

2021-05-27 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-16046: - Attachment: screenshot-1.png > TestBalanceProcedureScheduler timeouts >

[jira] [Commented] (HDFS-16046) TestBalanceProcedureScheduler timeouts

2021-05-27 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352929#comment-17352929 ] Akira Ajisaka commented on HDFS-16046: -- !image-2021-05-28-11-41-16-733.png! I ran the test from

[jira] [Updated] (HDFS-16046) TestBalanceProcedureScheduler timeouts

2021-05-27 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-16046: - Attachment: image-2021-05-28-11-41-16-733.png > TestBalanceProcedureScheduler timeouts >

[jira] [Work logged] (HDFS-13729) Fix broken links to RBF documentation

2021-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13729?focusedWorklogId=603374=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-603374 ] ASF GitHub Bot logged work on HDFS-13729: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-13729) Fix broken links to RBF documentation

2021-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13729?focusedWorklogId=603373=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-603373 ] ASF GitHub Bot logged work on HDFS-13729: - Author: ASF GitHub Bot

[jira] [Created] (HDFS-16046) TestBalanceProcedureScheduler timeouts

2021-05-27 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-16046: Summary: TestBalanceProcedureScheduler timeouts Key: HDFS-16046 URL: https://issues.apache.org/jira/browse/HDFS-16046 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-16040) RpcQueueTime metric counts requeued calls as unique events.

2021-05-27 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352920#comment-17352920 ] Konstantin Shvachko commented on HDFS-16040: Wow - clean build. Adding my +1 to that. Will

[jira] [Updated] (HDFS-15946) Fix java doc in FSPermissionChecker

2021-05-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15946: Issue Type: Improvement (was: Wish) > Fix java doc in FSPermissionChecker >

[jira] [Resolved] (HDFS-15946) Fix java doc in FSPermissionChecker

2021-05-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-15946. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix java doc in

[jira] [Resolved] (HDFS-16002) TestJournalNodeRespectsBindHostKeys#testHttpsBindHostKey very flaky

2021-05-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-16002. - Resolution: Duplicate Was broken by HADOOP-16524 and now fixed as an Addendum there itself. >

[jira] [Commented] (HDFS-15915) Race condition with async edits logging due to updating txId outside of the namesystem log

2021-05-27 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352653#comment-17352653 ] Konstantin Shvachko commented on HDFS-15915: [~daryn] would appreciate your review. > Race

[jira] [Commented] (HDFS-15915) Race condition with async edits logging due to updating txId outside of the namesystem log

2021-05-27 Thread Daryn Sharp (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352565#comment-17352565 ] Daryn Sharp commented on HDFS-15915: I'm very nervous about this patch and need to thoroughly

[jira] [Work logged] (HDFS-13522) RBF: Support observer node from Router-Based Federation

2021-05-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?focusedWorklogId=603055=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-603055 ] ASF GitHub Bot logged work on HDFS-13522: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16042) DatanodeAdminMonitor scan should be delay based

2021-05-27 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352535#comment-17352535 ] Ahmed Hussein commented on HDFS-16042: -- Hey [~Jim_Brennan], can you please take a look at [GitHub

[jira] [Commented] (HDFS-16045) FileSystem.CACHE memory leak

2021-05-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352527#comment-17352527 ] Xiaoqiao He commented on HDFS-16045: Thanks [~zhuxiangyi] raise this issue here. I think it could be

[jira] [Commented] (HDFS-15714) HDFS Provided Storage Read/Write Mount Support On-the-fly

2021-05-27 Thread Bhavik Patel (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352466#comment-17352466 ] Bhavik Patel commented on HDFS-15714: - [~PhiloHe] "metadata wrapped in remote file status, like

[jira] [Created] (HDFS-16045) FileSystem.CACHE memory leak

2021-05-27 Thread Xiangyi Zhu (Jira)
Xiangyi Zhu created HDFS-16045: -- Summary: FileSystem.CACHE memory leak Key: HDFS-16045 URL: https://issues.apache.org/jira/browse/HDFS-16045 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-05-27 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-16044: - Description: In production cluster when call getListing very frequent. The processing time of rpc request is

[jira] [Updated] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-05-27 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-16044: - Description: In production cluster when call getListing very frequent. The processing time of rpc request is

[jira] [Updated] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-05-27 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-16044: - Attachment: HDFS-16044.00.patch > getListing call getLocatedBlocks even source is a directory >

[jira] [Commented] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-05-27 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352349#comment-17352349 ] ludun commented on HDFS-16044: -- [~brahma] if you have time, please check this issue > getListing call

[jira] [Commented] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-05-27 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352348#comment-17352348 ] ludun commented on HDFS-16044: -- after check code, the getLocatedBlocks is called in

[jira] [Created] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-05-27 Thread ludun (Jira)
ludun created HDFS-16044: Summary: getListing call getLocatedBlocks even source is a directory Key: HDFS-16044 URL: https://issues.apache.org/jira/browse/HDFS-16044 Project: Hadoop HDFS Issue Type:

[jira] [Assigned] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-05-27 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun reassigned HDFS-16044: Assignee: ludun > getListing call getLocatedBlocks even source is a directory >

[jira] [Updated] (HDFS-16043) HDFS : Delete performance optimization

2021-05-27 Thread Xiangyi Zhu (Jira)
Zhu >Priority: Major > Attachments: 20210527-after.svg, 20210527-before.svg > > > The deletion of the large directory caused NN to hold the lock for too long, > which caused our NameNode to be killed by ZKFC. > Through the flame graph, it is found that its