[jira] [Commented] (HDFS-16262) Async refresh of cached locations in DFSInputStream

2021-10-10 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426826#comment-17426826 ] Ahmed Hussein commented on HDFS-16262: -- Thanks [~bbeaudreault] for working on the asynchronous

[jira] [Updated] (HDFS-16207) Remove NN logs stack trace for non-existent xattr query

2021-09-09 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-16207: - Attachment: HDFS-16207-branch-2.10.001.patch Status: Patch Available (was: In Progress)

[jira] [Commented] (HDFS-16207) Remove NN logs stack trace for non-existent xattr query

2021-09-09 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412574#comment-17412574 ] Ahmed Hussein commented on HDFS-16207: -- Thanks [~cnauroth]! I will upload a separate patch for

[jira] [Commented] (HDFS-16207) Remove NN logs stack trace for non-existent xattr query

2021-09-08 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412120#comment-17412120 ] Ahmed Hussein commented on HDFS-16207: -- I am fine with merging the changes. Thanks [~cnauroth] for

[jira] [Commented] (HDFS-16207) Remove NN logs stack trace for non-existent xattr query

2021-09-07 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411293#comment-17411293 ] Ahmed Hussein commented on HDFS-16207: -- I submitted a PR to suppress the stack by: # created a new

[jira] [Work started] (HDFS-16207) Remove NN logs stack trace for non-existent xattr query

2021-09-02 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16207 started by Ahmed Hussein. > Remove NN logs stack trace for non-existent xattr query >

[jira] [Created] (HDFS-16207) Remove NN logs stack trace for non-existent xattr query

2021-09-02 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HDFS-16207: Summary: Remove NN logs stack trace for non-existent xattr query Key: HDFS-16207 URL: https://issues.apache.org/jira/browse/HDFS-16207 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15979) Move within EZ fails and cannot remove nested EZs

2021-08-31 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17407375#comment-17407375 ] Ahmed Hussein commented on HDFS-15979: -- Hi [~weichiu], Are you okay with the changes in this Jira?

[jira] [Commented] (HDFS-12188) TestDecommissioningStatus#testDecommissionStatus fails intermittently

2021-08-23 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403275#comment-17403275 ] Ahmed Hussein commented on HDFS-12188: -- Thanks [~vjasani]. I marked this issue as fixed by

[jira] [Resolved] (HDFS-12188) TestDecommissioningStatus#testDecommissionStatus fails intermittently

2021-08-23 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein resolved HDFS-12188. -- Resolution: Fixed > TestDecommissioningStatus#testDecommissionStatus fails intermittently >

[jira] [Commented] (HDFS-12188) TestDecommissioningStatus#testDecommissionStatus fails intermittently

2021-08-12 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17398191#comment-17398191 ] Ahmed Hussein commented on HDFS-12188: -- Thanks [~vjasani]! I am looking forward to seeing the new

[jira] [Commented] (HDFS-12188) De-flake testDecommissionStatus

2021-08-12 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17398097#comment-17398097 ] Ahmed Hussein commented on HDFS-12188: -- Hi [~vjasani] Thanks for taking a look at this jira. I have

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2021-07-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381524#comment-17381524 ] Ahmed Hussein commented on HDFS-15160: -- Hi [~sodonnell] , I have created PRs for branch-2.10 and

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2021-07-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381522#comment-17381522 ] Ahmed Hussein commented on HDFS-15160: -- Backporting HDFS-15160 to branch-3.2 *Created

[jira] [Commented] (HDFS-16042) DatanodeAdminMonitor scan should be delay based

2021-07-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381509#comment-17381509 ] Ahmed Hussein commented on HDFS-16042: -- I have uploaded patches for 2.10, 3.2, and 3.3 and posted

[jira] [Comment Edited] (HDFS-16042) DatanodeAdminMonitor scan should be delay based

2021-07-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380724#comment-17380724 ] Ahmed Hussein edited comment on HDFS-16042 at 7/14/21, 4:22 PM:

[jira] [Comment Edited] (HDFS-16042) DatanodeAdminMonitor scan should be delay based

2021-07-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380722#comment-17380722 ] Ahmed Hussein edited comment on HDFS-16042 at 7/14/21, 4:22 PM: no

[jira] [Updated] (HDFS-16042) DatanodeAdminMonitor scan should be delay based

2021-07-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-16042: - Attachment: HDFS-16042-branch-2.10.001.patch > DatanodeAdminMonitor scan should be delay based >

[jira] [Commented] (HDFS-16042) DatanodeAdminMonitor scan should be delay based

2021-07-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380724#comment-17380724 ] Ahmed Hussein commented on HDFS-16042: -- *cherry-picking to branch-3.2* {code:bash} git cherry-pick

[jira] [Updated] (HDFS-16042) DatanodeAdminMonitor scan should be delay based

2021-07-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-16042: - Attachment: HDFS-16042-branch-3.2.001.patch > DatanodeAdminMonitor scan should be delay based >

[jira] [Updated] (HDFS-16042) DatanodeAdminMonitor scan should be delay based

2021-07-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-16042: - Attachment: HDFS-16042-branch-3.3.001.patch Status: Patch Available (was: Reopened) no

[jira] [Reopened] (HDFS-16042) DatanodeAdminMonitor scan should be delay based

2021-07-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein reopened HDFS-16042: -- Reopening to backport fix to 3.3, 3.2, and 2.10 > DatanodeAdminMonitor scan should be delay based

[jira] [Comment Edited] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2021-07-13 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17379425#comment-17379425 ] Ahmed Hussein edited comment on HDFS-15160 at 7/13/21, 1:08 PM: Created

[jira] [Comment Edited] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2021-07-13 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17379425#comment-17379425 ] Ahmed Hussein edited comment on HDFS-15160 at 7/13/21, 1:08 PM: Created

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2021-07-12 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17379425#comment-17379425 ] Ahmed Hussein commented on HDFS-15160: -- Created [PR-3196|https://github.com/apache/hadoop/pull/3196]

[jira] [Reopened] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2021-07-12 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein reopened HDFS-15160: -- > ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl > methods should use

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2021-07-12 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17379406#comment-17379406 ] Ahmed Hussein commented on HDFS-15160: -- I am opening the issue in order to submit PRs backporting

[jira] [Resolved] (HDFS-15671) TestBalancerRPCDelay#testBalancerRPCDelayQpsDefault fails on Trunk

2021-07-09 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein resolved HDFS-15671. -- Resolution: Fixed > TestBalancerRPCDelay#testBalancerRPCDelayQpsDefault fails on Trunk >

[jira] [Commented] (HDFS-13092) Reduce verbosity for ThrottledAsyncChecker.java:schedule

2021-07-07 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376702#comment-17376702 ] Ahmed Hussein commented on HDFS-13092: -- Hi [~msingh], thanks for providing the patch. We observed

[jira] [Commented] (HDFS-15659) Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster

2021-06-25 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17369561#comment-17369561 ] Ahmed Hussein commented on HDFS-15659: -- For branch-3.2: * {{TestNameNodeMXBean}} is an intermittent

[jira] [Resolved] (HDFS-16072) TestBlockRecovery fails consistently on Branch-2.10

2021-06-23 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein resolved HDFS-16072. -- Fix Version/s: 2.10.2 Resolution: Fixed > TestBlockRecovery fails consistently on

[jira] [Comment Edited] (HDFS-15659) Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster

2021-06-23 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17368320#comment-17368320 ] Ahmed Hussein edited comment on HDFS-15659 at 6/23/21, 4:33 PM: Thanks

[jira] [Comment Edited] (HDFS-15659) Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster

2021-06-23 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17368320#comment-17368320 ] Ahmed Hussein edited comment on HDFS-15659 at 6/23/21, 4:10 PM: Thanks

[jira] [Updated] (HDFS-15659) Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster

2021-06-23 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15659: - Attachment: HDFS-15659-branch-3.2.001.patch Status: Patch Available (was: In Progress)

[jira] [Updated] (HDFS-15659) Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster

2021-06-23 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15659: - Status: In Progress (was: Patch Available) > Set dfs.namenode.redundancy.considerLoad to false

[jira] [Updated] (HDFS-15659) Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster

2021-06-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15659: - Attachment: HDFS-15659-branch-2.10.001.patch Status: Patch Available (was: In Progress)

[jira] [Work started] (HDFS-15659) Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster

2021-06-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15659 started by Ahmed Hussein. > Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster >

[jira] [Commented] (HDFS-15150) Introduce read write lock to Datanode

2021-06-22 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367511#comment-17367511 ] Ahmed Hussein commented on HDFS-15150: -- Thanks [~sodonnell] for the review and committing the patch.

[jira] [Commented] (HDFS-15150) Introduce read write lock to Datanode

2021-06-21 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366782#comment-17366782 ] Ahmed Hussein commented on HDFS-15150: -- Hi [~sodonnell] can you please commit the 003 patch into

[jira] [Work started] (HDFS-16072) TestBlockRecovery fails consistently on Branch-2.10

2021-06-21 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16072 started by Ahmed Hussein. > TestBlockRecovery fails consistently on Branch-2.10 >

[jira] [Assigned] (HDFS-16072) TestBlockRecovery fails consistently on Branch-2.10

2021-06-17 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein reassigned HDFS-16072: Assignee: Ahmed Hussein > TestBlockRecovery fails consistently on Branch-2.10 >

[jira] [Commented] (HDFS-15150) Introduce read write lock to Datanode

2021-06-16 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364370#comment-17364370 ] Ahmed Hussein commented on HDFS-15150: -- After committing [^HDFS-15150-branch-2.10.003.patch] to

[jira] [Commented] (HDFS-16072) TestBlockRecovery fails consistently on Branch-2.10

2021-06-16 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364344#comment-17364344 ] Ahmed Hussein commented on HDFS-16072: -- {quote}Apologies Ahmed Hussein, I should have added

[jira] [Commented] (HDFS-15150) Introduce read write lock to Datanode

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363926#comment-17363926 ] Ahmed Hussein commented on HDFS-15150: -- {quote}Are the above changes intentional? They seem to be

[jira] [Commented] (HDFS-15618) Improve datanode shutdown latency

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363910#comment-17363910 ] Ahmed Hussein commented on HDFS-15618: -- spotbugs errors can be ignored. Later, some suppress jiras

[jira] [Updated] (HDFS-15150) Introduce read write lock to Datanode

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15150: - Attachment: HDFS-15150-branch-2.10.003.patch > Introduce read write lock to Datanode >

[jira] [Updated] (HDFS-15618) Improve datanode shutdown latency

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15618: - Attachment: HDFS-15618-branch-2.10.003.patch > Improve datanode shutdown latency >

[jira] [Commented] (HDFS-16072) TestBlockRecovery fails consistently on Branch-2.10

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363814#comment-17363814 ] Ahmed Hussein commented on HDFS-16072: -- [~vjasani] Since you worked on HDFS-15940, Do you know if

[jira] [Created] (HDFS-16072) TestBlockRecovery fails consistently on Branch-2.10

2021-06-15 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HDFS-16072: Summary: TestBlockRecovery fails consistently on Branch-2.10 Key: HDFS-16072 URL: https://issues.apache.org/jira/browse/HDFS-16072 Project: Hadoop HDFS

[jira] [Updated] (HDFS-16071) TestJournalNodeRespectsBindHostKeys fails consistently on branch-2.10

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-16071: - Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) >

[jira] [Created] (HDFS-16071) TestJournalNodeRespectsBindHostKeys fails consistently on branch-2.10

2021-06-15 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HDFS-16071: Summary: TestJournalNodeRespectsBindHostKeys fails consistently on branch-2.10 Key: HDFS-16071 URL: https://issues.apache.org/jira/browse/HDFS-16071 Project: Hadoop

[jira] [Updated] (HDFS-15940) Some tests in TestBlockRecovery are consistently failing

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15940: - Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) > Some tests in TestBlockRecovery

[jira] [Commented] (HDFS-15940) Some tests in TestBlockRecovery are consistently failing

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363698#comment-17363698 ] Ahmed Hussein commented on HDFS-15940: -- Thanks [~vjasani] and [~ayushtkn] for fixing the failures in

[jira] [Commented] (HDFS-15618) Improve datanode shutdown latency

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363692#comment-17363692 ] Ahmed Hussein commented on HDFS-15618: -- Submitted [^HDFS-15618-branch-2.10.002.patch] to fix the

[jira] [Updated] (HDFS-15618) Improve datanode shutdown latency

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15618: - Attachment: HDFS-15618-branch-2.10.002.patch > Improve datanode shutdown latency >

[jira] [Commented] (HDFS-15150) Introduce read write lock to Datanode

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363677#comment-17363677 ] Ahmed Hussein commented on HDFS-15150: -- I uploaded to fix the two spotbugs errors

[jira] [Updated] (HDFS-15150) Introduce read write lock to Datanode

2021-06-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15150: - Attachment: HDFS-15150-branch-2.10.002.patch > Introduce read write lock to Datanode >

[jira] [Updated] (HDFS-15618) Improve datanode shutdown latency

2021-06-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15618: - Attachment: HDFS-15618-branch-2.10.001.patch Status: Patch Available (was: In Progress)

[jira] [Reopened] (HDFS-15618) Improve datanode shutdown latency

2021-06-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein reopened HDFS-15618: -- Reopening to submit a patch for branch-2.10 > Improve datanode shutdown latency >

[jira] [Work started] (HDFS-15618) Improve datanode shutdown latency

2021-06-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15618 started by Ahmed Hussein. > Improve datanode shutdown latency > - > >

[jira] [Reopened] (HDFS-15659) Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster

2021-06-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein reopened HDFS-15659: -- Reopen issue to submit patches for earlier branches 2.10-3.x > Set

[jira] [Updated] (HDFS-15150) Introduce read write lock to Datanode

2021-06-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15150: - Status: Patch Available (was: Reopened) > Introduce read write lock to Datanode >

[jira] [Updated] (HDFS-15150) Introduce read write lock to Datanode

2021-06-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15150: - Attachment: HDFS-15150-branch-2.10.001.patch > Introduce read write lock to Datanode >

[jira] [Updated] (HDFS-15150) Introduce read write lock to Datanode

2021-06-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15150: - Attachment: (was: HDFS-1515-branch-2.10.001.patch) > Introduce read write lock to Datanode >

[jira] [Updated] (HDFS-15150) Introduce read write lock to Datanode

2021-06-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15150: - Attachment: HDFS-1515-branch-2.10.001.patch > Introduce read write lock to Datanode >

[jira] [Reopened] (HDFS-15150) Introduce read write lock to Datanode

2021-06-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein reopened HDFS-15150: -- Thanks [~sodonnell] and [~weichiu] for introducing this optimization. I am opening the issue in

[jira] [Commented] (HDFS-15671) TestBalancerRPCDelay#testBalancerRPCDelayQpsDefault fails on Trunk

2021-06-11 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17361915#comment-17361915 ] Ahmed Hussein commented on HDFS-15671: -- Ok, sure. I will work on back porting HDFS-15659 >

[jira] [Commented] (HDFS-15671) TestBalancerRPCDelay#testBalancerRPCDelayQpsDefault fails on Trunk

2021-06-11 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17361916#comment-17361916 ] Ahmed Hussein commented on HDFS-15671: -- Thanks [~Jim_Brennan] >

[jira] [Comment Edited] (HDFS-15671) TestBalancerRPCDelay#testBalancerRPCDelayQpsDefault fails on Trunk

2021-06-11 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17361829#comment-17361829 ] Ahmed Hussein edited comment on HDFS-15671 at 6/11/21, 3:13 PM: Setting

[jira] [Commented] (HDFS-15671) TestBalancerRPCDelay#testBalancerRPCDelayQpsDefault fails on Trunk

2021-06-11 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17361829#comment-17361829 ] Ahmed Hussein commented on HDFS-15671: -- Setting {{dfs.namenode.redundancy.considerLoad}} to false.

[jira] [Assigned] (HDFS-15671) TestBalancerRPCDelay#testBalancerRPCDelayQpsDefault fails on Trunk

2021-06-11 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein reassigned HDFS-15671: Assignee: Ahmed Hussein > TestBalancerRPCDelay#testBalancerRPCDelayQpsDefault fails on

[jira] [Work started] (HDFS-16061) DFTestUtil.waitReplication can produce false positives

2021-06-10 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16061 started by Ahmed Hussein. > DFTestUtil.waitReplication can produce false positives >

[jira] [Created] (HDFS-16061) DFTestUtil.waitReplication can produce false positives

2021-06-09 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HDFS-16061: Summary: DFTestUtil.waitReplication can produce false positives Key: HDFS-16061 URL: https://issues.apache.org/jira/browse/HDFS-16061 Project: Hadoop HDFS

[jira] [Reopened] (HDFS-15671) TestBalancerRPCDelay#testBalancerRPCDelayQpsDefault fails on Trunk

2021-06-09 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein reopened HDFS-15671: -- > TestBalancerRPCDelay#testBalancerRPCDelayQpsDefault fails on Trunk >

[jira] [Updated] (HDFS-15146) TestBalancerRPCDelay. testBalancerRPCDelayQpsDefault fails intermittently

2021-06-09 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15146: - Description: TestBalancerRPCDelay.testBalancerRPCDelayQpsDefault fails intermittently when the

[jira] [Resolved] (HDFS-15671) TestBalancerRPCDelay#testBalancerRPCDelayQpsDefault fails on Trunk

2021-06-09 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein resolved HDFS-15671. -- Resolution: Duplicate duplicate of HDFS-15146 >

[jira] [Updated] (HDFS-15146) TestBalancerRPCDelay. testBalancerRPCDelayQpsDefault fails intermittently

2021-06-09 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15146: - Summary: TestBalancerRPCDelay. testBalancerRPCDelayQpsDefault fails intermittently (was:

[jira] [Updated] (HDFS-15146) TestBalancerRPCDelay.testBalancerRPCDelay fails intermittently

2021-06-09 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15146: - Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) >

[jira] [Commented] (HDFS-16042) DatanodeAdminMonitor scan should be delay based

2021-05-27 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352535#comment-17352535 ] Ahmed Hussein commented on HDFS-16042: -- Hey [~Jim_Brennan], can you please take a look at [GitHub

[jira] [Work started] (HDFS-16042) DatanodeAdminMonitor scan should be delay based

2021-05-26 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16042 started by Ahmed Hussein. > DatanodeAdminMonitor scan should be delay based >

[jira] [Created] (HDFS-16042) DatanodeAdminMonitor scan should be delay based

2021-05-26 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HDFS-16042: Summary: DatanodeAdminMonitor scan should be delay based Key: HDFS-16042 URL: https://issues.apache.org/jira/browse/HDFS-16042 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-15999) TestCommitBlockSynchronization incorrect tests

2021-04-27 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HDFS-15999: Summary: TestCommitBlockSynchronization incorrect tests Key: HDFS-15999 URL: https://issues.apache.org/jira/browse/HDFS-15999 Project: Hadoop HDFS Issue

[jira] [Comment Edited] (HDFS-15869) Network issue while FSEditLogAsync is executing RpcEdit.logSyncNotify can cause the namenode to hang

2021-04-18 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324564#comment-17324564 ] Ahmed Hussein edited comment on HDFS-15869 at 4/18/21, 5:37 PM:

[jira] [Commented] (HDFS-15869) Network issue while FSEditLogAsync is executing RpcEdit.logSyncNotify can cause the namenode to hang

2021-04-18 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324564#comment-17324564 ] Ahmed Hussein commented on HDFS-15869: -- {quote}Second, even if there is no such kernel issue {quote}

[jira] [Commented] (HDFS-15869) Network issue while FSEditLogAsync is executing RpcEdit.logSyncNotify can cause the namenode to hang

2021-04-18 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324534#comment-17324534 ] Ahmed Hussein commented on HDFS-15869: -- Thanks [~functioner]. I cannot understand the bug

[jira] [Commented] (HDFS-15979) Move within EZ fails and cannot remove nested EZs

2021-04-16 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17323602#comment-17323602 ] Ahmed Hussein commented on HDFS-15979: -- The test failures are not related to the changes. Those

[jira] [Updated] (HDFS-15979) Move within EZ fails and cannot remove nested EZs

2021-04-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15979: - Attachment: HDFS-15979.001.patch Status: Patch Available (was: In Progress) > Move

[jira] [Work started] (HDFS-15979) Move within EZ fails and cannot remove nested EZs

2021-04-15 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15979 started by Ahmed Hussein. > Move within EZ fails and cannot remove nested EZs >

[jira] [Created] (HDFS-15979) Move within EZ fails and cannot remove nested EZs

2021-04-15 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HDFS-15979: Summary: Move within EZ fails and cannot remove nested EZs Key: HDFS-15979 URL: https://issues.apache.org/jira/browse/HDFS-15979 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-14904) Add Option to let Balancer prefer highly utilized nodes in each iteration

2021-04-09 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318060#comment-17318060 ] Ahmed Hussein commented on HDFS-14904: -- Hey [~LeonG] and [~jingzhao] ! Thanks for the contribution.

[jira] [Commented] (HDFS-15646) Track failing tests in HDFS

2021-03-30 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311520#comment-17311520 ] Ahmed Hussein commented on HDFS-15646: -- Thanks [~ayushtkn], Last time I checked the qbt-reports ,

[jira] [Commented] (HDFS-15004) Refactor TestBalancer for faster execution.

2021-02-12 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17283797#comment-17283797 ] Ahmed Hussein commented on HDFS-15004: -- [~simbadzina], is there any update on this jira? > Refactor

[jira] [Comment Edited] (HDFS-12398) Use JUnit Parameterized test suite in TestWriteReadStripedFile

2021-02-12 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17283791#comment-17283791 ] Ahmed Hussein edited comment on HDFS-12398 at 2/12/21, 4:07 PM:

[jira] [Commented] (HDFS-12398) Use JUnit Parameterized test suite in TestWriteReadStripedFile

2021-02-12 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17283791#comment-17283791 ] Ahmed Hussein commented on HDFS-12398: -- [~HuafengWang] [~huafengw] > Use JUnit Parameterized test

[jira] [Updated] (HDFS-12188) TestDecommissioningStatus#testDecommissionStatus fails intermittently

2021-02-12 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-12188: - Parent: HDFS-15646 Issue Type: Sub-task (was: Bug) >

[jira] [Commented] (HDFS-12188) TestDecommissioningStatus#testDecommissionStatus fails intermittently

2021-02-12 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17283784#comment-17283784 ] Ahmed Hussein commented on HDFS-12188: -- We see this failure on our clusters running 2.10 as well.

[jira] [Commented] (HDFS-13723) Occasional "Should be different group" error in TestRefreshUserMappings#testGroupMappingRefresh

2021-01-21 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269473#comment-17269473 ] Ahmed Hussein commented on HDFS-13723: -- [~smeng], [~Jim_Brennan] can you please pull this into 2.10?

[jira] [Commented] (HDFS-15308) TestReconstructStripedFile#testNNSendsErasureCodingTasks fails intermittently

2020-12-21 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252947#comment-17252947 ] Ahmed Hussein commented on HDFS-15308: -- {quote}[~ahussein] any pointers, why do you think consider

[jira] [Commented] (HDFS-15308) TestReconstructStripedFile#testNNSendsErasureCodingTasks fails intermittently

2020-12-18 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251957#comment-17251957 ] Ahmed Hussein commented on HDFS-15308: -- We have {{dfs.namenode.redundancy.considerLoad}} set to

[jira] [Commented] (HDFS-15679) DFSOutputStream close should be a no-op when called multiple times

2020-12-18 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251942#comment-17251942 ] Ahmed Hussein commented on HDFS-15679: -- Thanks [~Jim_Brennan] for your feedback. I am going to

  1   2   3   4   5   >