[jira] [Comment Edited] (HDFS-15133) Use rocksdb to store NameNode inode and blockInfo

2020-01-27 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024869#comment-17024869 ] hemanthboyina edited comment on HDFS-15133 at 1/28/20 5:40 AM: --- thanks for

[jira] [Commented] (HDFS-15133) Use rocksdb to store NameNode inode and blockInfo

2020-01-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024876#comment-17024876 ] Ayush Saxena commented on HDFS-15133: - [~maobaolong] are you just trying to push just the inodeMap to

[jira] [Commented] (HDFS-15118) [SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster.

2020-01-27 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024872#comment-17024872 ] Hadoop QA commented on HDFS-15118: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15133) Use rocksdb to store NameNode inode and blockInfo

2020-01-27 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024869#comment-17024869 ] hemanthboyina commented on HDFS-15133: -- thanks for the improvements [~maobaolong] {quote}how to

[jira] [Commented] (HDFS-15148) dfs.namenode.send.qop.enabled should not apply to primary NN port

2020-01-27 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024862#comment-17024862 ] Hadoop QA commented on HDFS-15148: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-15133) Use rocksdb to store NameNode inode and blockInfo

2020-01-27 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024858#comment-17024858 ] maobaolong edited comment on HDFS-15133 at 1/28/20 4:30 AM: [~brahmareddy]

[jira] [Commented] (HDFS-15133) Use rocksdb to store NameNode inode and blockInfo

2020-01-27 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024858#comment-17024858 ] maobaolong commented on HDFS-15133: --- [~brahmareddy] [~ayushtkn], After some work these day, i give some

[jira] [Commented] (HDFS-15118) [SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster.

2020-01-27 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024820#comment-17024820 ] Konstantin Shvachko commented on HDFS-15118: v02 patch looks good. Let's fix the checkstyle.

[jira] [Commented] (HDFS-15118) [SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster.

2020-01-27 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024808#comment-17024808 ] Chen Liang commented on HDFS-15118: --- Thanks for the catch [~shv]! Updated in v02 patch > [SBN Read]

[jira] [Commented] (HDFS-13179) TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently

2020-01-27 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024806#comment-17024806 ] Hadoop QA commented on HDFS-13179: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15118) [SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster.

2020-01-27 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15118: -- Attachment: HDFS-15118.002.patch > [SBN Read] Slow clients when Observer reads are enabled but there

[jira] [Commented] (HDFS-15118) [SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster.

2020-01-27 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024802#comment-17024802 ] Konstantin Shvachko commented on HDFS-15118: # Should this config read go into the

[jira] [Commented] (HDFS-13179) TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently

2020-01-27 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-13179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024795#comment-17024795 ] Íñigo Goiri commented on HDFS-13179: Sure, let's wait for Yetus to come back. >

[jira] [Updated] (HDFS-15148) dfs.namenode.send.qop.enabled should not apply to primary NN port

2020-01-27 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15148: -- Status: Patch Available (was: Open) > dfs.namenode.send.qop.enabled should not apply to primary NN

[jira] [Updated] (HDFS-15148) dfs.namenode.send.qop.enabled should not apply to primary NN port

2020-01-27 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15148: -- Attachment: HDFS-15148.001.patch > dfs.namenode.send.qop.enabled should not apply to primary NN port >

[jira] [Created] (HDFS-15148) dfs.namenode.send.qop.enabled should not apply to primary NN port

2020-01-27 Thread Chen Liang (Jira)
Chen Liang created HDFS-15148: - Summary: dfs.namenode.send.qop.enabled should not apply to primary NN port Key: HDFS-15148 URL: https://issues.apache.org/jira/browse/HDFS-15148 Project: Hadoop HDFS

[jira] [Created] (HDFS-15147) LazyPersistTestCase wait logic is error pruned

2020-01-27 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HDFS-15147: Summary: LazyPersistTestCase wait logic is error pruned Key: HDFS-15147 URL: https://issues.apache.org/jira/browse/HDFS-15147 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-13179) TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently

2020-01-27 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024758#comment-17024758 ] Ahmed Hussein commented on HDFS-13179: -- Thanks [~inigoiri]! if you do not mind I will create another

[jira] [Commented] (HDFS-15146) TestBalancerRPCDelay.testBalancerRPCDelay fails intermittently

2020-01-27 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024749#comment-17024749 ] Íñigo Goiri commented on HDFS-15146: +1 on [^HDFS-15146.001.patch]. I have to say that it seems a

[jira] [Commented] (HDFS-13179) TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently

2020-01-27 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-13179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024743#comment-17024743 ] Íñigo Goiri commented on HDFS-13179: I think is worth using this JIRA to remove all these cases in

[jira] [Commented] (HDFS-15144) TestBlockStatsMXBean#testStorageTypeStatsWhenStorageFailed is incorrect

2020-01-27 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024741#comment-17024741 ] Íñigo Goiri commented on HDFS-15144: I have to say this is a very anti-intuitive piece of code. I

[jira] [Comment Edited] (HDFS-15144) TestBlockStatsMXBean#testStorageTypeStatsWhenStorageFailed is incorrect

2020-01-27 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024741#comment-17024741 ] Íñigo Goiri edited comment on HDFS-15144 at 1/27/20 11:20 PM: -- I have to say

[jira] [Updated] (HDFS-13179) TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently

2020-01-27 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-13179: - Attachment: HDFS-13179.003.patch > TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas

[jira] [Commented] (HDFS-13179) TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently

2020-01-27 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024713#comment-17024713 ] Ahmed Hussein commented on HDFS-13179: -- Thanks [~inigoiri]! This is a good catch. I am uploading a

[jira] [Commented] (HDFS-15146) TestBalancerRPCDelay.testBalancerRPCDelay fails intermittently

2020-01-27 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024710#comment-17024710 ] Hadoop QA commented on HDFS-15146: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Comment Edited] (HDFS-15146) TestBalancerRPCDelay.testBalancerRPCDelay fails intermittently

2020-01-27 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024590#comment-17024590 ] Ahmed Hussein edited comment on HDFS-15146 at 1/27/20 8:48 PM: --- I added

[jira] [Updated] (HDFS-15144) TestBlockStatsMXBean#testStorageTypeStatsWhenStorageFailed is incorrect

2020-01-27 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15144: - Resolution: Invalid Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-15144) TestBlockStatsMXBean#testStorageTypeStatsWhenStorageFailed is incorrect

2020-01-27 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024608#comment-17024608 ] Ahmed Hussein commented on HDFS-15144: -- [~ayushtkn], I think I was wrong in my first evaluation.

[jira] [Commented] (HDFS-15145) HttpFS : getAclStatus returns permission as null

2020-01-27 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024596#comment-17024596 ] Hadoop QA commented on HDFS-15145: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-13179) TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently

2020-01-27 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-13179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024592#comment-17024592 ] Íñigo Goiri commented on HDFS-13179: Thanks for the updated patch. Any chance we can wait for some

[jira] [Updated] (HDFS-15146) TestBalancerRPCDelay.testBalancerRPCDelay fails intermittently

2020-01-27 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15146: - Attachment: HDFS-15146.001.patch > TestBalancerRPCDelay.testBalancerRPCDelay fails

[jira] [Commented] (HDFS-15146) TestBalancerRPCDelay.testBalancerRPCDelay fails intermittently

2020-01-27 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024590#comment-17024590 ] Ahmed Hussein commented on HDFS-15146: -- I added triggerBlockReport call after restarting the

[jira] [Updated] (HDFS-15146) TestBalancerRPCDelay.testBalancerRPCDelay fails intermittently

2020-01-27 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15146: - Status: Patch Available (was: Open) > TestBalancerRPCDelay.testBalancerRPCDelay fails

[jira] [Commented] (HDFS-15145) HttpFS : getAclStatus returns permission as null

2020-01-27 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024588#comment-17024588 ] Íñigo Goiri commented on HDFS-15145: The existing code uses {{assertTrue()}} but I think we should

[jira] [Updated] (HDFS-14757) TestBalancerRPCDelay.testBalancerRPCDelay failed

2020-01-27 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-14757: - Resolution: Cannot Reproduce Status: Resolved (was: Patch Available) The stack trace

[jira] [Updated] (HDFS-15119) Allow expiration of cached locations in DFSInputStream

2020-01-27 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15119: - Attachment: HDFS-15119-branch-2.10.003.patch > Allow expiration of cached locations in

[jira] [Created] (HDFS-15146) TestBalancerRPCDelay.testBalancerRPCDelay fails intermittently

2020-01-27 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HDFS-15146: Summary: TestBalancerRPCDelay.testBalancerRPCDelay fails intermittently Key: HDFS-15146 URL: https://issues.apache.org/jira/browse/HDFS-15146 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15145) HttpFS : getAclStatus returns permission as null

2020-01-27 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15145: - Attachment: HDFS-15145.001.patch Status: Patch Available (was: Open) > HttpFS :

[jira] [Created] (HDFS-15145) HttpFS : getAclStatus returns permission as null

2020-01-27 Thread hemanthboyina (Jira)
hemanthboyina created HDFS-15145: Summary: HttpFS : getAclStatus returns permission as null Key: HDFS-15145 URL: https://issues.apache.org/jira/browse/HDFS-15145 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-15119) Allow expiration of cached locations in DFSInputStream

2020-01-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024526#comment-17024526 ] Ayush Saxena commented on HDFS-15119: - Thanx [~ahussein] for the details, Blocks moving usually isn't

[jira] [Commented] (HDFS-15119) Allow expiration of cached locations in DFSInputStream

2020-01-27 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024474#comment-17024474 ] Ahmed Hussein commented on HDFS-15119: -- [~ayushtkn], refreshening the block locations regardless of

[jira] [Commented] (HDFS-15144) TestBlockStatsMXBean#testStorageTypeStatsWhenStorageFailed is incorrect

2020-01-27 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024413#comment-17024413 ] Ahmed Hussein commented on HDFS-15144: -- [~ayushtkn], I think there is a bug in {{MiniDFSCluster}}