[jira] [Commented] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

[ https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119228#comment-17119228 ] Janus Chow commented on HDFS-13274: --- It is a big federation cluster, there are many users querying

[jira] [Commented] (HDFS-15377) BlockScanner scans one part per round, expect full scans after several rounds

[ https://issues.apache.org/jira/browse/HDFS-15377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119229#comment-17119229 ] Yang Yun commented on HDFS-15377: - Updated to HDFS-15377.004.patch for compile error. > BlockScanner

[jira] [Updated] (HDFS-15377) BlockScanner scans one part per round, expect full scans after several rounds

[ https://issues.apache.org/jira/browse/HDFS-15377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15377: Attachment: HDFS-15377.004.patch Status: Patch Available (was: Open) > BlockScanner scans one

[jira] [Updated] (HDFS-15377) BlockScanner scans one part per round, expect full scans after several rounds

[ https://issues.apache.org/jira/browse/HDFS-15377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15377: Status: Open (was: Patch Available) > BlockScanner scans one part per round, expect full scans after

[jira] [Commented] (HDFS-15377) BlockScanner scans one part per round, expect full scans after several rounds

[ https://issues.apache.org/jira/browse/HDFS-15377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119225#comment-17119225 ] Hadoop QA commented on HDFS-15377: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15246) ArrayIndexOfboundsException in BlockManager CreateLocatedBlock

[ https://issues.apache.org/jira/browse/HDFS-15246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119220#comment-17119220 ] hemanthboyina commented on HDFS-15246: -- thanks [~elgoiri] for review  i have updated the patch ,

[jira] [Updated] (HDFS-15246) ArrayIndexOfboundsException in BlockManager CreateLocatedBlock

[ https://issues.apache.org/jira/browse/HDFS-15246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15246: - Attachment: HDFS-15246.002.patch > ArrayIndexOfboundsException in BlockManager

[jira] [Commented] (HDFS-15377) BlockScanner scans one part per round, expect full scans after several rounds

[ https://issues.apache.org/jira/browse/HDFS-15377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119218#comment-17119218 ] Yang Yun commented on HDFS-15377: - Thanks [~elgoiri] for the review. Updated to HDFS-15377.003.patch

[jira] [Updated] (HDFS-15377) BlockScanner scans one part per round, expect full scans after several rounds

[ https://issues.apache.org/jira/browse/HDFS-15377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15377: Attachment: HDFS-15377.003.patch Status: Patch Available (was: Open) > BlockScanner scans one

[jira] [Updated] (HDFS-15377) BlockScanner scans one part per round, expect full scans after several rounds

[ https://issues.apache.org/jira/browse/HDFS-15377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15377: Status: Open (was: Patch Available) > BlockScanner scans one part per round, expect full scans after

[jira] [Commented] (HDFS-15168) ABFS driver enhancement - Allow customizable translation from AAD SPNs and security groups to Linux user and group

[ https://issues.apache.org/jira/browse/HDFS-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119215#comment-17119215 ] Hudson commented on HDFS-15168: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18306 (See

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119185#comment-17119185 ] Hadoop QA commented on HDFS-14960: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15378) TestReconstructStripedFile#testErasureCodingWorkerXmitsWeight is failing on trunk

[ https://issues.apache.org/jira/browse/HDFS-15378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119121#comment-17119121 ] Hadoop QA commented on HDFS-15378: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119061#comment-17119061 ] Jim Brennan commented on HDFS-14960: Thanks for the review [~inigoiri]! I've addressed all of your

[jira] [Updated] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-14960: --- Attachment: HDFS-14960.005.patch > TestBalancerWithNodeGroup should not succeed with

[jira] [Commented] (HDFS-15246) ArrayIndexOfboundsException in BlockManager CreateLocatedBlock

[ https://issues.apache.org/jira/browse/HDFS-15246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119019#comment-17119019 ] Íñigo Goiri commented on HDFS-15246: * Can we add some assert in the test? * We may want to extract

[jira] [Commented] (HDFS-15377) BlockScanner scans one part per round, expect full scans after several rounds

[ https://issues.apache.org/jira/browse/HDFS-15377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119018#comment-17119018 ] Íñigo Goiri commented on HDFS-15377: * Most of the new code in scanBlock() should probably be a

[jira] [Commented] (HDFS-15366) Active NameNode went down with NPE

[ https://issues.apache.org/jira/browse/HDFS-15366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119017#comment-17119017 ] sarun singla commented on HDFS-15366: - [~hexiaoqiao] Let me confirm and get back.Thnx > Active

[jira] [Comment Edited] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

[ https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119013#comment-17119013 ] Íñigo Goiri edited comment on HDFS-13274 at 5/28/20, 7:17 PM: --

[jira] [Commented] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

[ https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119013#comment-17119013 ] Íñigo Goiri commented on HDFS-13274: RpcServerNumOpenConnections seems pretty high, can we confirm

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119005#comment-17119005 ] Íñigo Goiri commented on HDFS-14960: Minor comments: * As L198 only has one equals, let's use

[jira] [Commented] (HDFS-15378) TestReconstructStripedFile#testErasureCodingWorkerXmitsWeight is failing on trunk

[ https://issues.apache.org/jira/browse/HDFS-15378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119000#comment-17119000 ] Íñigo Goiri commented on HDFS-15378: Just for completion, why is there a delay? >

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118995#comment-17118995 ] Jim Brennan commented on HDFS-14960: The failed unit tests are unrelated to this change. >

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118982#comment-17118982 ] Hadoop QA commented on HDFS-14960: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15378) TestReconstructStripedFile#testErasureCodingWorkerXmitsWeight is failing on trunk

[ https://issues.apache.org/jira/browse/HDFS-15378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15378: - Attachment: HDFS-15378.001.patch Status: Patch Available (was: Open) >

[jira] [Commented] (HDFS-15378) TestReconstructStripedFile#testErasureCodingWorkerXmitsWeight is failing on trunk

[ https://issues.apache.org/jira/browse/HDFS-15378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118963#comment-17118963 ] hemanthboyina commented on HDFS-15378: -- there was a slight delay in the test case run , if we wait

[jira] [Created] (HDFS-15378) TestReconstructStripedFile#testErasureCodingWorkerXmitsWeight is failing on trunk

hemanthboyina created HDFS-15378: Summary: TestReconstructStripedFile#testErasureCodingWorkerXmitsWeight is failing on trunk Key: HDFS-15378 URL: https://issues.apache.org/jira/browse/HDFS-15378

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118840#comment-17118840 ] Hudson commented on HDFS-15368: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18305 (See

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118837#comment-17118837 ] Jim Brennan commented on HDFS-14960: Now that HDFS-13183 has been fixed, I uploaded patch 004 which

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118835#comment-17118835 ] Xiaoqiao He commented on HDFS-15368: Thanks [~ayushtkn] for your help and review to fix this failed

[jira] [Updated] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-14960: --- Attachment: HDFS-14960.004.patch > TestBalancerWithNodeGroup should not succeed with

[jira] [Commented] (HDFS-15366) Active NameNode went down with NPE

[ https://issues.apache.org/jira/browse/HDFS-15366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118831#comment-17118831 ] Xiaoqiao He commented on HDFS-15366: [~saruntek] Please help to check if HDFS-12832 could solve your

[jira] [Updated] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15368: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118824#comment-17118824 ] Ayush Saxena commented on HDFS-15368: - Committed to trunk. Thanx [~hexiaoqiao] for the

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118797#comment-17118797 ] Xiaoqiao He commented on HDFS-15180: Thanks [~sodonnell] for your positive feedback. {quote} we were

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118784#comment-17118784 ] Xiaoqiao He commented on HDFS-15368: Thanks [~ayushtkn],

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118692#comment-17118692 ] Hadoop QA commented on HDFS-15160: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118594#comment-17118594 ] Ayush Saxena commented on HDFS-15368: - v002 LGTM +1 [~hexiaoqiao] can you confirm about the failed

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118543#comment-17118543 ] Hadoop QA commented on HDFS-15368: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118537#comment-17118537 ] Stephen O'Donnell commented on HDFS-15180: -- [~hexiaoqiao] We are interested in this change, but

[jira] [Updated] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15160: - Attachment: HDFS-15160.006.patch > ReplicaMap, Disk Balancer, Directory Scanner and

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118535#comment-17118535 ] Stephen O'Donnell commented on HDFS-15160: -- Hi [~Jiang Xin] - it would be a great help if you

[jira] [Comment Edited] (HDFS-14320) Support skipTrash for WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-14320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118235#comment-17118235 ] Chao Sun edited comment on HDFS-14320 at 5/28/20, 10:16 AM: Bumping up this

[jira] [Comment Edited] (HDFS-14773) SWEBHDFS closes the connection before a client can read the error response for a DSQuotaExceededException

[ https://issues.apache.org/jira/browse/HDFS-14773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118518#comment-17118518 ] Zhao Yi Ming edited comment on HDFS-14773 at 5/28/20, 10:05 AM:

[jira] [Commented] (HDFS-14773) SWEBHDFS closes the connection before a client can read the error response for a DSQuotaExceededException

[ https://issues.apache.org/jira/browse/HDFS-14773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118518#comment-17118518 ] Zhao Yi Ming commented on HDFS-14773: - [~simbadzina] I tried the recreate steps(hadoop version is

[jira] [Commented] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

[ https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118439#comment-17118439 ] xuzq commented on HDFS-13274: - Maybe we can change RenewLease Rpc, bring the listing of writing files to

[jira] [Commented] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

[ https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118425#comment-17118425 ] Janus Chow commented on HDFS-13274: --- Yes, all the routers have similar numbers. > RBF: Extend

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118421#comment-17118421 ] Hudson commented on HDFS-13183: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18304 (See

[jira] [Commented] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

[ https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118420#comment-17118420 ] Ayush Saxena commented on HDFS-13274: - GetServerDefaults doesn't goes to all Namespaces as of now, it

[jira] [Commented] (HDFS-14984) HDFS setQuota: Error message should be added for invalid input max range value to hdfs dfsadmin -setQuota command

[ https://issues.apache.org/jira/browse/HDFS-14984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118413#comment-17118413 ] Zhao Yi Ming commented on HDFS-14984: - After some deeply investigation, I found DFSClient.java code

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118411#comment-17118411 ] Ayush Saxena commented on HDFS-15368: - Thanx [~hexiaoqiao] for confirmation, Have pushed the addendum

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-13183: Resolution: Fixed Status: Resolved (was: Patch Available) > Standby NameNode process

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118409#comment-17118409 ] Ayush Saxena commented on HDFS-13183: - Committed addendum to trunk and branch-3.3 Thanx [~hexiaoqiao]

[jira] [Work started] (HDFS-14984) HDFS setQuota: Error message should be added for invalid input max range value to hdfs dfsadmin -setQuota command

[ https://issues.apache.org/jira/browse/HDFS-14984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-14984 started by Zhao Yi Ming. --- > HDFS setQuota: Error message should be added for invalid input max range >

[jira] [Comment Edited] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118394#comment-17118394 ] Jiang Xin edited comment on HDFS-15160 at 5/28/20, 7:28 AM: [~sodonnell] 

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118394#comment-17118394 ] Jiang Xin commented on HDFS-15160: -- [~sodonnell]  I'm going to apply patch 005 and run on our production