[jira] [Commented] (HDFS-14675) Increase Balancer Defaults Further

[ https://issues.apache.org/jira/browse/HDFS-14675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16895096#comment-16895096 ] Chen Zhang commented on HDFS-14675: --- +1, the default config is too slow for large clusters. On our

[jira] [Commented] (HDFS-14662) Document the usage of the new Balancer "asService" parameter

[ https://issues.apache.org/jira/browse/HDFS-14662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16895045#comment-16895045 ] Chen Zhang commented on HDFS-14662: --- uploaded the v1 patch > Document the usage of the new Balancer

[jira] [Updated] (HDFS-14662) Document the usage of the new Balancer "asService" parameter

[ https://issues.apache.org/jira/browse/HDFS-14662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14662: -- Attachment: HDFS-14662.001.patch > Document the usage of the new Balancer "asService" parameter >

[jira] [Updated] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-13783: -- Attachment: HDFS-13783.006.patch > Balancer: make balancer to be a long service process for easy to

[jira] [Commented] (HDFS-12967) NNBench should support multi-cluster access

[ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16894253#comment-16894253 ] Chen Zhang commented on HDFS-12967: --- Thanks [~jojochuang], my email is chzhang1...@gmail.com > NNBench

[jira] [Commented] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893927#comment-16893927 ] Chen Zhang commented on HDFS-13783: --- TestDirectoryScanner failed intermittently, do we need to fix it?

[jira] [Commented] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893896#comment-16893896 ] Chen Zhang commented on HDFS-13783: --- Thanks [~xkrogen] for your review again {quote} * You still have

[jira] [Comment Edited] (HDFS-14657) Refine NameSystem lock usage during processing FBR

[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893844#comment-16893844 ] Chen Zhang edited comment on HDFS-14657 at 7/26/19 2:06 PM: Thanks [~shv] for

[jira] [Commented] (HDFS-14657) Refine NameSystem lock usage during processing FBR

[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893844#comment-16893844 ] Chen Zhang commented on HDFS-14657: --- Hi [~shv], you are right, releasing NN lock in the middle of the

[jira] [Updated] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-13783: -- Attachment: HDFS-13783.005.patch > Balancer: make balancer to be a long service process for easy to

[jira] [Commented] (HDFS-14657) Refine NameSystem lock usage during processing FBR

[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892925#comment-16892925 ] Chen Zhang commented on HDFS-14657: --- Thanks [~jojochuang] for mentioning HADOOP-16452, also thanks

[jira] [Updated] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-13783: -- Attachment: HDFS-13783.004.patch > Balancer: make balancer to be a long service process for easy to

[jira] [Commented] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892885#comment-16892885 ] Chen Zhang commented on HDFS-13783: --- Updated patch according the review comments and uploaded the v4

[jira] [Commented] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892884#comment-16892884 ] Chen Zhang commented on HDFS-13783: --- Thanks [~xkrogen] for your patient review and detailed comments

[jira] [Commented] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891570#comment-16891570 ] Chen Zhang commented on HDFS-13783: --- Hi [~xkrogen], I've updated the patch, do you have time to review?

[jira] [Commented] (HDFS-12820) Decommissioned datanode is counted in service cause datanode allcating failure

[ https://issues.apache.org/jira/browse/HDFS-12820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890872#comment-16890872 ] Chen Zhang commented on HDFS-12820: --- Thanks [~hexiaoqiao] for your comments, my bad, ignored the order

[jira] [Comment Edited] (HDFS-12820) Decommissioned datanode is counted in service cause datanode allcating failure

[ https://issues.apache.org/jira/browse/HDFS-12820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890847#comment-16890847 ] Chen Zhang edited comment on HDFS-12820 at 7/23/19 9:44 AM: Hi [~jojochuang],

[jira] [Commented] (HDFS-12820) Decommissioned datanode is counted in service cause datanode allcating failure

[ https://issues.apache.org/jira/browse/HDFS-12820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890847#comment-16890847 ] Chen Zhang commented on HDFS-12820: --- Hi [~jojochuang], I've checked the code of the trunk branch, I

[jira] [Assigned] (HDFS-14662) Document the usage of the new Balancer "asService" parameter

[ https://issues.apache.org/jira/browse/HDFS-14662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang reassigned HDFS-14662: - Assignee: Chen Zhang > Document the usage of the new Balancer "asService" parameter >

[jira] [Created] (HDFS-14662) Document the usage of the new Balancer "asService" parameter

Chen Zhang created HDFS-14662: - Summary: Document the usage of the new Balancer "asService" parameter Key: HDFS-14662 URL: https://issues.apache.org/jira/browse/HDFS-14662 Project: Hadoop HDFS

[jira] [Updated] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-13783: -- Attachment: HDFS-13783.003.patch > Balancer: make balancer to be a long service process for easy to

[jira] [Comment Edited] (HDFS-14657) Refine NameSystem lock usage during processing FBR

[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889768#comment-16889768 ] Chen Zhang edited comment on HDFS-14657 at 7/21/19 5:17 PM: uploaded a quick

[jira] [Commented] (HDFS-14657) Refine NameSystem lock usage during processing FBR

[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889768#comment-16889768 ] Chen Zhang commented on HDFS-14657: --- upload a quick demo patch for the idea of

[jira] [Updated] (HDFS-14657) Refine NameSystem lock usage during processing FBR

[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14657: -- Attachment: HDFS-14657.002.patch > Refine NameSystem lock usage during processing FBR >

[jira] [Comment Edited] (HDFS-14657) Refine NameSystem lock usage during processing FBR

[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889763#comment-16889763 ] Chen Zhang edited comment on HDFS-14657 at 7/21/19 4:49 PM: Thanks [~xkrogen]

[jira] [Commented] (HDFS-14657) Refine NameSystem lock usage during processing FBR

[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889763#comment-16889763 ] Chen Zhang commented on HDFS-14657: --- Thanks [~xkrogen] for reminding me of the batch IBR processing

[jira] [Comment Edited] (HDFS-10927) Lease Recovery: File not getting closed on HDFS when block write operation fails

[ https://issues.apache.org/jira/browse/HDFS-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1660#comment-1660 ] Chen Zhang edited comment on HDFS-10927 at 7/19/19 1:34 PM: Thanks

[jira] [Comment Edited] (HDFS-10927) Lease Recovery: File not getting closed on HDFS when block write operation fails

[ https://issues.apache.org/jira/browse/HDFS-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1660#comment-1660 ] Chen Zhang edited comment on HDFS-10927 at 7/19/19 1:28 PM: Thanks

[jira] [Comment Edited] (HDFS-10927) Lease Recovery: File not getting closed on HDFS when block write operation fails

[ https://issues.apache.org/jira/browse/HDFS-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1660#comment-1660 ] Chen Zhang edited comment on HDFS-10927 at 7/19/19 1:27 PM: Thanks

[jira] [Comment Edited] (HDFS-10927) Lease Recovery: File not getting closed on HDFS when block write operation fails

[ https://issues.apache.org/jira/browse/HDFS-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1660#comment-1660 ] Chen Zhang edited comment on HDFS-10927 at 7/19/19 1:27 PM: Thanks

[jira] [Comment Edited] (HDFS-10927) Lease Recovery: File not getting closed on HDFS when block write operation fails

[ https://issues.apache.org/jira/browse/HDFS-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1660#comment-1660 ] Chen Zhang edited comment on HDFS-10927 at 7/19/19 1:26 PM: Thanks

[jira] [Commented] (HDFS-10927) Lease Recovery: File not getting closed on HDFS when block write operation fails

[ https://issues.apache.org/jira/browse/HDFS-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1660#comment-1660 ] Chen Zhang commented on HDFS-10927: --- Thanks [~hexiaoqiao] for finding that HDFS-11472 can fix this

[jira] [Commented] (HDFS-10927) Lease Recovery: File not getting closed on HDFS when block write operation fails

[ https://issues.apache.org/jira/browse/HDFS-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887883#comment-16887883 ] Chen Zhang commented on HDFS-10927: --- Sorry, I can't remember the detail at that time, that comment is

[jira] [Commented] (HDFS-14576) Avoid block report retry and slow down namenode startup

[ https://issues.apache.org/jira/browse/HDFS-14576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887878#comment-16887878 ] Chen Zhang commented on HDFS-14576: --- Thanks [~hexiaoqiao] for your detailed description of your

[jira] [Commented] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887857#comment-16887857 ] Chen Zhang commented on HDFS-13783: --- Thanks [~xkrogen] for your detailed comment and suggestion, I'll

[jira] [Commented] (HDFS-14657) Refine NameSystem lock usage during processing FBR

[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887596#comment-16887596 ] Chen Zhang commented on HDFS-14657: --- Thanks [~shv] for your comments, I did searched for a few jiras

[jira] [Commented] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887105#comment-16887105 ] Chen Zhang commented on HDFS-13783: --- Hi [~xkrogen], do you have time to review this patch? Thanks :) >

[jira] [Updated] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-13783: -- Attachment: HDFS-13783-002.patch Status: Patch Available (was: Open) re-submit 002 patch to

[jira] [Updated] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-13783: -- Status: Open (was: Patch Available) > Balancer: make balancer to be a long service process for easy

[jira] [Updated] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-13783: -- Status: Patch Available (was: Open) > Balancer: make balancer to be a long service process for easy

[jira] [Updated] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-13783: -- Status: Open (was: Patch Available) submit patch not trigger jenkins, cancel patch and re-submit >

[jira] [Updated] (HDFS-14657) Refine NameSystem lock usage during processing FBR

[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14657: -- Status: Patch Available (was: Open) > Refine NameSystem lock usage during processing FBR >

[jira] [Updated] (HDFS-14657) Refine NameSystem lock usage during processing FBR

[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14657: -- Attachment: HDFS-14657-001.patch > Refine NameSystem lock usage during processing FBR >

[jira] [Assigned] (HDFS-14657) Refine NameSystem lock usage during processing FBR

[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang reassigned HDFS-14657: - Assignee: Chen Zhang > Refine NameSystem lock usage during processing FBR >

[jira] [Resolved] (HDFS-14658) Refine NameSystem lock usage during processing FBR

[ https://issues.apache.org/jira/browse/HDFS-14658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang resolved HDFS-14658. --- Resolution: Abandoned > Refine NameSystem lock usage during processing FBR >

[jira] [Resolved] (HDFS-14659) Refine NameSystem lock usage during processing FBR

[ https://issues.apache.org/jira/browse/HDFS-14659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang resolved HDFS-14659. --- Resolution: Abandoned duplicate jira due to apache jira server error > Refine NameSystem lock usage

[jira] [Commented] (HDFS-14658) Refine NameSystem lock usage during processing FBR

[ https://issues.apache.org/jira/browse/HDFS-14658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886886#comment-16886886 ] Chen Zhang commented on HDFS-14658: --- duplicate jira due to apache jira sever error > Refine NameSystem

[jira] [Commented] (HDFS-14576) Avoid block report retry and slow down namenode startup

[ https://issues.apache.org/jira/browse/HDFS-14576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886799#comment-16886799 ] Chen Zhang commented on HDFS-14576: --- {quote}I believe there are still some points need to optimize on

[jira] [Updated] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-13783: -- Affects Version/s: (was: 3.0.3) Attachment: HDFS-13783-001.patch Status:

[jira] [Assigned] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang reassigned HDFS-13783: - Assignee: Chen Zhang > Balancer: make balancer to be a long service process for easy to monitor

[jira] [Commented] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886758#comment-16886758 ] Chen Zhang commented on HDFS-13783: --- Since this JIRA is not active for almost 1 year, I assign to

[jira] [Commented] (HDFS-14576) Avoid block report retry and slow down namenode startup

[ https://issues.apache.org/jira/browse/HDFS-14576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886081#comment-16886081 ] Chen Zhang commented on HDFS-14576: --- Hi [~hexiaoqiao], we've meet similar problem on our production

[jira] [Commented] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885890#comment-16885890 ] Chen Zhang commented on HDFS-13783: --- Hi [~maobaolong], are you still working on this issue? we've did

[jira] [Updated] (HDFS-14652) HealthMonitor connection retry times should be configurable

[ https://issues.apache.org/jira/browse/HDFS-14652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14652: -- Attachment: HDFS-14652-002.patch > HealthMonitor connection retry times should be configurable >

[jira] [Commented] (HDFS-13709) Report bad block to NN when transfer block encounter EIO exception

[ https://issues.apache.org/jira/browse/HDFS-13709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885346#comment-16885346 ] Chen Zhang commented on HDFS-13709: --- [~linyiqun] [~jojochuang] [~xkrogen] can you help to review this

[jira] [Updated] (HDFS-14652) HealthMonitor connection retry times should be configurable

[ https://issues.apache.org/jira/browse/HDFS-14652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-14652: -- Assignee: Chen Zhang Attachment: HDFS-14652-001.patch Status: Patch Available (was:

[jira] [Created] (HDFS-14652) HealthMonitor connection retry times should be configurable

Chen Zhang created HDFS-14652: - Summary: HealthMonitor connection retry times should be configurable Key: HDFS-14652 URL: https://issues.apache.org/jira/browse/HDFS-14652 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12967) NNBench should support multi-cluster access

[ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873174#comment-16873174 ] Chen Zhang commented on HDFS-12967: --- Hi [~jojochuang], thanks for review. I've fixed these checkstyle

[jira] [Updated] (HDFS-12967) NNBench should support multi-cluster access

[ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-12967: -- Status: Patch Available (was: In Progress) > NNBench should support multi-cluster access >

[jira] [Updated] (HDFS-12967) NNBench should support multi-cluster access

[ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-12967: -- Status: In Progress (was: Patch Available) > NNBench should support multi-cluster access >

[jira] [Updated] (HDFS-12967) NNBench should support multi-cluster access

[ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-12967: -- Attachment: HDFS-12967-004.patch > NNBench should support multi-cluster access >

[jira] [Updated] (HDFS-12967) NNBench should support multi-cluster access

[ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-12967: -- Attachment: HDFS-12967-003.patch > NNBench should support multi-cluster access >

[jira] [Updated] (HDFS-12967) NNBench should support multi-cluster access

[ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-12967: -- Status: Patch Available (was: Open) > NNBench should support multi-cluster access >

[jira] [Updated] (HDFS-12967) NNBench should support multi-cluster access

[ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-12967: -- Status: Open (was: Patch Available) submitted the wrong version for patch-002, which would cause the

[jira] [Work stopped] (HDFS-12967) NNBench should support multi-cluster access

[ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12967 stopped by Chen Zhang. - > NNBench should support multi-cluster access >

[jira] [Commented] (HDFS-12967) NNBench should support multi-cluster access

[ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790168#comment-16790168 ] Chen Zhang commented on HDFS-12967: --- [~jojochuang], would you please help me to review this patch

[jira] [Updated] (HDFS-12967) NNBench should support multi-cluster access

[ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-12967: -- Status: Patch Available (was: Open) > NNBench should support multi-cluster access >

[jira] [Updated] (HDFS-12967) NNBench should support multi-cluster access

[ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-12967: -- Status: In Progress (was: Patch Available) Add UT and update the help message > NNBench should

[jira] [Updated] (HDFS-12967) NNBench should support multi-cluster access

[ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-12967: -- Attachment: (was: HDFS-12967-002.patch) > NNBench should support multi-cluster access >

[jira] [Updated] (HDFS-12967) NNBench should support multi-cluster access

[ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-12967: -- Attachment: HDFS-12967-002.patch > NNBench should support multi-cluster access >

[jira] [Commented] (HDFS-12967) NNBench should support multi-cluster access

[ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790147#comment-16790147 ] Chen Zhang commented on HDFS-12967: --- {quote}Did you try {{TestDFSIO}} instead. Should be the right tool

[jira] [Updated] (HDFS-12967) NNBench should support multi-cluster access

[ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-12967: -- Status: Patch Available (was: Open) > NNBench should support multi-cluster access >

[jira] [Updated] (HDFS-12967) NNBench should support multi-cluster access

[ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-12967: -- Attachment: HDFS-12967-002.patch > NNBench should support multi-cluster access >

[jira] [Commented] (HDFS-3246) pRead equivalent for direct read path

[ https://issues.apache.org/jira/browse/HDFS-3246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767916#comment-16767916 ] Chen Zhang commented on HDFS-3246: -- Hi [~henryr], do you still work on this issue? This issue is very

[jira] [Assigned] (HDFS-3246) pRead equivalent for direct read path

[ https://issues.apache.org/jira/browse/HDFS-3246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang reassigned HDFS-3246: Assignee: Chen Zhang (was: Henry Robinson) > pRead equivalent for direct read path >

[jira] [Updated] (HDFS-13709) Report bad block to NN when transfer block encounter EIO exception

[ https://issues.apache.org/jira/browse/HDFS-13709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-13709: -- Status: Patch Available (was: Open) > Report bad block to NN when transfer block encounter EIO

[jira] [Updated] (HDFS-13709) Report bad block to NN when transfer block encounter EIO exception

[ https://issues.apache.org/jira/browse/HDFS-13709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-13709: -- Description: In our online cluster, the BlockPoolSliceScanner is turned off, and sometimes disk bad

[jira] [Updated] (HDFS-13709) Report bad block to NN when transfer block encounter EIO exception

[ https://issues.apache.org/jira/browse/HDFS-13709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-13709: -- Attachment: HDFS-13709.patch > Report bad block to NN when transfer block encounter EIO exception >

[jira] [Updated] (HDFS-13709) Report bad block to NN when transfer block encounter EIO exception

[ https://issues.apache.org/jira/browse/HDFS-13709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-13709: -- Description: In our online cluster, the BlockPoolSliceScanner is turned off, and sometimes disk bad

[jira] [Created] (HDFS-13709) Report bad block to NN when transfer block encounter EIO exception

Chen Zhang created HDFS-13709: - Summary: Report bad block to NN when transfer block encounter EIO exception Key: HDFS-13709 URL: https://issues.apache.org/jira/browse/HDFS-13709 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12967) NNBench should support multi-cluster access

[ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16305877#comment-16305877 ] Chen Zhang commented on HDFS-12967: --- Thanks for your response and suggestion, [~jojochuang]. bq. what

[jira] [Updated] (HDFS-12967) NNBench should support multi-cluster access

[ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-12967: -- Description: Sometimes we need to run NNBench for some scaling tests after made some improvements on

[jira] [Updated] (HDFS-12967) NNBench should support multi-cluster access

[ https://issues.apache.org/jira/browse/HDFS-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-12967: -- Attachment: HDFS-12967-001.patch > NNBench should support multi-cluster access >

[jira] [Created] (HDFS-12967) NNBench should support multi-cluster access

Chen Zhang created HDFS-12967: - Summary: NNBench should support multi-cluster access Key: HDFS-12967 URL: https://issues.apache.org/jira/browse/HDFS-12967 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12936) java.lang.OutOfMemoryError: unable to create new native thread

[ https://issues.apache.org/jira/browse/HDFS-12936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294704#comment-16294704 ] Chen Zhang commented on HDFS-12936: --- Hey [~1028344...@qq.com]，this error usually means you didn't set

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134583#comment-16134583 ] Chen Zhang commented on HDFS-11303: --- Thanks [~jzhuge] a lot for pushing this issue forward. I'm sorry

[jira] [Commented] (HDFS-8693) refreshNamenodes does not support adding a new standby to a running DN

[ https://issues.apache.org/jira/browse/HDFS-8693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16062512#comment-16062512 ] Chen Zhang commented on HDFS-8693: -- Hi [~vinayrpet] [~ajithshetty], any progress on this issue? Supporting

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046574#comment-16046574 ] Chen Zhang commented on HDFS-11303: --- [~jzhuge] thanks for your help, I've fixed the checkstyle error.

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-11303: -- Attachment: HDFS-11303-002.patch fix checkstyle issues > Hedged read might hang infinitely if read

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-11303: -- Status: Patch Available (was: Open) > Hedged read might hang infinitely if read data from all DN

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-11303: -- Status: Open (was: Patch Available) > Hedged read might hang infinitely if read data from all DN

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-11303: -- Status: Patch Available (was: In Progress) Re-submit the patch to kick off test-patch again. > Hedged

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-11303: -- Status: In Progress (was: Patch Available) > Hedged read might hang infinitely if read data from all

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-11303: -- Attachment: HDFS-11303-002.patch fix checkstyle error > Hedged read might hang infinitely if read data

[jira] [Comment Edited] (HDFS-10927) Lease Recovery: File not getting closed on HDFS when block write operation fails

[ https://issues.apache.org/jira/browse/HDFS-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15871310#comment-15871310 ] Chen Zhang edited comment on HDFS-10927 at 2/17/17 7:25 AM: Hey guys, I just

[jira] [Commented] (HDFS-10927) Lease Recovery: File not getting closed on HDFS when block write operation fails

[ https://issues.apache.org/jira/browse/HDFS-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15871310#comment-15871310 ] Chen Zhang commented on HDFS-10927: --- Hey guys, I just found an issue like this. HBase RegionServer got

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15837255#comment-15837255 ] Chen Zhang commented on HDFS-11303: --- Got it, thanks a lot for your explanation, Stack. > Hedged read

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15824141#comment-15824141 ] Chen Zhang commented on HDFS-11303: --- Hi Andrew, I’m a newbie to apache community, HDFS-11303 is the

[jira] [Commented] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813527#comment-15813527 ] Chen Zhang commented on HDFS-11303: --- Stack, thanks for your comments. Yes, the test is just to verify,

[jira] [Updated] (HDFS-11303) Hedged read might hang infinitely if read data from all DN failed

[ https://issues.apache.org/jira/browse/HDFS-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Zhang updated HDFS-11303: -- Attachment: HDFS-11303-001.patch > Hedged read might hang infinitely if read data from all DN failed >

<    1   2   3   4   5   >