[jira] [Commented] (HDFS-13639) SlotReleaser is not fast enough

2021-03-24 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307586#comment-17307586 ] Lisheng Sun commented on HDFS-13639: Hi, [~sodonnell]  This patch is  running in production for a

[jira] [Commented] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

2021-03-20 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305617#comment-17305617 ] Lisheng Sun commented on HDFS-15787: Hi [~ayushtkn],Could we commit this patch to trunk if no one

[jira] [Updated] (HDFS-15809) DeadNodeDetector doesn't remove live nodes from dead node set.

2021-03-14 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15809: --- Fix Version/s: 3.4.0 > DeadNodeDetector doesn't remove live nodes from dead node set. >

[jira] [Commented] (HDFS-15809) DeadNodeDetector doesn't remove live nodes from dead node set.

2021-03-14 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17301363#comment-17301363 ] Lisheng Sun commented on HDFS-15809: Committed to trunk. Thanx [~LiJinglun] for the contribution. >

[jira] [Updated] (HDFS-15809) DeadNodeDetector doesn't remove live nodes from dead node set.

2021-03-14 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15809: --- Resolution: Fixed Status: Resolved (was: Patch Available) > DeadNodeDetector doesn't remove

[jira] [Comment Edited] (HDFS-15809) DeadNodeDetector doesn't remove live nodes from dead node set.

2021-03-08 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297395#comment-17297395 ] Lisheng Sun edited comment on HDFS-15809 at 3/8/21, 2:15 PM: -  Thank

[jira] [Commented] (HDFS-15809) DeadNodeDetector doesn't remove live nodes from dead node set.

2021-03-08 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297395#comment-17297395 ] Lisheng Sun commented on HDFS-15809:  Thank [~LiJinglun] for your patience work. LGFM . +1 for 

[jira] [Comment Edited] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

2021-03-06 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296486#comment-17296486 ] Lisheng Sun edited comment on HDFS-15787 at 3/6/21, 9:38 AM: - Hi 

[jira] [Comment Edited] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

2021-03-06 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296486#comment-17296486 ] Lisheng Sun edited comment on HDFS-15787 at 3/6/21, 9:37 AM: - Hi 

[jira] [Commented] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

2021-03-06 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296486#comment-17296486 ] Lisheng Sun commented on HDFS-15787: Hi   [~brahmareddy] [~cdouglas] Could you have time to confirm

[jira] [Commented] (HDFS-15809) DeadNodeDetector doesn't remove live nodes from dead node set.

2021-02-26 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292014#comment-17292014 ] Lisheng Sun commented on HDFS-15809: Hi [~LiJinglun]    I think it is more appropriate to use

[jira] [Commented] (HDFS-15809) DeadNodeDetector doesn't remove live nodes from dead node set.

2021-02-21 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287912#comment-17287912 ] Lisheng Sun commented on HDFS-15809: Hi [~LiJinglun] I understand the problem you want to solve is

[jira] [Commented] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

2021-02-10 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282881#comment-17282881 ] Lisheng Sun commented on HDFS-15787: Hi [~elgoiri]  [~ayushtkn] Could you mind to have another

[jira] [Commented] (HDFS-15809) DeadNodeDetector doesn't remove live nodes from dead node set.

2021-02-10 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282879#comment-17282879 ] Lisheng Sun commented on HDFS-15809: hi [~LiJinglun] for catching this scene. {quote}

[jira] [Updated] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

2021-01-31 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15787: --- Attachment: HDFS-15787.002.patch > Remove unnecessary Lease Renew in

[jira] [Commented] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

2021-01-31 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17275830#comment-17275830 ] Lisheng Sun commented on HDFS-15787: Thanx [~hexiaoqiao] for your remind. I think we can add a

[jira] [Commented] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

2021-01-28 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17274120#comment-17274120 ] Lisheng Sun commented on HDFS-15787: The failed UTs are unreated to this patch. Hi [~ayushtkn]

[jira] [Updated] (HDFS-15661) The DeadNodeDetector shouldn't be shared by different DFSClients.

2021-01-27 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15661: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-15661) The DeadNodeDetector shouldn't be shared by different DFSClients.

2021-01-27 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273259#comment-17273259 ] Lisheng Sun commented on HDFS-15661: Commited to trunk. Thanks [~LiJinglun] for your report and

[jira] [Comment Edited] (HDFS-15661) The DeadNodeDetector shouldn't be shared by different DFSClients.

2021-01-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271382#comment-17271382 ] Lisheng Sun edited comment on HDFS-15661 at 1/25/21, 3:51 PM: -- +1 on the

[jira] [Comment Edited] (HDFS-15661) The DeadNodeDetector shouldn't be shared by different DFSClients.

2021-01-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271382#comment-17271382 ] Lisheng Sun edited comment on HDFS-15661 at 1/25/21, 3:51 PM: -- +1 on the

[jira] [Commented] (HDFS-15661) The DeadNodeDetector shouldn't be shared by different DFSClients.

2021-01-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271382#comment-17271382 ] Lisheng Sun commented on HDFS-15661: +1 on 

[jira] [Comment Edited] (HDFS-15661) The DeadNodeDetector shouldn't be shared by different DFSClients.

2021-01-24 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271048#comment-17271048 ] Lisheng Sun edited comment on HDFS-15661 at 1/25/21, 2:57 AM: -- Thank

[jira] [Commented] (HDFS-15661) The DeadNodeDetector shouldn't be shared by different DFSClients.

2021-01-24 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271048#comment-17271048 ] Lisheng Sun commented on HDFS-15661: Thank [~LiJinglun] for nice fixing,according to the way we

[jira] [Updated] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

2021-01-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15787: --- Attachment: HDFS-15787.001.patch Status: Patch Available (was: Open) > Remove unnecessary

[jira] [Updated] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

2021-01-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15787: --- Description: The method of FSNamesystem#internalReleaseLease() as follow:   {code:java} boolean

[jira] [Updated] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

2021-01-23 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15787: --- Description: The method of FSNamesystem#internalReleaseLease() as follow:   {code:java} boolean

[jira] [Created] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

2021-01-23 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-15787: -- Summary: Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease Key: HDFS-15787 URL: https://issues.apache.org/jira/browse/HDFS-15787 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-15605) DeadNodeDetector supports getting deadnode from NameNode.

2020-10-18 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216172#comment-17216172 ] Lisheng Sun edited comment on HDFS-15605 at 10/19/20, 2:51 AM: --- Hi

[jira] [Commented] (HDFS-15605) DeadNodeDetector supports getting deadnode from NameNode.

2020-10-18 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216172#comment-17216172 ] Lisheng Sun commented on HDFS-15605: Hi [~LiJinglun]  Sorry,I relay to your mesage now. I

[jira] [Commented] (HDFS-15559) Complement initialize member variables in TestHdfsConfigFields#initializeMemberVariables

2020-09-14 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17195812#comment-17195812 ] Lisheng Sun commented on HDFS-15559: Hi [~hexiaoqiao] I confirm the failed UTs are ok at local. And

[jira] [Commented] (HDFS-15573) Only log warning if considerLoad and considerStorageType are both true

2020-09-11 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194212#comment-17194212 ] Lisheng Sun commented on HDFS-15573: Thanks [~sodonnell] for fixing this problem.

[jira] [Commented] (HDFS-15559) Complement initialize member variables in TestHdfsConfigFields#initializeMemberVariables

2020-09-11 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194121#comment-17194121 ] Lisheng Sun commented on HDFS-15559: Thanks [~hexiaoqiao]  The v002 patch rebased. > Complement

[jira] [Updated] (HDFS-15559) Complement initialize member variables in TestHdfsConfigFields#initializeMemberVariables

2020-09-11 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15559: --- Attachment: HDFS-15559.002.patch > Complement initialize member variables in >

[jira] [Comment Edited] (HDFS-15559) Complement initialize member variables in TestHdfsConfigFields#initializeMemberVariables

2020-09-09 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193386#comment-17193386 ] Lisheng Sun edited comment on HDFS-15559 at 9/10/20, 5:56 AM: -- Hi

[jira] [Commented] (HDFS-15559) Complement initialize member variables in TestHdfsConfigFields#initializeMemberVariables

2020-09-09 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193386#comment-17193386 ] Lisheng Sun commented on HDFS-15559: Hi [~hexiaoqiao] There are two places of missing infomation. 

[jira] [Updated] (HDFS-15559) Complement initialize member variables in TestHdfsConfigFields#initializeMemberVariables

2020-09-09 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15559: --- Attachment: HDFS-15559.001.patch Status: Patch Available (was: Open) > Complement

[jira] [Created] (HDFS-15559) Complement initialize member variables in TestHdfsConfigFields

2020-09-07 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-15559: -- Summary: Complement initialize member variables in TestHdfsConfigFields Key: HDFS-15559 URL: https://issues.apache.org/jira/browse/HDFS-15559 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15559) Complement initialize member variables in TestHdfsConfigFields#initializeMemberVariables

2020-09-07 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15559: --- Summary: Complement initialize member variables in TestHdfsConfigFields#initializeMemberVariables

[jira] [Updated] (HDFS-15559) Complement initialize member variables in TestHdfsConfigFields#

2020-09-07 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15559: --- Summary: Complement initialize member variables in TestHdfsConfigFields# (was: Complement

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-07 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17191708#comment-17191708 ] Lisheng Sun commented on HDFS-14694: Thanx [~ayushtkn] for your **suggestion.  I updated 

[jira] [Comment Edited] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-07 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17191708#comment-17191708 ] Lisheng Sun edited comment on HDFS-14694 at 9/7/20, 1:20 PM: - Thanx

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-07 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14694: --- Attachment: HDFS-14694.014.patch > Call recoverLease on DFSOutputStream close exception >

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-07 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14694: --- Attachment: HDFS-14694.013.patch > Call recoverLease on DFSOutputStream close exception >

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-06 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17191422#comment-17191422 ] Lisheng Sun commented on HDFS-14694: Thanks [~ayushtkn] for patient review. According to your

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-06 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14694: --- Attachment: HDFS-14694.012.patch > Call recoverLease on DFSOutputStream close exception >

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-03 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190570#comment-17190570 ] Lisheng Sun commented on HDFS-14694: The failed UT is not related to this patch. > Call recoverLease

[jira] [Commented] (HDFS-15551) Tiny Improve for DeadNode detector

2020-09-03 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190537#comment-17190537 ] Lisheng Sun commented on HDFS-15551: Yeah,I would review it recently. > Tiny Improve for DeadNode

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-03 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190479#comment-17190479 ] Lisheng Sun commented on HDFS-14694: Thanks [~hexiaoqiao] for patient review. The v011 patch removed

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-03 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14694: --- Attachment: HDFS-14694.011.patch > Call recoverLease on DFSOutputStream close exception >

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-03 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14694: --- Attachment: (was: HDFS-14694.010.patch) > Call recoverLease on DFSOutputStream close exception >

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-03 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14694: --- Attachment: HDFS-14694.010.patch > Call recoverLease on DFSOutputStream close exception >

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-03 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14694: --- Attachment: HDFS-14694.010.patch > Call recoverLease on DFSOutputStream close exception >

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-02 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17189164#comment-17189164 ] Lisheng Sun commented on HDFS-14694: Thanks [~hexiaoqiao] for your review. The failed UTs are ok in

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-02 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14694: --- Attachment: HDFS-14694.009.patch > Call recoverLease on DFSOutputStream close exception >

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-09-01 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14694: --- Attachment: HDFS-14694.008.patch > Call recoverLease on DFSOutputStream close exception >

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-08-30 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187215#comment-17187215 ] Lisheng Sun commented on HDFS-14694: Thanks [~hexiaoqiao] for your review and good suggestion. I

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-08-30 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14694: --- Attachment: HDFS-14694.007.patch > Call recoverLease on DFSOutputStream close exception >

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-08-27 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17186223#comment-17186223 ] Lisheng Sun commented on HDFS-14694: hi [~ayushtkn] [~weichiu] [~elgoiri] [~hexiaoqiao] Could you

[jira] [Comment Edited] (HDFS-15267) Implement Statistics Count for HttpFSFileSystem

2020-08-26 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185570#comment-17185570 ] Lisheng Sun edited comment on HDFS-15267 at 8/27/20, 2:55 AM: -- [~ayushtkn] 

[jira] [Commented] (HDFS-15267) Implement Statistics Count for HttpFSFileSystem

2020-08-26 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185570#comment-17185570 ] Lisheng Sun commented on HDFS-15267: >From the code point of view, HttpFSFileSystem is used as a

[jira] [Commented] (HDFS-15267) Implement Statistics Count for HttpFSFileSystem

2020-08-26 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185075#comment-17185075 ] Lisheng Sun commented on HDFS-15267: the v002 patch trigger new check. > Implement Statistics Count

[jira] [Updated] (HDFS-15267) Implement Statistics Count for HttpFSFileSystem

2020-08-26 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15267: --- Attachment: HDFS-15267.002.patch > Implement Statistics Count for HttpFSFileSystem >

[jira] [Commented] (HDFS-15267) Implement Statistics Count for HttpFSFileSystem

2020-08-26 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185016#comment-17185016 ] Lisheng Sun commented on HDFS-15267: hi [~ayushtkn] Are you still work on this jira?  if not can I

[jira] [Updated] (HDFS-15267) Implement Statistics Count for HttpFSFileSystem

2020-08-26 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15267: --- Attachment: HDFS-15267.001.patch Status: Patch Available (was: Open) > Implement Statistics

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-08-26 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17184986#comment-17184986 ] Lisheng Sun commented on HDFS-14694: The failed UT is ok in my local.

[jira] [Assigned] (HDFS-15471) TestHDFSContractMultipartUploader fails on trunk

2020-08-26 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-15471: -- Assignee: Lisheng Sun > TestHDFSContractMultipartUploader fails on trunk >

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-08-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14694: --- Attachment: HDFS-14694.006.patch > Call recoverLease on DFSOutputStream close exception >

[jira] [Assigned] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-08-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-14694: -- Assignee: Lisheng Sun (was: Chen Zhang) > Call recoverLease on DFSOutputStream close

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-08-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183915#comment-17183915 ] Lisheng Sun commented on HDFS-14694: Hi [~zhangchen]  Are you still working on this jira? If not, i

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-08-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14694: --- Attachment: HDFS-14694.005.patch > Call recoverLease on DFSOutputStream close exception >

[jira] [Issue Comment Deleted] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-08-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14694: --- Comment: was deleted (was: Hi [~zhangchen] Are you still working on this jira? If not, i will

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2020-08-25 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183879#comment-17183879 ] Lisheng Sun commented on HDFS-14694: Hi [~zhangchen] Are you still working on this jira? If not, i

[jira] [Comment Edited] (HDFS-15409) Optimization Strategy for choosing ShortCircuitCache

2020-07-01 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149428#comment-17149428 ] Lisheng Sun edited comment on HDFS-15409 at 7/1/20, 1:10 PM: - Old (current)

[jira] [Commented] (HDFS-15409) Optimization Strategy for choosing ShortCircuitCache

2020-07-01 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149428#comment-17149428 ] Lisheng Sun commented on HDFS-15409: Old (current) version shows better distribution when the

[jira] [Comment Edited] (HDFS-15409) Optimization Strategy for choosing ShortCircuitCache

2020-06-24 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143743#comment-17143743 ] Lisheng Sun edited comment on HDFS-15409 at 6/24/20, 10:44 AM: --- {quote} So

[jira] [Comment Edited] (HDFS-15409) Optimization Strategy for choosing ShortCircuitCache

2020-06-24 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143743#comment-17143743 ] Lisheng Sun edited comment on HDFS-15409 at 6/24/20, 10:42 AM: --- {quote} So

[jira] [Commented] (HDFS-15409) Optimization Strategy for choosing ShortCircuitCache

2020-06-24 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143743#comment-17143743 ] Lisheng Sun commented on HDFS-15409: {quote} So we could do it more tricky for case when

[jira] [Commented] (HDFS-15409) Optimization Strategy for choosing ShortCircuitCache

2020-06-21 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141638#comment-17141638 ] Lisheng Sun commented on HDFS-15409: yeah, it should be that. My idea is also to learn from the way

[jira] [Assigned] (HDFS-15409) Optimization Strategy for choosing ShortCircuitCache

2020-06-21 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-15409: -- Assignee: Lisheng Sun > Optimization Strategy for choosing ShortCircuitCache >

[jira] [Commented] (HDFS-15409) Optimization Strategy for choosing ShortCircuitCache

2020-06-21 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141494#comment-17141494 ] Lisheng Sun commented on HDFS-15409: Thank [~pustota] for you test. I have some question for your

[jira] [Updated] (HDFS-14895) Define LOG instead of BlockPlacementPolicy.LOG in DatanodeDescriptor#chooseStorage4Block

2020-06-17 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14895: --- Resolution: Duplicate Status: Resolved (was: Patch Available) > Define LOG instead of

[jira] [Updated] (HDFS-15409) Optimization Strategy for choosing ShortCircuitCache

2020-06-11 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15409: --- Description: When clientShortCircuitNum is 10, the probability of falling into each

[jira] [Created] (HDFS-15409) Optimization Strategy for choosing ShortCircuitCache

2020-06-11 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-15409: -- Summary: Optimization Strategy for choosing ShortCircuitCache Key: HDFS-15409 URL: https://issues.apache.org/jira/browse/HDFS-15409 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-24 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115611#comment-17115611 ] Lisheng Sun commented on HDFS-15373: the v01 patch LGFM. > Fix number of threads in

[jira] [Commented] (HDFS-13639) SlotReleaser is not fast enough

2020-05-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111267#comment-17111267 ] Lisheng Sun commented on HDFS-13639:   ||case|| || |Before Case|perf_before_improve_SlotReleaser.png|

[jira] [Updated] (HDFS-13639) SlotReleaser is not fast enough

2020-05-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13639: --- Description: When test the performance of the ShortCircuit Read of the HDFS with YCSB, we find that

[jira] [Updated] (HDFS-13639) SlotReleaser is not fast enough

2020-05-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13639: --- Attachment: (was: image-2020-05-17-23-53-41-115.png) > SlotReleaser is not fast enough >

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2020-05-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1777#comment-1777 ] Lisheng Sun commented on HDFS-12288: hi [~elgoiri] Should we commit this patch to trunk? Thank you.

[jira] [Updated] (HDFS-13639) SlotReleaser is not fast enough

2020-05-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13639: --- Status: Open (was: Patch Available) > SlotReleaser is not fast enough >

[jira] [Work started] (HDFS-13639) SlotReleaser is not fast enough

2020-05-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13639 started by Lisheng Sun. -- > SlotReleaser is not fast enough > --- > >

[jira] [Updated] (HDFS-13639) SlotReleaser is not fast enough

2020-05-17 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13639: --- Attachment: image-2020-05-17-23-53-41-115.png > SlotReleaser is not fast enough >

[jira] [Commented] (HDFS-13639) SlotReleaser is not fast enough

2020-05-11 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105030#comment-17105030 ] Lisheng Sun commented on HDFS-13639: hi [~sodonnell]  [~ayushtkn] Could you have time to help review

[jira] [Commented] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-05-10 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103856#comment-17103856 ] Lisheng Sun commented on HDFS-15255:   {quote} 2. There was a conflict due to HDFS-14283 in

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2020-05-10 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103843#comment-17103843 ] Lisheng Sun commented on HDFS-12288: hi [~elgoiri] i understands this patch resolved the issues that

[jira] [Commented] (HDFS-14283) DFSInputStream to prefer cached replica

2020-05-05 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099836#comment-17099836 ] Lisheng Sun commented on HDFS-14283: the v009 patch updated description in hdfs-default.xml. >

[jira] [Updated] (HDFS-14283) DFSInputStream to prefer cached replica

2020-05-05 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14283: --- Attachment: HDFS-14283.009.patch > DFSInputStream to prefer cached replica >

[jira] [Updated] (HDFS-14283) DFSInputStream to prefer cached replica

2020-05-05 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14283: --- Attachment: (was: HDFS-14283.009.patch) > DFSInputStream to prefer cached replica >

[jira] [Updated] (HDFS-14283) DFSInputStream to prefer cached replica

2020-05-05 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14283: --- Attachment: HDFS-14283.009.patch > DFSInputStream to prefer cached replica >

[jira] [Commented] (HDFS-14283) DFSInputStream to prefer cached replica

2020-05-05 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099652#comment-17099652 ] Lisheng Sun commented on HDFS-14283: Thanx [~ayushtkn] for your suggestion. {quote} + if

  1   2   3   4   5   6   7   8   9   10   >