[jira] [Commented] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

2021-02-02 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277120#comment-17277120 ] huhaiyang commented on HDFS-15798: -- Upload v003 patch according to your suggestions.    > EC:

[jira] [Updated] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

2021-02-02 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15798: - Attachment: HDFS-15798.003.patch > EC: Reconstruct task failed, and It would be XmitsInProgress of DN

[jira] [Commented] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

2021-02-02 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277075#comment-17277075 ] huhaiyang commented on HDFS-15798: -- [~ferhui]    [~sodonnell] Thank you for your advice! I think it

[jira] [Comment Edited] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

2021-02-01 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276283#comment-17276283 ] huhaiyang edited comment on HDFS-15798 at 2/1/21, 12:13 PM: [~sodonnell]  We

[jira] [Comment Edited] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

2021-02-01 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276283#comment-17276283 ] huhaiyang edited comment on HDFS-15798 at 2/1/21, 12:12 PM: [~sodonnell]  We

[jira] [Commented] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

2021-02-01 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276283#comment-17276283 ] huhaiyang commented on HDFS-15798: -- [~sodonnell]  We have encountered exceptions like this in our

[jira] [Commented] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

2021-02-01 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276145#comment-17276145 ] huhaiyang commented on HDFS-15798: -- [~ferhui] Thanks for the reviews! I have carefully checked the

[jira] [Comment Edited] (HDFS-15803) Remove unnecessary method (getWeight) in StripedReconstructionInfo

2021-01-29 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17275504#comment-17275504 ] huhaiyang edited comment on HDFS-15803 at 1/30/21, 7:28 AM: Upload the simple

[jira] [Assigned] (HDFS-15803) Remove unnecessary method (getWeight) in StripedReconstructionInfo

2021-01-29 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang reassigned HDFS-15803: Assignee: huhaiyang > Remove unnecessary method (getWeight) in StripedReconstructionInfo >

[jira] [Comment Edited] (HDFS-15803) Remove unnecessary method (getWeight) in StripedReconstructionInfo

2021-01-29 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17275504#comment-17275504 ] huhaiyang edited comment on HDFS-15803 at 1/30/21, 7:28 AM: Upload the simple

[jira] [Updated] (HDFS-15803) Remove unnecessary method (getWeight) in StripedReconstructionInfo

2021-01-29 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15803: - Description:  Removing the unused method from StripedReconstructionInfo {code:java} //

[jira] [Commented] (HDFS-15803) Remove unnecessary method (getWeight) in StripedReconstructionInfo

2021-01-29 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17275504#comment-17275504 ] huhaiyang commented on HDFS-15803: -- Here is the patch to remove it. No need for new test case. > Remove

[jira] [Updated] (HDFS-15803) Remove unnecessary method (getWeight) in StripedReconstructionInfo

2021-01-29 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15803: - Description:  Removing the unused method from StripedReconstructionInfo > Remove unnecessary method

[jira] [Updated] (HDFS-15803) Remove unnecessary method (getWeight) in StripedReconstructionInfo

2021-01-29 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15803: - Attachment: HDFS-15803_001.patch > Remove unnecessary method (getWeight) in StripedReconstructionInfo >

[jira] [Created] (HDFS-15803) Remove unnecessary method (getWeight) in StripedReconstructionInfo

2021-01-29 Thread huhaiyang (Jira)
huhaiyang created HDFS-15803: Summary: Remove unnecessary method (getWeight) in StripedReconstructionInfo Key: HDFS-15803 URL: https://issues.apache.org/jira/browse/HDFS-15803 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15798: - Description: The EC reconstruct task failed, and the decrementXmitsInProgress of

[jira] [Updated] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15798: - Description: The EC reconstruct task failed, and the decrementXmitsInProgress of

[jira] [Comment Edited] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17274126#comment-17274126 ] huhaiyang edited comment on HDFS-15798 at 1/29/21, 3:07 AM: Thanks for the

[jira] [Commented] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17274126#comment-17274126 ] huhaiyang commented on HDFS-15798: -- Thanks for the reviews, [~sodonnell]  As you suggested,Updated the

[jira] [Updated] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15798: - Attachment: HDFS-15798.002.patch > EC: Reconstruct task failed, and It would be XmitsInProgress of DN

[jira] [Updated] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15798: - Description: The EC reconstruct task failed, and the decrementXmitsInProgress of

[jira] [Updated] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15798: - Description: The EC reconstruct task failed, and the decrementXmitsInProgress of

[jira] [Updated] (HDFS-15798) EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15798: - Summary: EC: Reconstruct task failed, and It would be XmitsInProgress of DN has negative number (was:

[jira] [Updated] (HDFS-15798) EC: Reconstruct task failed, and the XmitsInProgress operation will be performed twice

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15798: - Summary: EC: Reconstruct task failed, and the XmitsInProgress operation will be performed twice (was:

[jira] [Updated] (HDFS-15798) EC: Reconstruct task failed, and the decrementXmitsInProgress operation will be performed twice

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15798: - Description: The EC reconstruct task failed, and the decrementXmitsInProgress operation will be

[jira] [Updated] (HDFS-15798) EC: Reconstruct task failed, and the decrementXmitsInProgress operation will be performed twice

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15798: - Description: The EC reconstruct task failed, and the decrementXmitsInProgress operation will be

[jira] [Assigned] (HDFS-15798) EC: Reconstruct task failed, and the decrementXmitsInProgress operation will be performed twice

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang reassigned HDFS-15798: Assignee: huhaiyang > EC: Reconstruct task failed, and the decrementXmitsInProgress operation

[jira] [Updated] (HDFS-15798) EC: Reconstruct task failed, and the decrementXmitsInProgress operation will be performed twice

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15798: - Attachment: HDFS-15798.001.patch > EC: Reconstruct task failed, and the decrementXmitsInProgress

[jira] [Updated] (HDFS-15798) EC: Reconstruct task failed, and the decrementXmitsInProgress operation will be performed twice

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15798: - Description: The EC reconstruct task failed, and the decrementXmitsInProgress operation will be

[jira] [Updated] (HDFS-15798) EC: Reconstruct task failed, and the decrementXmitsInProgress operation will be performed twice

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15798: - Description: The EC reconstruct task failed, and the decrementXmitsInProgress operation will be

[jira] [Updated] (HDFS-15798) EC: Reconstruct task failed, and the decrementXmitsInProgress operation will be performed twice

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15798: - Description: The EC reconstruct task failed, and the decrementXmitsInProgress operation will be

[jira] [Updated] (HDFS-15798) EC: Reconstruct task failed, and the decrementXmitsInProgress operation will be performed twice

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15798: - Description: The EC reconstruct task failed, and the decrementXmitsInProgress operation will be

[jira] [Updated] (HDFS-15798) EC: Reconstruct task failed, and the decrementXmitsInProgress operation will be performed twice

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15798: - Summary: EC: Reconstruct task failed, and the decrementXmitsInProgress operation will be performed twice

[jira] [Updated] (HDFS-15798) EC:Reconstruction task failed, and the decrementXmitsInProgress operation will be performed twice

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15798: - Description: The EC refactoring task failed, and the decrementXmitsInProgress operation will be

[jira] [Updated] (HDFS-15798) EC:Reconstruction task failed, and the decrementXmitsInProgress operation will be performed twice

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15798: - Description: The EC refactoring task failed, and the decrementXmitsInProgress operation will be

[jira] [Created] (HDFS-15798) EC:Reconstruction task failed, and the decrementXmitsInProgress operation will be performed twice

2021-01-28 Thread huhaiyang (Jira)
huhaiyang created HDFS-15798: Summary: EC:Reconstruction task failed, and the decrementXmitsInProgress operation will be performed twice Key: HDFS-15798 URL: https://issues.apache.org/jira/browse/HDFS-15798

[jira] [Updated] (HDFS-15798) EC:Reconstruction task failed, and the decrementXmitsInProgress operation will be performed twice

2021-01-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15798: - Description: The EC refactoring task failed, and the decrementXmitsInProgress operation will be

[jira] [Commented] (HDFS-12861) Track speed in DFSClient

2020-12-15 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249676#comment-17249676 ] huhaiyang commented on HDFS-12861: --   {code:java} // code placeholder diff --git

[jira] [Updated] (HDFS-15697) Fast copy support EC for HDFS.

2020-11-27 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15697: - Description: Enhance FastCopy to support EC file . (was: Enhance FastCopy to support EC file ) > Fast

[jira] [Updated] (HDFS-15697) Fast copy support EC for HDFS.

2020-11-27 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15697: - External issue ID: (was: https://issues.apache.org/jira/browse/HDFS-2139) > Fast copy support EC for

[jira] [Updated] (HDFS-15697) Fast copy support EC for HDFS.

2020-11-27 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15697: - External issue ID: https://issues.apache.org/jira/browse/HDFS-2139 > Fast copy support EC for HDFS. >

[jira] [Updated] (HDFS-15697) Fast copy support EC for HDFS.

2020-11-27 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15697: - Description: Enhance FastCopy to support EC file > Fast copy support EC for HDFS. >

[jira] [Created] (HDFS-15697) Fast copy support EC for HDFS.

2020-11-27 Thread huhaiyang (Jira)
huhaiyang created HDFS-15697: Summary: Fast copy support EC for HDFS. Key: HDFS-15697 URL: https://issues.apache.org/jira/browse/HDFS-15697 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Commented] (HDFS-12861) Track speed in DFSClient

2020-09-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203054#comment-17203054 ] huhaiyang commented on HDFS-12861: -- [~elgoiri]It looks like very good work And are there plans to merge

[jira] [Comment Edited] (HDFS-12861) Track speed in DFSClient

2020-09-28 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203054#comment-17203054 ] huhaiyang edited comment on HDFS-12861 at 9/28/20, 7:29 AM: [~elgoiri] It

[jira] [Comment Edited] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-04 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190601#comment-17190601 ] huhaiyang edited comment on HDFS-15556 at 9/4/20, 7:28 AM: --- The current issue

[jira] [Commented] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-04 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190601#comment-17190601 ] huhaiyang commented on HDFS-15556: -- The current issue is the same as[HDFS-14042|

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Attachment: NN_DN.LOG > Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline >

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Attachment: (was: NN_DN.LOG) > Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN

[jira] [Comment Edited] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190108#comment-17190108 ] huhaiyang edited comment on HDFS-15556 at 9/3/20, 12:48 PM: [~hexiaoqiao]

[jira] [Comment Edited] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190108#comment-17190108 ] huhaiyang edited comment on HDFS-15556 at 9/3/20, 12:43 PM: 3.the cause of

[jira] [Comment Edited] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190108#comment-17190108 ] huhaiyang edited comment on HDFS-15556 at 9/3/20, 12:42 PM: 3.the cause of

[jira] [Comment Edited] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190108#comment-17190108 ] huhaiyang edited comment on HDFS-15556 at 9/3/20, 12:41 PM: 3.the cause of

[jira] [Comment Edited] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190108#comment-17190108 ] huhaiyang edited comment on HDFS-15556 at 9/3/20, 12:39 PM: 3.the cause of

[jira] [Comment Edited] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190108#comment-17190108 ] huhaiyang edited comment on HDFS-15556 at 9/3/20, 12:38 PM: 3.the cause of

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Attachment: NN_DN.LOG > Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline >

[jira] [Comment Edited] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190108#comment-17190108 ] huhaiyang edited comment on HDFS-15556 at 9/3/20, 12:36 PM: 3.the cause of

[jira] [Comment Edited] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190108#comment-17190108 ] huhaiyang edited comment on HDFS-15556 at 9/3/20, 12:36 PM: 3.the cause of

[jira] [Commented] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190108#comment-17190108 ] huhaiyang commented on HDFS-15556: -- 3.the cause of occurred the problem is: {quote} 1.One DataNode

[jira] [Comment Edited] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17189991#comment-17189991 ] huhaiyang edited comment on HDFS-15556 at 9/3/20, 9:30 AM: --- 1. CPU NameNode

[jira] [Comment Edited] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17189991#comment-17189991 ] huhaiyang edited comment on HDFS-15556 at 9/3/20, 9:25 AM: --- 1. CPU NameNode

[jira] [Comment Edited] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17189991#comment-17189991 ] huhaiyang edited comment on HDFS-15556 at 9/3/20, 9:24 AM: --- # CPU NameNode

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Attachment: (was: NN-jstack.png) > Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Attachment: NN-jstack.png > Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline >

[jira] [Commented] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17189991#comment-17189991 ] huhaiyang commented on HDFS-15556: -- # CPU NameNode high, thread stack is !NN-jstack.png! # > Fix

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Attachment: screenshot-1.png > Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Attachment: (was: screenshot-1.png) > Fix NPE in DatanodeDescriptor#updateStorageStats when handle

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Attachment: NN-CPU.png > Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline >

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Attachment: HDFS-15556.001.patch > Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Attachment: (was: NN-CPU.png) > Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Attachment: NN-CPU.png > Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline >

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Description: In our cluster, the NameNode appears NPE when processing lifeline messages sent by the

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Description: In our cluster, the NameNode appears NPE when processing lifeline messages sent by the

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Description: In our cluster, the NameNode appears NPE when processing lifeline messages sent by the

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Description: In our cluster, the NameNode appears NPE when processing lifeline messages sent by the

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Description: In our cluster, the NameNode appears NPE when processing lifeline messages sent by the

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Description: In our cluster, the NameNode appears NPE when processing lifeline messages sent by the

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Description: In our cluster, the NameNode appears NPE when processing lifeline messages sent by the

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Description: In our cluster, the NameNode appears NPE when processing lifeline messages sent by the

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Description: In our cluster, the NameNode appears NPE when processing lifeline messages sent by the

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Description: In our cluster, the NameNode appears NPE when processing lifeline messages sent by the

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Description: In our cluster, the NameNode appears NPE when processing lifeline messages sent by the

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Description: In our cluster, the NameNode appears NPE when processing lifeline messages sent by the

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Description: In our cluster, the NameNode appears NPE when processing lifeline messages sent by the

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Description: In our cluster, the NameNode appears NPE when processing lifeline messages sent by the

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Description: In our cluster, the NameNode appears NPE when processing lifeline messages sent by the

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Description: In our cluster, the NameNode appears NPE when processing lifeline messages sent by the

[jira] [Updated] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huhaiyang updated HDFS-15556: - Description: In our cluster, the NameNode appears NPE when processing lifeline messages sent by the

[jira] [Created] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-03 Thread huhaiyang (Jira)
huhaiyang created HDFS-15556: Summary: Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline Key: HDFS-15556 URL: https://issues.apache.org/jira/browse/HDFS-15556 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15391) Standby NameNode due loads the corruption edit log, the service exits and cannot be restarted

2020-06-15 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135712#comment-17135712 ] huhaiyang commented on HDFS-15391: -- Thanks [~hexiaoqiao] To help solve. > Standby NameNode due loads

[jira] [Commented] (HDFS-15391) Standby NameNode due loads the corruption edit log, the service exits and cannot be restarted

2020-06-15 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135698#comment-17135698 ] huhaiyang commented on HDFS-15391: -- [~liuml07] Thank you for reply! The current issue is the same as

[jira] [Commented] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

2020-06-12 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134129#comment-17134129 ] huhaiyang commented on HDFS-15175: -- hi [~wanchang] Thank you for reply.

[jira] [Comment Edited] (HDFS-15391) Standby NameNode due loads the corruption edit log, the service exits and cannot be restarted

2020-06-12 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133910#comment-17133910 ] huhaiyang edited comment on HDFS-15391 at 6/12/20, 6:14 AM: [~ayushtkn] Thank

[jira] [Comment Edited] (HDFS-15391) Standby NameNode due loads the corruption edit log, the service exits and cannot be restarted

2020-06-12 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133245#comment-17133245 ] huhaiyang edited comment on HDFS-15391 at 6/12/20, 6:13 AM: Hi [~ayushtkn]

[jira] [Comment Edited] (HDFS-15391) Standby NameNode due loads the corruption edit log, the service exits and cannot be restarted

2020-06-11 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133910#comment-17133910 ] huhaiyang edited comment on HDFS-15391 at 6/12/20, 4:23 AM: [~ayushtkn] Thank

[jira] [Comment Edited] (HDFS-15391) Standby NameNode due loads the corruption edit log, the service exits and cannot be restarted

2020-06-11 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133910#comment-17133910 ] huhaiyang edited comment on HDFS-15391 at 6/12/20, 4:24 AM: [~ayushtkn] Thank

[jira] [Commented] (HDFS-15391) Standby NameNode due loads the corruption edit log, the service exits and cannot be restarted

2020-06-11 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133910#comment-17133910 ] huhaiyang commented on HDFS-15391: -- [~ayushtkn] Thank you for reply! Will try to reproduce. However,

[jira] [Commented] (HDFS-15391) Standby NameNode due loads the corruption edit log, the service exits and cannot be restarted

2020-06-11 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133865#comment-17133865 ] huhaiyang commented on HDFS-15391: -- Hi [~hexiaoqiao] Thank you for reply! {quote} Do you enable

[jira] [Comment Edited] (HDFS-15391) Standby NameNode due loads the corruption edit log, the service exits and cannot be restarted

2020-06-11 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133245#comment-17133245 ] huhaiyang edited comment on HDFS-15391 at 6/11/20, 1:28 PM: Hi [~ayushtkn]

[jira] [Comment Edited] (HDFS-15391) Standby NameNode due loads the corruption edit log, the service exits and cannot be restarted

2020-06-11 Thread huhaiyang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133245#comment-17133245 ] huhaiyang edited comment on HDFS-15391 at 6/11/20, 1:13 PM: Hi [~ayushtkn]

  1   2   >