[jira] [Updated] (HDFS-14808) EC: Improper size values for corrupt ec block in LOG

[ https://issues.apache.org/jira/browse/HDFS-14808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14808: --- Component/s: ec > EC: Improper size values for corrupt ec block in LOG >

[jira] [Reopened] (HDFS-7134) Replication count for a block should not update till the blocks have settled on Datanodes

[ https://issues.apache.org/jira/browse/HDFS-7134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-7134: --- > Replication count for a block should not update till the blocks have settled > on Datanodes >

[jira] [Resolved] (HDFS-7134) Replication count for a block should not update till the blocks have settled on Datanodes

[ https://issues.apache.org/jira/browse/HDFS-7134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-7134. --- Resolution: Cannot Reproduce Resolve as cannot reproduce. > Replication count for a block

[jira] [Commented] (HDFS-14754) Erasure Coding : The number of Under-Replicated Blocks never reduced

[ https://issues.apache.org/jira/browse/HDFS-14754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941376#comment-16941376 ] Wei-Chiu Chuang commented on HDFS-14754: Too bad this one didn't land in 3.2.1 and 3.1.3. Let's

[jira] [Comment Edited] (HDFS-14754) Erasure Coding : The number of Under-Replicated Blocks never reduced

[ https://issues.apache.org/jira/browse/HDFS-14754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941376#comment-16941376 ] Wei-Chiu Chuang edited comment on HDFS-14754 at 9/30/19 10:20 PM: -- Too

[jira] [Updated] (HDFS-14754) Erasure Coding : The number of Under-Replicated Blocks never reduced

[ https://issues.apache.org/jira/browse/HDFS-14754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14754: --- Component/s: ec > Erasure Coding : The number of Under-Replicated Blocks never reduced >

[jira] [Updated] (HDFS-14528) Failover from Active to Standby Failed

[ https://issues.apache.org/jira/browse/HDFS-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14528: --- Labels: multi-sbnn (was: ) > Failover from Active to Standby Failed >

[jira] [Updated] (HDFS-14855) client always print standbyexception info with multi standby namenode

[ https://issues.apache.org/jira/browse/HDFS-14855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14855: --- Labels: multi-sbnn (was: ) > client always print standbyexception info with multi standby

[jira] [Updated] (HDFS-14201) Ability to disallow safemode NN to become active

[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14201: --- Labels: multi-sbnn (was: ) > Ability to disallow safemode NN to become active >

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941238#comment-16941238 ] Wei-Chiu Chuang commented on HDFS-14305: HDFS-6440 was backported into branch-2 by HDFS-14205.

[jira] [Commented] (HDFS-14793) BlockTokenSecretManager should LOG block token range it operates on.

[ https://issues.apache.org/jira/browse/HDFS-14793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941235#comment-16941235 ] Wei-Chiu Chuang commented on HDFS-14793: Looks good, but it is superseded by HDFS-14305. >

[jira] [Updated] (HDFS-14378) Simplify the design of multiple NN and both logic of edit log roll and checkpoint

[ https://issues.apache.org/jira/browse/HDFS-14378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14378: --- Labels: multi-sbnn (was: ) > Simplify the design of multiple NN and both logic of edit log

[jira] [Updated] (HDFS-14646) Standby NameNode should not upload fsimage to an inappropriate NameNode.

[ https://issues.apache.org/jira/browse/HDFS-14646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14646: --- Labels: multi-sbnn (was: ) > Standby NameNode should not upload fsimage to an inappropriate

[jira] [Updated] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14305: --- Labels: multi-sbnn (was: ) > Serial number in BlockTokenSecretManager could overlap between

[jira] [Updated] (HDFS-14883) NPE when the second SNN is starting

[ https://issues.apache.org/jira/browse/HDFS-14883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14883: --- Labels: multi-sbnn (was: ) > NPE when the second SNN is starting >

[jira] [Commented] (HDFS-14883) NPE when the second SNN is starting

[ https://issues.apache.org/jira/browse/HDFS-14883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941164#comment-16941164 ] Wei-Chiu Chuang commented on HDFS-14883: Assuming this is related to the multi-standby-nn

[jira] [Resolved] (HDFS-14564) Add libhdfs APIs for readFully; add readFully to ByteBufferPositionedReadable

[ https://issues.apache.org/jira/browse/HDFS-14564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14564. Fix Version/s: 3.3.0 Resolution: Fixed Thanks [~stakiar] for the patch and [~smeng]

[jira] [Commented] (HDFS-13901) INode access time is ignored because of race between open and rename

[ https://issues.apache.org/jira/browse/HDFS-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937047#comment-16937047 ] Wei-Chiu Chuang commented on HDFS-13901: Thanks for the update and the awesome benchmark result.

[jira] [Updated] (HDFS-14868) RBF: Fix typo in TestRouterQuota

[ https://issues.apache.org/jira/browse/HDFS-14868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14868: --- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-14778) BlockManager findAndMarkBlockAsCorrupt adds block to the map if the Storage state is failed

[ https://issues.apache.org/jira/browse/HDFS-14778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936272#comment-16936272 ] Wei-Chiu Chuang commented on HDFS-14778: I've definitely seen something similar happened which

[jira] [Commented] (HDFS-14868) RBF: Fix typo in TestRouterQuota

[ https://issues.apache.org/jira/browse/HDFS-14868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936260#comment-16936260 ] Wei-Chiu Chuang commented on HDFS-14868: +1 > RBF: Fix typo in TestRouterQuota >

[jira] [Updated] (HDFS-14849) Erasure Coding: the internal block is replicated many times when datanode is decommissioning

[ https://issues.apache.org/jira/browse/HDFS-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14849: --- Component/s: erasure-coding ec > Erasure Coding: the internal block is

[jira] [Updated] (HDFS-13732) ECAdmin should print the policy name when an EC policy is set

[ https://issues.apache.org/jira/browse/HDFS-13732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13732: --- Component/s: ec > ECAdmin should print the policy name when an EC policy is set >

[jira] [Commented] (HDFS-14858) [SBN read] Allow configurably enable/disable AlignmentContext on NameNode

[ https://issues.apache.org/jira/browse/HDFS-14858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936245#comment-16936245 ] Wei-Chiu Chuang commented on HDFS-14858: {code} public static final boolean

[jira] [Commented] (HDFS-14854) Create improved decommission monitor implementation

[ https://issues.apache.org/jira/browse/HDFS-14854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936075#comment-16936075 ] Wei-Chiu Chuang commented on HDFS-14854: Great writeup, thanks [~sodonnell]. I suspect we want to

[jira] [Commented] (HDFS-14858) [SBN read] Allow configurably enable/disable AlignmentContext on NameNode

[ https://issues.apache.org/jira/browse/HDFS-14858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935435#comment-16935435 ] Wei-Chiu Chuang commented on HDFS-14858: should we consider this as a blocker for 3.2.1 and 3.1.3

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935174#comment-16935174 ] Wei-Chiu Chuang commented on HDFS-14509: If this patch has to be applied to 3.x, it would be

[jira] [Updated] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14509: --- Target Version/s: 2.10.0, 3.3.0, 3.2.1, 3.1.3 (was: 2.10.0, 3.3.0, 3.1.4, 3.2.2) > DN

[jira] [Updated] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14509: --- Target Version/s: 2.10.0, 3.3.0, 3.1.4, 3.2.2 (was: 2.10.0, 3.3.0) > DN throws InvalidToken

[jira] [Updated] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14509: --- Target Version/s: 2.10.0, 3.3.0 (was: 2.10.0) > DN throws InvalidToken due to inequality of

[jira] [Commented] (HDFS-14851) WebHdfs Returns 200 Status Code for Open of Files with Corrupt Blocks

[ https://issues.apache.org/jira/browse/HDFS-14851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933819#comment-16933819 ] Wei-Chiu Chuang commented on HDFS-14851: I don't recall if something similar is implemented in

[jira] [Updated] (HDFS-14847) Blocks are over-replicated while EC decommissioning

[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14847: --- Component/s: (was: hdfs) ec > Blocks are over-replicated while EC

[jira] [Updated] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14852: --- Component/s: (was: hdfs) ec > Remove of LowRedundancyBlocks do NOT

[jira] [Updated] (HDFS-14836) FileIoProvider should not increase FileIoErrors metric in datanode volume metric

[ https://issues.apache.org/jira/browse/HDFS-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14836: --- Fix Version/s: 3.2.2 3.1.4 3.3.0 Resolution:

[jira] [Updated] (HDFS-14308) DFSStripedInputStream curStripeBuf is not freed by unbuffer()

[ https://issues.apache.org/jira/browse/HDFS-14308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14308: --- Component/s: ec > DFSStripedInputStream curStripeBuf is not freed by unbuffer() >

[jira] [Updated] (HDFS-14675) Increase Balancer Defaults Further

[ https://issues.apache.org/jira/browse/HDFS-14675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14675: --- Release Note: Increase default bandwidth limit for rebalancing per DataNode

[jira] [Updated] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14771: --- Fix Version/s: 2.10.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-14174) Enhance Audit for chown ( internally setOwner)

[ https://issues.apache.org/jira/browse/HDFS-14174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930967#comment-16930967 ] Wei-Chiu Chuang commented on HDFS-14174: I just wanted to emphasize there are tools that parse

[jira] [Commented] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930951#comment-16930951 ] Wei-Chiu Chuang commented on HDFS-14771: +1 Once this features goes into branch-2 (which will

[jira] [Updated] (HDFS-14836) FileIoProvider should not increase FileIoErrors metric in datanode volume metric

[ https://issues.apache.org/jira/browse/HDFS-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14836: --- Status: Patch Available (was: Open) LGTM +1 pending Jenkins > FileIoProvider should not

[jira] [Commented] (HDFS-14836) FileIoProvider should not increase FileIoErrors metric in datanode volume metric

[ https://issues.apache.org/jira/browse/HDFS-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929569#comment-16929569 ] Wei-Chiu Chuang commented on HDFS-14836: bq. So why we not keep consistency to HDFS-2054 . Ok.

[jira] [Updated] (HDFS-14821) Make HDFS-14617 (fsimage sub-sections) off by default

[ https://issues.apache.org/jira/browse/HDFS-14821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14821: --- Resolution: Fixed Status: Resolved (was: Patch Available) Pushed to trunk. Thanks

[jira] [Commented] (HDFS-14778) BlockManager findAndMarkBlockAsCorrupt adds block to the map if the Storage state is failed

[ https://issues.apache.org/jira/browse/HDFS-14778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928109#comment-16928109 ] Wei-Chiu Chuang commented on HDFS-14778: It would be really nice if you can update the test

[jira] [Commented] (HDFS-14836) FileIoProvider should not increase FileIoErrors metric in datanode volume metric

[ https://issues.apache.org/jira/browse/HDFS-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927514#comment-16927514 ] Wei-Chiu Chuang commented on HDFS-14836: Thanks for the patch. I have a few comments and please

[jira] [Commented] (HDFS-14074) DataNode runs async disk checks maybe throws NullPointerException, and DataNode failed to register to NameSpace.

[ https://issues.apache.org/jira/browse/HDFS-14074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926344#comment-16926344 ] Wei-Chiu Chuang commented on HDFS-14074: Removed the incompatible change flag. This is a harmless

[jira] [Updated] (HDFS-14074) DataNode runs async disk checks maybe throws NullPointerException, and DataNode failed to register to NameSpace.

[ https://issues.apache.org/jira/browse/HDFS-14074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14074: --- Hadoop Flags: Reviewed (was: Incompatible change,Reviewed) > DataNode runs async disk

[jira] [Commented] (HDFS-14836) FileIoProvider should not increase FileIoErrors metric in datanode volume metric

[ https://issues.apache.org/jira/browse/HDFS-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926308#comment-16926308 ] Wei-Chiu Chuang commented on HDFS-14836: Got it. Thanks. That makes sense to me. >

[jira] [Resolved] (HDFS-14774) RBF: Improve RouterWebhdfsMethods#chooseDatanode() error handling

[ https://issues.apache.org/jira/browse/HDFS-14774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14774. Resolution: Not A Problem Thanks CR. I'm resolving it. > RBF: Improve

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926109#comment-16926109 ] Wei-Chiu Chuang commented on HDFS-14509: [~ferhui] can you tell if this fix is still required

[jira] [Assigned] (HDFS-14836) FileIoProvider should not increase FileIoErrors metric in datanode volume metric

[ https://issues.apache.org/jira/browse/HDFS-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-14836: -- Assignee: Aiphago > FileIoProvider should not increase FileIoErrors metric in

[jira] [Commented] (HDFS-14836) FileIoProvider should not increase FileIoErrors metric in datanode volume metric

[ https://issues.apache.org/jira/browse/HDFS-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925670#comment-16925670 ] Wei-Chiu Chuang commented on HDFS-14836: I don't think I understand the proposal here.    Upon

[jira] [Commented] (HDFS-14831) Downgrade Failed from 3.2.0 to 2.7 because of incompatible stringtable

[ https://issues.apache.org/jira/browse/HDFS-14831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925291#comment-16925291 ] Wei-Chiu Chuang commented on HDFS-14831: The same fix is in branch-2.7 (not in the last release

[jira] [Commented] (HDFS-14810) review FSNameSystem editlog sync

[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924215#comment-16924215 ] Wei-Chiu Chuang commented on HDFS-14810: [~ayushtkn] i'm really sorry coming to this late. I am

[jira] [Comment Edited] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923122#comment-16923122 ] Wei-Chiu Chuang edited comment on HDFS-14771 at 9/5/19 7:21 AM: Had a

[jira] [Commented] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923122#comment-16923122 ] Wei-Chiu Chuang commented on HDFS-14771: Had a quick look at this and looks good to me.

[jira] [Commented] (HDFS-14821) Make HDFS-14617 (fsimage sub-sections) off by default

[ https://issues.apache.org/jira/browse/HDFS-14821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922708#comment-16922708 ] Wei-Chiu Chuang commented on HDFS-14821: +1 best to avoid the complication of rolling

[jira] [Commented] (HDFS-14758) Decrease lease hard limit

[ https://issues.apache.org/jira/browse/HDFS-14758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921793#comment-16921793 ] Wei-Chiu Chuang commented on HDFS-14758: I think Kihwal is much more experienced than I do so

[jira] [Commented] (HDFS-14637) Namenode may not replicate blocks to meet the policy after enabling upgradeDomain

[ https://issues.apache.org/jira/browse/HDFS-14637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921514#comment-16921514 ] Wei-Chiu Chuang commented on HDFS-14637: [~ayushtkn] would you like to review this patch as well?

[jira] [Resolved] (HDFS-14706) Checksums are not checked if block meta file is less than 7 bytes

[ https://issues.apache.org/jira/browse/HDFS-14706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14706. Resolution: Fixed Done. Reverted the commits and pushed 08 patch to trunk branch-3.2 and

[jira] [Reopened] (HDFS-14706) Checksums are not checked if block meta file is less than 7 bytes

[ https://issues.apache.org/jira/browse/HDFS-14706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-14706: Reopen. For future reference, I committed the wrong patch. I'm going to revert and re-apply

[jira] [Commented] (HDFS-14809) Make a new BlockReader for hdfs client lib

[ https://issues.apache.org/jira/browse/HDFS-14809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920283#comment-16920283 ] Wei-Chiu Chuang commented on HDFS-14809: Thanks for the proposal. Looks like a new feature

[jira] [Updated] (HDFS-14809) Make a new BlockReader for hdfs client lib

[ https://issues.apache.org/jira/browse/HDFS-14809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14809: --- Issue Type: New Feature (was: Bug) > Make a new BlockReader for hdfs client lib >

[jira] [Updated] (HDFS-8178) QJM doesn't move aside stale inprogress edits files

[ https://issues.apache.org/jira/browse/HDFS-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-8178: -- Fix Version/s: 3.1.3 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919720#comment-16919720 ] Wei-Chiu Chuang commented on HDFS-11246: It would make a good candidate for branch-2. I don't

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919609#comment-16919609 ] Wei-Chiu Chuang commented on HDFS-13157: Good work, [~belugabehr]! I think it makes sense to look

[jira] [Commented] (HDFS-14800) Data race between block report and recoverLease()

[ https://issues.apache.org/jira/browse/HDFS-14800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919594#comment-16919594 ] Wei-Chiu Chuang commented on HDFS-14800: I need to check the code. But I believe a block is

[jira] [Commented] (HDFS-14801) PrometheusMetricsSink: Better support for NNTop

[ https://issues.apache.org/jira/browse/HDFS-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919099#comment-16919099 ] Wei-Chiu Chuang commented on HDFS-14801: Please keep backward computability please >

[jira] [Updated] (HDFS-14748) Make DataNodePeerMetrics#minOutlierDetectionSamples configurable

[ https://issues.apache.org/jira/browse/HDFS-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14748: --- Fix Version/s: 3.1.3 3.2.1 Resolution: Fixed Status:

[jira] [Updated] (HDFS-14748) Make DataNodePeerMetrics#minOutlierDetectionSamples configurable

[ https://issues.apache.org/jira/browse/HDFS-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14748: --- Fix Version/s: 3.3.0 > Make DataNodePeerMetrics#minOutlierDetectionSamples configurable >

[jira] [Updated] (HDFS-14706) Checksums are not checked if block meta file is less than 7 bytes

[ https://issues.apache.org/jira/browse/HDFS-14706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14706: --- Fix Version/s: (was: 3.1.4) 3.1.3 > Checksums are not checked if

[jira] [Updated] (HDFS-14706) Checksums are not checked if block meta file is less than 7 bytes

[ https://issues.apache.org/jira/browse/HDFS-14706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14706: --- Resolution: Fixed Status: Resolved (was: Patch Available) Pushed to trunk,

[jira] [Updated] (HDFS-14706) Checksums are not checked if block meta file is less than 7 bytes

[ https://issues.apache.org/jira/browse/HDFS-14706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14706: --- Fix Version/s: 3.1.4 > Checksums are not checked if block meta file is less than 7 bytes >

[jira] [Updated] (HDFS-14706) Checksums are not checked if block meta file is less than 7 bytes

[ https://issues.apache.org/jira/browse/HDFS-14706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14706: --- Fix Version/s: 3.2.1 > Checksums are not checked if block meta file is less than 7 bytes >

[jira] [Updated] (HDFS-14706) Checksums are not checked if block meta file is less than 7 bytes

[ https://issues.apache.org/jira/browse/HDFS-14706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14706: --- Fix Version/s: 3.3.0 > Checksums are not checked if block meta file is less than 7 bytes >

[jira] [Commented] (HDFS-14706) Checksums are not checked if block meta file is less than 7 bytes

[ https://issues.apache.org/jira/browse/HDFS-14706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919069#comment-16919069 ] Wei-Chiu Chuang commented on HDFS-14706: +1 > Checksums are not checked if block meta file is

[jira] [Updated] (HDFS-14800) Data race between block report and recoverLease()

[ https://issues.apache.org/jira/browse/HDFS-14800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14800: --- Description: I thought I fixed it in HDFS-10240, but I am seeing a similar race condition in

[jira] [Updated] (HDFS-14800) Data race between block report and recoverLease()

[ https://issues.apache.org/jira/browse/HDFS-14800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14800: --- Attachment: PreCommit-HDFS-Build #27717 test - testUpgradeFromRel1BBWImage [Jenkins].pdf >

[jira] [Created] (HDFS-14800) Data race between block report and recoverLease()

Wei-Chiu Chuang created HDFS-14800: -- Summary: Data race between block report and recoverLease() Key: HDFS-14800 URL: https://issues.apache.org/jira/browse/HDFS-14800 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8178) QJM doesn't move aside stale inprogress edits files

[ https://issues.apache.org/jira/browse/HDFS-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919055#comment-16919055 ] Wei-Chiu Chuang commented on HDFS-8178: --- Pushed to trunk. There is a trivial conflict that I fixed

[jira] [Updated] (HDFS-8178) QJM doesn't move aside stale inprogress edits files

[ https://issues.apache.org/jira/browse/HDFS-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-8178: -- Attachment: HDFS-8178.branch-3.2.patch > QJM doesn't move aside stale inprogress edits files >

[jira] [Updated] (HDFS-8178) QJM doesn't move aside stale inprogress edits files

[ https://issues.apache.org/jira/browse/HDFS-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-8178: -- Fix Version/s: 3.2.1 3.3.0 > QJM doesn't move aside stale inprogress edits

[jira] [Commented] (HDFS-14277) [SBN read] Observer benchmark results

[ https://issues.apache.org/jira/browse/HDFS-14277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918894#comment-16918894 ] Wei-Chiu Chuang commented on HDFS-14277: Reassigned myself. I am sorry I wasn’t watching this

[jira] [Assigned] (HDFS-14277) [SBN read] Observer benchmark results

[ https://issues.apache.org/jira/browse/HDFS-14277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-14277: -- Assignee: (was: Wei-Chiu Chuang) > [SBN read] Observer benchmark results >

[jira] [Updated] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11246: --- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918789#comment-16918789 ] Wei-Chiu Chuang commented on HDFS-11246: Pushed v011 patch to trunk. Thanks [~hexiaoqiao] for

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918701#comment-16918701 ] Wei-Chiu Chuang commented on HDFS-11246: Patch still applies. Committing 011 patch shortly. >

[jira] [Commented] (HDFS-8178) QJM doesn't move aside stale inprogress edits files

[ https://issues.apache.org/jira/browse/HDFS-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918687#comment-16918687 ] Wei-Chiu Chuang commented on HDFS-8178: --- +1 > QJM doesn't move aside stale inprogress edits files >

[jira] [Updated] (HDFS-14796) Define LOG instead of BlockManager.LOG in ErasureCodingWork

[ https://issues.apache.org/jira/browse/HDFS-14796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14796: --- Status: Patch Available (was: Open) LGTM submitted the patch for precommit build. > Define

[jira] [Commented] (HDFS-8178) QJM doesn't move aside stale inprogress edits files

[ https://issues.apache.org/jira/browse/HDFS-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918224#comment-16918224 ] Wei-Chiu Chuang commented on HDFS-8178: --- 008 patch LGTM +1 pending Jenkins. Can you move the

[jira] [Commented] (HDFS-14706) Checksums are not checked if block meta file is less than 7 bytes

[ https://issues.apache.org/jira/browse/HDFS-14706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918200#comment-16918200 ] Wei-Chiu Chuang commented on HDFS-14706: Thanks [~sodonnell] looks good to me. There's just one

[jira] [Updated] (HDFS-14706) Checksums are not checked if block meta file is less than 7 bytes

[ https://issues.apache.org/jira/browse/HDFS-14706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14706: --- Attachment: HDFS-14706.007.patch > Checksums are not checked if block meta file is less than

[jira] [Commented] (HDFS-14790) Support Client Write Fan-Out

[ https://issues.apache.org/jira/browse/HDFS-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918150#comment-16918150 ] Wei-Chiu Chuang commented on HDFS-14790: Actually, I think this is is the project you're looking

[jira] [Assigned] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-14768: -- Assignee: guojh > In some cases, erasure blocks are corruption when they are

[jira] [Assigned] (HDFS-14780) make the information of SlowPeersReport in namenode's jmx more specific

[ https://issues.apache.org/jira/browse/HDFS-14780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-14780: -- Assignee: HaiBin Huang > make the information of SlowPeersReport in namenode's jmx

[jira] [Comment Edited] (HDFS-13270) RBF: Router audit logger

[ https://issues.apache.org/jira/browse/HDFS-13270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16917278#comment-16917278 ] Wei-Chiu Chuang edited comment on HDFS-13270 at 8/27/19 11:52 PM: --

[jira] [Commented] (HDFS-13270) RBF: Router audit logger

[ https://issues.apache.org/jira/browse/HDFS-13270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16917278#comment-16917278 ] Wei-Chiu Chuang commented on HDFS-13270: [~hemanthboyina] thanks for the patch. It's quite a big

[jira] [Updated] (HDFS-14760) Log INFO mode if snapshot usage and actual usage differ

[ https://issues.apache.org/jira/browse/HDFS-14760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14760: --- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-14760) Log INFO mode if snapshot usage and actual usage differ

[ https://issues.apache.org/jira/browse/HDFS-14760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16917229#comment-16917229 ] Wei-Chiu Chuang commented on HDFS-14760: +1 on the 002 patch. Will commit soon. > Log INFO mode

[jira] [Updated] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14771: --- Labels: release-blocker (was: ) > Backport HDFS-14617 to branch-2 (Improve fsimage load

[jira] [Updated] (HDFS-14497) Write lock held by metasave impact following RPC processing

[ https://issues.apache.org/jira/browse/HDFS-14497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14497: --- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks! > Write lock

<    6   7   8   9   10   11   12   13   14   15   >