[jira] [Resolved] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

[ https://issues.apache.org/jira/browse/HDFS-15624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15624. Resolution: Fixed The updated patch was committed. Thanks Ayush for the help! > Fix the

[jira] [Created] (HDFS-16002) TestJournalNodeRespectsBindHostKeys#testHttpsBindHostKey very flaky

Wei-Chiu Chuang created HDFS-16002: -- Summary: TestJournalNodeRespectsBindHostKeys#testHttpsBindHostKey very flaky Key: HDFS-16002 URL: https://issues.apache.org/jira/browse/HDFS-16002 Project:

[jira] [Updated] (HDFS-15982) Deleted data using HTTP API should be saved to the trash

[ https://issues.apache.org/jira/browse/HDFS-15982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15982: --- ===Bulk update=== I am planning to cut the branch for Hadoop 3.3.1 release, and this jira

[jira] [Updated] (HDFS-15788) Correct the statement for pmem cache to reflect cache persistence support

[ https://issues.apache.org/jira/browse/HDFS-15788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15788: --- ===Bulk update=== I am planning to cut the branch for Hadoop 3.3.1 release, and this jira

[jira] [Updated] (HDFS-13916) Distcp SnapshotDiff to support WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13916: --- ===Bulk update=== I am planning to cut the branch for Hadoop 3.3.1 release, and this jira

[jira] [Updated] (HDFS-15566) NN restart fails after RollingUpgrade from 3.1.3/3.2.1 to 3.3.0

[ https://issues.apache.org/jira/browse/HDFS-15566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15566: --- Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed Status:

[jira] [Commented] (HDFS-15566) NN restart fails after RollingUpgrade from 3.1.3/3.2.1 to 3.3.0

[ https://issues.apache.org/jira/browse/HDFS-15566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17331714#comment-17331714 ] Wei-Chiu Chuang commented on HDFS-15566: +1 committing 003. > NN restart fails after

[jira] [Work started] (HDFS-15995) Rework HDFS-15624 Fix the SetQuotaByStorageTypeOp problem after updating hadoop

[ https://issues.apache.org/jira/browse/HDFS-15995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15995 started by Wei-Chiu Chuang. -- > Rework HDFS-15624 Fix the SetQuotaByStorageTypeOp problem after updating

[jira] [Commented] (HDFS-15982) Deleted data using HTTP API should be saved to the trash

[ https://issues.apache.org/jira/browse/HDFS-15982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17331521#comment-17331521 ] Wei-Chiu Chuang commented on HDFS-15982: So – essentially we change the default behavior of

[jira] [Created] (HDFS-15995) Rework HDFS-15624 Fix the SetQuotaByStorageTypeOp problem after updating hadoop

Wei-Chiu Chuang created HDFS-15995: -- Summary: Rework HDFS-15624 Fix the SetQuotaByStorageTypeOp problem after updating hadoop Key: HDFS-15995 URL: https://issues.apache.org/jira/browse/HDFS-15995

[jira] [Comment Edited] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

[ https://issues.apache.org/jira/browse/HDFS-15624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17329956#comment-17329956 ] Wei-Chiu Chuang edited comment on HDFS-15624 at 4/23/21, 8:29 AM: -- Hi

[jira] [Reopened] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

[ https://issues.apache.org/jira/browse/HDFS-15624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-15624: > Fix the SetQuotaByStorageTypeOp problem after updating hadoop >

[jira] [Commented] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

[ https://issues.apache.org/jira/browse/HDFS-15624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17329956#comment-17329956 ] Wei-Chiu Chuang commented on HDFS-15624: Hi looks like we have a problem here. I'm going to

[jira] [Commented] (HDFS-15566) NN restart fails after RollingUpgrade from 3.1.3/3.2.1 to 3.3.0

[ https://issues.apache.org/jira/browse/HDFS-15566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17329955#comment-17329955 ] Wei-Chiu Chuang commented on HDFS-15566: HDFS-15624 blocks this jira. We need to find a solution.

[jira] [Commented] (HDFS-15850) Superuser actions should be reported to external enforcers

[ https://issues.apache.org/jira/browse/HDFS-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17327041#comment-17327041 ] Wei-Chiu Chuang commented on HDFS-15850: We should get HADOOP-17079 to branch-3.3 too. I'll look

[jira] [Commented] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17325054#comment-17325054 ] Wei-Chiu Chuang commented on HDFS-15796: [~Daniel Ma] ping. Please let us know more details.

[jira] [Updated] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15796: --- Target Version/s: 3.4.0 (was: 3.3.1) > ConcurrentModificationException error happens on

[jira] [Updated] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15796: --- Fix Version/s: (was: 3.1.1) > ConcurrentModificationException error happens on NameNode

[jira] [Updated] (HDFS-15965) Please upgrade the log4j dependency to log4j2

[ https://issues.apache.org/jira/browse/HDFS-15965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15965: --- Fix Version/s: (was: 3.4.0) (was: 3.3.0) > Please upgrade the

[jira] [Updated] (HDFS-15964) Please update the okhttp version to 4.9.1

[ https://issues.apache.org/jira/browse/HDFS-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15964: --- Target Version/s: 3.3.1, 3.4.0 (was: 3.3.0, 3.4.0) > Please update the okhttp version to

[jira] [Updated] (HDFS-15965) Please upgrade the log4j dependency to log4j2

[ https://issues.apache.org/jira/browse/HDFS-15965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15965: --- Target Version/s: 3.3.1, 3.4.0 (was: 3.3.0, 3.4.0) > Please upgrade the log4j dependency to

[jira] [Updated] (HDFS-15561) Fix NullPointException when start dfsrouter

[ https://issues.apache.org/jira/browse/HDFS-15561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15561: --- Target Version/s: 3.3.1 (was: 3.3.0) > Fix NullPointException when start dfsrouter >

[jira] [Commented] (HDFS-15561) Fix NullPointException when start dfsrouter

[ https://issues.apache.org/jira/browse/HDFS-15561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324645#comment-17324645 ] Wei-Chiu Chuang commented on HDFS-15561: [~fengnanli] are you taking of the PR? I'll go ahead

[jira] [Updated] (HDFS-15561) Fix NullPointException when start dfsrouter

[ https://issues.apache.org/jira/browse/HDFS-15561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15561: --- Fix Version/s: (was: 3.3.1) > Fix NullPointException when start dfsrouter >

[jira] [Updated] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15796: --- Target Version/s: 3.3.1 (was: 3.3.0) > ConcurrentModificationException error happens on

[jira] [Commented] (HDFS-15985) Incorrect sorting will cause failure to load an FsImage file

[ https://issues.apache.org/jira/browse/HDFS-15985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17322701#comment-17322701 ] Wei-Chiu Chuang commented on HDFS-15985: [~sodonnell] > Incorrect sorting will cause failure to

[jira] [Commented] (HDFS-15957) The ignored IOException in the RPC response sent by FSEditLogAsync can cause the HDFS client to hang

[ https://issues.apache.org/jira/browse/HDFS-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320983#comment-17320983 ] Wei-Chiu Chuang commented on HDFS-15957: [~kihwal] [~daryn] [~ahussein] any ideas about this

[jira] [Updated] (HDFS-15815) if required storageType are unavailable, log the failed reason during choosing Datanode

[ https://issues.apache.org/jira/browse/HDFS-15815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15815: --- Fix Version/s: 3.2.3 > if required storageType are unavailable, log the failed reason

[jira] [Updated] (HDFS-15815) if required storageType are unavailable, log the failed reason during choosing Datanode

[ https://issues.apache.org/jira/browse/HDFS-15815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15815: --- Fix Version/s: 3.3.1 > if required storageType are unavailable, log the failed reason

[jira] [Updated] (HDFS-15759) EC: Verify EC reconstruction correctness on DataNode

[ https://issues.apache.org/jira/browse/HDFS-15759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15759: --- Fix Version/s: 3.1.5 > EC: Verify EC reconstruction correctness on DataNode >

[jira] [Updated] (HDFS-15759) EC: Verify EC reconstruction correctness on DataNode

[ https://issues.apache.org/jira/browse/HDFS-15759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15759: --- Fix Version/s: 3.2.3 > EC: Verify EC reconstruction correctness on DataNode >

[jira] [Commented] (HDFS-15887) Make LogRoll and TailEdits execute in parallel

[ https://issues.apache.org/jira/browse/HDFS-15887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317645#comment-17317645 ] Wei-Chiu Chuang commented on HDFS-15887: Not an expert here, but makes sense to me. > Make

[jira] [Updated] (HDFS-15243) Add an option to prevent sub-directories of protected directories from deletion

[ https://issues.apache.org/jira/browse/HDFS-15243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15243: --- Fix Version/s: 3.3.1 > Add an option to prevent sub-directories of protected directories

[jira] [Updated] (HDFS-15759) EC: Verify EC reconstruction correctness on DataNode

[ https://issues.apache.org/jira/browse/HDFS-15759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15759: --- Fix Version/s: 3.3.1 > EC: Verify EC reconstruction correctness on DataNode >

[jira] [Commented] (HDFS-15759) EC: Verify EC reconstruction correctness on DataNode

[ https://issues.apache.org/jira/browse/HDFS-15759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17315247#comment-17315247 ] Wei-Chiu Chuang commented on HDFS-15759: This is a great tool. If no objections I intend to

[jira] [Updated] (HDFS-15316) Deletion failure should not remove directory from snapshottables

[ https://issues.apache.org/jira/browse/HDFS-15316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15316: --- Fix Version/s: 3.3.1 > Deletion failure should not remove directory from snapshottables >

[jira] [Updated] (HDFS-15351) Blocks scheduled count was wrong on truncate

[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15351: --- Fix Version/s: 3.3.1 > Blocks scheduled count was wrong on truncate >

[jira] [Updated] (HDFS-15362) FileWithSnapshotFeature#updateQuotaAndCollectBlocks should collect all distinct blocks

[ https://issues.apache.org/jira/browse/HDFS-15362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15362: --- Fix Version/s: 3.3.1 > FileWithSnapshotFeature#updateQuotaAndCollectBlocks should collect

[jira] [Updated] (HDFS-15196) RBF: RouterRpcServer getListing cannot list large dirs correctly

[ https://issues.apache.org/jira/browse/HDFS-15196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15196: --- Fix Version/s: 3.3.1 > RBF: RouterRpcServer getListing cannot list large dirs correctly >

[jira] [Updated] (HDFS-15252) HttpFS: setWorkingDirectory should not accept invalid paths

[ https://issues.apache.org/jira/browse/HDFS-15252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15252: --- Fix Version/s: 3.3.1 > HttpFS: setWorkingDirectory should not accept invalid paths >

[jira] [Updated] (HDFS-15300) RBF: updateActiveNamenode() is invalid when RPC address is IP

[ https://issues.apache.org/jira/browse/HDFS-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15300: --- Fix Version/s: 3.3.1 > RBF: updateActiveNamenode() is invalid when RPC address is IP >

[jira] [Updated] (HDFS-15198) RBF: Add test for MountTableRefresherService failed to refresh other router MountTableEntries in secure mode

[ https://issues.apache.org/jira/browse/HDFS-15198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15198: --- Fix Version/s: 3.3.1 > RBF: Add test for MountTableRefresherService failed to refresh other

[jira] [Updated] (HDFS-15591) RBF: Fix webHdfs file display error

[ https://issues.apache.org/jira/browse/HDFS-15591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15591: --- Fix Version/s: 3.3.1 > RBF: Fix webHdfs file display error >

[jira] [Updated] (HDFS-15510) RBF: Quota and Content Summary was not correct in Multiple Destinations

[ https://issues.apache.org/jira/browse/HDFS-15510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15510: --- Fix Version/s: 3.3.1 > RBF: Quota and Content Summary was not correct in Multiple

[jira] [Commented] (HDFS-15945) DataNodes with zero capacity and zero blocks should be decommissioned immediately

[ https://issues.apache.org/jira/browse/HDFS-15945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17313736#comment-17313736 ] Wei-Chiu Chuang commented on HDFS-15945: Thanks a lot for reporting the issue. Make sense to me.

[jira] [Updated] (HDFS-15266) Add missing DFSOps Statistics in WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-15266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15266: --- Fix Version/s: 3.3.1 > Add missing DFSOps Statistics in WebHDFS >

[jira] [Updated] (HDFS-15265) HttpFS: validate content-type in HttpFSUtils

[ https://issues.apache.org/jira/browse/HDFS-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15265: --- Fix Version/s: 3.3.1 > HttpFS: validate content-type in HttpFSUtils >

[jira] [Updated] (HDFS-15332) Quota Space consumed was wrong in truncate with Snapshots

[ https://issues.apache.org/jira/browse/HDFS-15332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15332: --- Fix Version/s: 3.3.1 > Quota Space consumed was wrong in truncate with Snapshots >

[jira] [Updated] (HDFS-15246) ArrayIndexOfboundsException in BlockManager CreateLocatedBlock

[ https://issues.apache.org/jira/browse/HDFS-15246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15246: --- Fix Version/s: 3.3.1 > ArrayIndexOfboundsException in BlockManager CreateLocatedBlock >

[jira] [Updated] (HDFS-15667) Audit log record the unexpected allowed result when delete called

[ https://issues.apache.org/jira/browse/HDFS-15667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15667: --- Fix Version/s: 3.3.1 > Audit log record the unexpected allowed result when delete called >

[jira] [Updated] (HDFS-14383) Compute datanode load based on StoragePolicy

[ https://issues.apache.org/jira/browse/HDFS-14383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14383: --- Fix Version/s: 3.3.1 > Compute datanode load based on StoragePolicy >

[jira] [Updated] (HDFS-15253) Set default throttle value on dfs.image.transfer.bandwidthPerSec

[ https://issues.apache.org/jira/browse/HDFS-15253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15253: --- Fix Version/s: 3.3.1 > Set default throttle value on dfs.image.transfer.bandwidthPerSec >

[jira] [Updated] (HDFS-15506) [JDK 11] Fix javadoc errors in hadoop-hdfs module

[ https://issues.apache.org/jira/browse/HDFS-15506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15506: --- Fix Version/s: 3.3.1 > [JDK 11] Fix javadoc errors in hadoop-hdfs module >

[jira] [Updated] (HDFS-15508) [JDK 11] Fix javadoc errors in hadoop-hdfs-rbf module

[ https://issues.apache.org/jira/browse/HDFS-15508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15508: --- Fix Version/s: 3.3.1 > [JDK 11] Fix javadoc errors in hadoop-hdfs-rbf module >

[jira] [Updated] (HDFS-15331) Remove invalid exclusions that minicluster dependency on HDFS

[ https://issues.apache.org/jira/browse/HDFS-15331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15331: --- Fix Version/s: 3.3.1 > Remove invalid exclusions that minicluster dependency on HDFS >

[jira] [Updated] (HDFS-15507) [JDK 11] Fix javadoc errors in hadoop-hdfs-client module

[ https://issues.apache.org/jira/browse/HDFS-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15507: --- Fix Version/s: 3.3.1 > [JDK 11] Fix javadoc errors in hadoop-hdfs-client module >

[jira] [Updated] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15651: --- Fix Version/s: 3.3.1 > Client could not obtain block when DN CommandProcessingThread exit >

[jira] [Updated] (HDFS-15253) Set default throttle value on dfs.image.transfer.bandwidthPerSec

[ https://issues.apache.org/jira/browse/HDFS-15253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15253: --- Release Note: The configuration dfs.image.transfer.bandwidthPerSec which defines the maximum

[jira] [Commented] (HDFS-15924) Log4j will cause Server handler blocked when audit log boom.

[ https://issues.apache.org/jira/browse/HDFS-15924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311345#comment-17311345 ] Wei-Chiu Chuang commented on HDFS-15924: Check this out: HDFS-15720. The additional properties

[jira] [Commented] (HDFS-15933) distcp geo hdfs site is not working

[ https://issues.apache.org/jira/browse/HDFS-15933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311138#comment-17311138 ] Wei-Chiu Chuang commented on HDFS-15933: This is not a HDFS bug. Please use user@hadoop for

[jira] [Updated] (HDFS-15456) TestExternalStoragePolicySatisfier fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15456: --- Fix Version/s: 3.3.1 > TestExternalStoragePolicySatisfier fails intermittently >

[jira] [Updated] (HDFS-14546) Document block placement policies

[ https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14546: --- Fix Version/s: 3.3.1 > Document block placement policies > -

[jira] [Updated] (HDFS-15380) RBF: Could not fetch real remote IP in RouterWebHdfsMethods

[ https://issues.apache.org/jira/browse/HDFS-15380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15380: --- Fix Version/s: 3.3.1 > RBF: Could not fetch real remote IP in RouterWebHdfsMethods >

[jira] [Updated] (HDFS-15610) Reduce datanode upgrade/hardlink thread

[ https://issues.apache.org/jira/browse/HDFS-15610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15610: --- Fix Version/s: 3.3.1 > Reduce datanode upgrade/hardlink thread >

[jira] [Updated] (HDFS-15275) HttpFS: Response of Create was not correct with noredirect and data are true

[ https://issues.apache.org/jira/browse/HDFS-15275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15275: --- Fix Version/s: 3.3.1 > HttpFS: Response of Create was not correct with noredirect and data

[jira] [Updated] (HDFS-12288) Fix DataNode's xceiver count calculation

[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12288: --- Fix Version/s: 3.3.1 > Fix DataNode's xceiver count calculation >

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307692#comment-17307692 ] Wei-Chiu Chuang commented on HDFS-15160: +1 to backport. > ReplicaMap, Disk Balancer, Directory

[jira] [Commented] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

[ https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307657#comment-17307657 ] Wei-Chiu Chuang commented on HDFS-15660: Sorry I am still confused. Shouldn't this get

[jira] [Updated] (HDFS-15249) ThrottledAsyncChecker is not thread-safe.

[ https://issues.apache.org/jira/browse/HDFS-15249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15249: --- Fix Version/s: 3.3.1 > ThrottledAsyncChecker is not thread-safe. >

[jira] [Updated] (HDFS-15743) Fix -Pdist build failure of hadoop-hdfs-native-client

[ https://issues.apache.org/jira/browse/HDFS-15743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15743: --- Fix Version/s: 3.3.1 > Fix -Pdist build failure of hadoop-hdfs-native-client >

[jira] [Commented] (HDFS-15610) Reduce datanode upgrade/hardlink thread

[ https://issues.apache.org/jira/browse/HDFS-15610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307589#comment-17307589 ] Wei-Chiu Chuang commented on HDFS-15610: I think this is a quite important improvement which

[jira] [Updated] (HDFS-15910) Replace bzero with explicit_bzero for better safety

[ https://issues.apache.org/jira/browse/HDFS-15910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15910: --- Fix Version/s: 3.3.1 > Replace bzero with explicit_bzero for better safety >

[jira] [Updated] (HDFS-15868) Possible Resource Leak in EditLogFileOutputStream

[ https://issues.apache.org/jira/browse/HDFS-15868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15868: --- Fix Version/s: 3.3.1 > Possible Resource Leak in EditLogFileOutputStream >

[jira] [Updated] (HDFS-15908) Possible Resource Leak in org.apache.hadoop.hdfs.qjournal.server.Journal

[ https://issues.apache.org/jira/browse/HDFS-15908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15908: --- Fix Version/s: 3.3.1 > Possible Resource Leak in

[jira] [Updated] (HDFS-15809) DeadNodeDetector doesn't remove live nodes from dead node set.

[ https://issues.apache.org/jira/browse/HDFS-15809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15809: --- Fix Version/s: 3.3.1 > DeadNodeDetector doesn't remove live nodes from dead node set. >

[jira] [Updated] (HDFS-15806) DeadNodeDetector should close all the threads when it is closed.

[ https://issues.apache.org/jira/browse/HDFS-15806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15806: --- Fix Version/s: 3.3.1 > DeadNodeDetector should close all the threads when it is closed. >

[jira] [Updated] (HDFS-15791) Possible Resource Leak in FSImageFormatProtobuf

[ https://issues.apache.org/jira/browse/HDFS-15791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15791: --- Fix Version/s: 3.3.1 > Possible Resource Leak in FSImageFormatProtobuf >

[jira] [Updated] (HDFS-15551) Tiny Improve for DeadNode detector

[ https://issues.apache.org/jira/browse/HDFS-15551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15551: --- Fix Version/s: 3.3.1 > Tiny Improve for DeadNode detector >

[jira] [Updated] (HDFS-15661) The DeadNodeDetector shouldn't be shared by different DFSClients.

[ https://issues.apache.org/jira/browse/HDFS-15661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15661: --- Fix Version/s: 3.3.1 > The DeadNodeDetector shouldn't be shared by different DFSClients. >

[jira] [Commented] (HDFS-15901) Solve the problem of DN repeated block reports occupying too many RPCs during Safemode

[ https://issues.apache.org/jira/browse/HDFS-15901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304646#comment-17304646 ] Wei-Chiu Chuang commented on HDFS-15901: We have some users running 1000+ node scale clusters but

[jira] [Commented] (HDFS-15719) [Hadoop 3] Both NameNodes can crash simultaneously due to the short JN socket timeout

[ https://issues.apache.org/jira/browse/HDFS-15719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298434#comment-17298434 ] Wei-Chiu Chuang commented on HDFS-15719: I'm inclined for longer timeout now. It was initially

[jira] [Commented] (HDFS-14013) Skip any credentials stored in HDFS when starting ZKFC

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292703#comment-17292703 ] Wei-Chiu Chuang commented on HDFS-14013: +1 thank you! > Skip any credentials stored in HDFS

[jira] [Commented] (HDFS-15210) EC : File write hanged when DN is shutdown by admin command.

[ https://issues.apache.org/jira/browse/HDFS-15210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291358#comment-17291358 ] Wei-Chiu Chuang commented on HDFS-15210: Cherrypicked to lower branches branch-3.3 ~ branch-3.1.

[jira] [Updated] (HDFS-15210) EC : File write hanged when DN is shutdown by admin command.

[ https://issues.apache.org/jira/browse/HDFS-15210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15210: --- Fix Version/s: 3.2.3 3.1.5 3.3.1 > EC : File write

[jira] [Commented] (HDFS-14013) HDFS ZKFC on standby NN not starting with credentials stored in hdfs

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289817#comment-17289817 ] Wei-Chiu Chuang commented on HDFS-14013: Other than that the fix LGTM > HDFS ZKFC on standby NN

[jira] [Commented] (HDFS-14013) HDFS ZKFC on standby NN not starting with credentials stored in hdfs

[ https://issues.apache.org/jira/browse/HDFS-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289782#comment-17289782 ] Wei-Chiu Chuang commented on HDFS-14013: I read the description and wondered why use HDFS to

[jira] [Commented] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289615#comment-17289615 ] Wei-Chiu Chuang commented on HDFS-15422: I think the patch looks reasonable. I am +1. bq. //

[jira] [Updated] (HDFS-15734) [READ] DirectoryScanner#scan need not check StorageType.PROVIDED

[ https://issues.apache.org/jira/browse/HDFS-15734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15734: --- Fix Version/s: (was: 3.40) 3.2.3 3.1.5

[jira] [Resolved] (HDFS-15734) [READ] DirectoryScanner#scan need not check StorageType.PROVIDED

[ https://issues.apache.org/jira/browse/HDFS-15734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15734. Fix Version/s: 3.40 Resolution: Fixed > [READ] DirectoryScanner#scan need not check

[jira] [Updated] (HDFS-15843) [libhdfs++] Make write cross platform

[ https://issues.apache.org/jira/browse/HDFS-15843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15843: --- Summary: [libhdfs++] Make write cross platform (was: Make write cross platform) >

[jira] [Resolved] (HDFS-15826) Solve the problem of incorrect progress of delegation tokens when loading FsImage

[ https://issues.apache.org/jira/browse/HDFS-15826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15826. Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Comment Edited] (HDFS-15824) Update to enable TLS >=1.2 as default secure protocols

[ https://issues.apache.org/jira/browse/HDFS-15824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280339#comment-17280339 ] Wei-Chiu Chuang edited comment on HDFS-15824 at 2/7/21, 12:09 AM: --

[jira] [Commented] (HDFS-15824) Update to enable TLS >=1.2 as default secure protocols

[ https://issues.apache.org/jira/browse/HDFS-15824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280339#comment-17280339 ] Wei-Chiu Chuang commented on HDFS-15824: Thanks for reporting the issue. I'm pretty sure we use

[jira] [Resolved] (HDFS-15801) Backport HDFS-14582 to branch-2.10 (Failed to start DN with ArithmeticException when NULL checksum used)

[ https://issues.apache.org/jira/browse/HDFS-15801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15801. Fix Version/s: 2.10.2 Resolution: Fixed Thanks. This is merged. > Backport

[jira] [Assigned] (HDFS-15801) Backport HDFS-14582 to branch-2.10 (Failed to start DN with ArithmeticException when NULL checksum used)

[ https://issues.apache.org/jira/browse/HDFS-15801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15801: -- Assignee: Janus Chow > Backport HDFS-14582 to branch-2.10 (Failed to start DN with >

[jira] [Resolved] (HDFS-15791) Possible Resource Leak in FSImageFormatProtobuf

[ https://issues.apache.org/jira/browse/HDFS-15791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15791. Fix Version/s: 3.4.0 Resolution: Fixed > Possible Resource Leak in

[jira] [Assigned] (HDFS-15791) Possible Resource Leak in FSImageFormatProtobuf

[ https://issues.apache.org/jira/browse/HDFS-15791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15791: -- Assignee: Narges Shadab > Possible Resource Leak in FSImageFormatProtobuf >

[jira] [Commented] (HDFS-15794) IBR and FBR use different queues to load data.

[ https://issues.apache.org/jira/browse/HDFS-15794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272795#comment-17272795 ] Wei-Chiu Chuang commented on HDFS-15794: I think we made quite some improvements recently in

[jira] [Commented] (HDFS-15661) The DeadNodeDetector shouldn't be shared by different DFSClients.

[ https://issues.apache.org/jira/browse/HDFS-15661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271747#comment-17271747 ] Wei-Chiu Chuang commented on HDFS-15661: LGTM > The DeadNodeDetector shouldn't be shared by

[jira] [Commented] (HDFS-15276) Concat on INodeRefernce fails with illegal state exception

[ https://issues.apache.org/jira/browse/HDFS-15276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268977#comment-17268977 ] Wei-Chiu Chuang commented on HDFS-15276: Nit: the test should be relocated to TestHDFSConcat, not

<    1   2   3   4   5   6   7   8   9   10   >