[jira] [Created] (HDFS-17468) Update ISA-L to 2.31.0 in the build image

2024-04-15 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-17468: --- Summary: Update ISA-L to 2.31.0 in the build image Key: HDFS-17468 URL: https://issues.apache.org/jira/browse/HDFS-17468 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-17435) Fix TestRouterRpc failed

2024-03-25 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17435. - Fix Version/s: 3.5.0 Resolution: Fixed > Fix TestRouterRpc failed >

[jira] [Created] (HDFS-17441) Fix junit dependency by adding missing library in hadoop-hdfs-rbf

2024-03-25 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-17441: --- Summary: Fix junit dependency by adding missing library in hadoop-hdfs-rbf Key: HDFS-17441 URL: https://issues.apache.org/jira/browse/HDFS-17441 Project:

[jira] [Resolved] (HDFS-17354) Delay invoke clearStaleNamespacesInRouterStateIdContext during router start up

2024-03-21 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17354. - Fix Version/s: 3.5.0 Resolution: Fixed > Delay invoke

[jira] [Resolved] (HDFS-17432) Fix junit dependency to enable JUnit4 tests to run in hadoop-hdfs-rbf

2024-03-21 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17432. - Fix Version/s: 3.4.1 3.5.0 Resolution: Fixed > Fix junit

[jira] [Created] (HDFS-17435) Fix TestRouterRpc#testClearStaleNamespacesInRouterStateIdContext() failed

2024-03-20 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-17435: --- Summary: Fix TestRouterRpc#testClearStaleNamespacesInRouterStateIdContext() failed Key: HDFS-17435 URL: https://issues.apache.org/jira/browse/HDFS-17435

[jira] [Created] (HDFS-17432) Fix junit dependency to enable JUnit4 tests to run in hadoop-hdfs-rbf

2024-03-18 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-17432: --- Summary: Fix junit dependency to enable JUnit4 tests to run in hadoop-hdfs-rbf Key: HDFS-17432 URL: https://issues.apache.org/jira/browse/HDFS-17432 Project:

[jira] [Resolved] (HDFS-17361) DiskBalancer: Query command support with multiple nodes

2024-02-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17361. - Fix Version/s: 3.5.0 Resolution: Fixed > DiskBalancer: Query command support with

[jira] [Created] (HDFS-17370) Fix junit dependency for running parameterized tests in hadoop-hdfs-rbf

2024-02-02 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-17370: --- Summary: Fix junit dependency for running parameterized tests in hadoop-hdfs-rbf Key: HDFS-17370 URL: https://issues.apache.org/jira/browse/HDFS-17370 Project:

[jira] [Resolved] (HDFS-17359) EC: recheck failed streamers should only after flushing all packets.

2024-02-01 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17359. - Fix Version/s: 3.3.9 3.4.1 3.5.0 Resolution:

[jira] [Reopened] (HDFS-17348) Enhance Log when checkLocations in RecoveryTaskStriped

2024-01-30 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma reopened HDFS-17348: - > Enhance Log when checkLocations in RecoveryTaskStriped >

[jira] [Resolved] (HDFS-17348) Enhance Log when checkLocations in RecoveryTaskStriped

2024-01-30 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17348. - Resolution: Duplicate I'd like to change the status to duplicate if HDFS-17358 fixes the

[jira] [Created] (HDFS-17362) RBF: RouterObserverReadProxyProvider should use ConfiguredFailoverProxyProvider internally

2024-01-28 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-17362: --- Summary: RBF: RouterObserverReadProxyProvider should use ConfiguredFailoverProxyProvider internally Key: HDFS-17362 URL: https://issues.apache.org/jira/browse/HDFS-17362

[jira] [Resolved] (HDFS-17312) packetsReceived metric should ignore heartbeat packet

2024-01-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17312. - Fix Version/s: 3.5.0 Resolution: Fixed > packetsReceived metric should ignore

[jira] [Resolved] (HDFS-17315) Optimize the namenode format code logic.

2024-01-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17315. - Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed > Optimize the

[jira] [Resolved] (HDFS-17277) Delete invalid code logic in namenode format

2023-12-29 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17277. - Fix Version/s: 3.4.0 Resolution: Fixed > Delete invalid code logic in namenode

[jira] [Resolved] (HDFS-17301) Add read and write dataXceiver threads count metrics to datanode.

2023-12-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17301. - Fix Version/s: 3.4.0 Resolution: Fixed > Add read and write dataXceiver threads

[jira] [Resolved] (HDFS-17297) The NameNode should remove block from the BlocksMap if the block is marked as deleted.

2023-12-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17297. - Fix Version/s: 3.4.0 Resolution: Fixed > The NameNode should remove block from

[jira] [Resolved] (HDFS-17284) Fix int overflow in calculating numEcReplicatedTasks and numReplicationTasks during block recovery

2023-12-26 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17284. - Fix Version/s: 3.4.0 Resolution: Fixed > Fix int overflow in calculating

[jira] [Resolved] (HDFS-17298) Fix NPE in DataNode.handleBadBlock and BlockSender

2023-12-25 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17298. - Fix Version/s: 3.4.0 Resolution: Fixed > Fix NPE in DataNode.handleBadBlock and

[jira] [Resolved] (HDFS-17294) Reconfigure the scheduling cycle of the slowPeerCollectorDaemon thread.

2023-12-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17294. - Resolution: Fixed > Reconfigure the scheduling cycle of the slowPeerCollectorDaemon

[jira] [Resolved] (HDFS-17156) Client may receive old state ID which will lead to inconsistent reads

2023-08-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17156. - Fix Version/s: 3.4.0 Resolution: Fixed > Client may receive old state ID which

[jira] [Resolved] (HDFS-16967) RBF: File based state stores should allow concurrent access to the records

2023-04-04 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16967. - Fix Version/s: 3.4.0 Resolution: Fixed > RBF: File based state stores should

[jira] [Resolved] (HDFS-16958) EC: Fix bug in processing EC excess redundancy

2023-03-27 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16958. - Resolution: Not A Problem > EC: Fix bug in processing EC excess redundancy >

[jira] [Resolved] (HDFS-16903) Fix javadoc of Class LightWeightResizableGSet

2023-02-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16903. - Fix Version/s: 3.4.0 Resolution: Fixed > Fix javadoc of Class

[jira] [Resolved] (HDFS-16821) Fix regression in HDFS-13522 that enables observer reads by default.

2023-01-31 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16821. - Fix Version/s: 3.4.0 Resolution: Fixed > Fix regression in HDFS-13522 that

[jira] [Resolved] (HDFS-16888) BlockManager#maxReplicationStreams, replicationStreamsHardLimit, blocksReplWorkMultiplier and PendingReconstructionBlocks#timeout should be volatile

2023-01-31 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16888. - Fix Version/s: 3.4.0 Resolution: Fixed > BlockManager#maxReplicationStreams,

[jira] [Resolved] (HDFS-16876) Garbage collect map entries in shared RouterStateIdContext using information from namenodeResolver instead of the map of active connectionPools.

2023-01-23 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16876. - Fix Version/s: 3.4.0 Resolution: Fixed > Garbage collect map entries in shared

[jira] [Created] (HDFS-16889) Backport JIRAs related to RBF SBN to branch-3.3

2023-01-12 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-16889: --- Summary: Backport JIRAs related to RBF SBN to branch-3.3 Key: HDFS-16889 URL: https://issues.apache.org/jira/browse/HDFS-16889 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-16809) EC striped block is not sufficient when doing in maintenance

2022-12-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16809. - Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed > EC striped

[jira] [Resolved] (HDFS-16833) NameNode should log internal EC blocks instead of the EC block group when it receives block reports

2022-11-06 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16833. - Fix Version/s: 3.4.0 Resolution: Fixed > NameNode should log internal EC blocks

[jira] [Created] (HDFS-16833) NameNode should log internal EC blocks instead of the EC block group when it receives block reports

2022-11-03 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-16833: --- Summary: NameNode should log internal EC blocks instead of the EC block group when it receives block reports Key: HDFS-16833 URL:

[jira] [Resolved] (HDFS-16822) HostRestrictingAuthorizationFilter should pass through requests if they don't access WebHDFS API

2022-10-26 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16822. - Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed >

[jira] [Created] (HDFS-16822) HostRestrictingAuthorizationFilter should pass through requests if they don't access WebHDFS API

2022-10-25 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-16822: --- Summary: HostRestrictingAuthorizationFilter should pass through requests if they don't access WebHDFS API Key: HDFS-16822 URL:

[jira] [Resolved] (HDFS-16776) Erasure Coding: The length of targets should be checked when DN gets a reconstruction task

2022-09-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16776. - Fix Version/s: 3.4.0 3.3.9 3.2.5 Resolution:

[jira] [Resolved] (HDFS-16579) Fix build failure for TestBlockManager on branch-3.2

2022-05-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16579. - Fix Version/s: 3.2.4 Resolution: Fixed > Fix build failure for TestBlockManager

[jira] [Resolved] (HDFS-16519) Add throttler to EC reconstruction

2022-04-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16519. - Fix Version/s: 3.4.0 3.3.4 Resolution: Fixed > Add throttler

[jira] [Resolved] (HDFS-16552) Fix NPE for TestBlockManager

2022-04-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16552. - Fix Version/s: 3.4.0 3.2.4 3.3.4 Resolution:

[jira] [Resolved] (HDFS-16510) Fix EC decommission when rack is not enough

2022-04-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16510. - Resolution: Duplicate I'm closing this jira as it is superceded by HDFS-16456. Thanks

[jira] [Resolved] (HDFS-16544) EC decoding failed due to invalid buffer

2022-04-20 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16544. - Fix Version/s: 3.4.0 3.2.4 3.3.4 Assignee:

[jira] [Resolved] (HDFS-16538) EC decoding failed due to not enough valid inputs

2022-04-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16538. - Fix Version/s: 3.4.0 3.2.4 3.3.4 Assignee:

[jira] [Resolved] (HDFS-16479) EC: NameNode should not send a reconstruction work when the source datanodes are insufficient

2022-04-13 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16479. - Fix Version/s: 3.4.0 3.2.4 3.3.4 Assignee:

[jira] [Resolved] (HDFS-16484) [SPS]: Fix an infinite loop bug in SPSPathIdProcessor thread

2022-04-12 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16484. - Fix Version/s: 3.4.0 3.2.4 3.3.4 Resolution:

[jira] [Resolved] (HDFS-14969) Fix HDFS client unnecessary failover log printing

2022-04-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-14969. - Resolution: Duplicate This issue seems to be resolved by HADOOP-17116. > Fix HDFS

[jira] [Resolved] (HDFS-16427) Add debug log for BlockManager#chooseExcessRedundancyStriped

2022-04-08 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16427. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution:

[jira] [Resolved] (HDFS-16457) Make fs.getspaceused.classname reconfigurable

2022-04-07 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16457. - Fix Version/s: 3.4.0 Resolution: Fixed > Make fs.getspaceused.classname

[jira] [Resolved] (HDFS-16413) Reconfig dfs usage parameters for datanode

2022-03-30 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16413. - Fix Version/s: 3.4.0 Resolution: Fixed > Reconfig dfs usage parameters for

[jira] [Resolved] (HDFS-16434) Add opname to read/write lock for remaining operations

2022-03-25 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16434. - Fix Version/s: 3.4.0 Resolution: Fixed > Add opname to read/write lock for

[jira] [Resolved] (HDFS-16501) Print the exception when reporting a bad block

2022-03-23 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16501. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Assignee:

[jira] [Resolved] (HDFS-16397) Reconfig slow disk parameters for datanode

2022-02-24 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16397. - Fix Version/s: 3.4.0 Resolution: Fixed Merged to trunk. I will try to backport it

[jira] [Resolved] (HDFS-16461) Expose JournalNode storage info in the jmx metrics

2022-02-21 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16461. - Fix Version/s: 3.4.0 Resolution: Fixed Merged to trunk. I didn't backport it into

[jira] [Resolved] (HDFS-16396) Reconfig slow peer parameters for datanode

2022-02-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16396. - Fix Version/s: 3.4.0 Resolution: Fixed > Reconfig slow peer parameters for

[jira] [Resolved] (HDFS-16398) Reconfig block report parameters for datanode

2022-01-26 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16398. - Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed > Reconfig block

[jira] [Resolved] (HDFS-16423) balancer should not get blocks on stale storages

2022-01-19 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16423. - Fix Version/s: 3.4.0 Resolution: Fixed > balancer should not get blocks on stale

[jira] [Resolved] (HDFS-16399) Reconfig cache report parameters for datanode

2022-01-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16399. - Fix Version/s: 3.4.0 Resolution: Fixed > Reconfig cache report parameters for

[jira] [Resolved] (HDFS-16426) fix nextBlockReportTime when trigger full block report force

2022-01-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16426. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution:

[jira] [Resolved] (HDFS-16297) striped block was deleted less than 1 replication

2022-01-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16297. - Resolution: Duplicate It seems this issue is the same as HDFS-16420. So I'm closing it.

[jira] [Resolved] (HDFS-16420) Avoid deleting unique data blocks when deleting redundancy striped blocks

2022-01-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16420. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution:

[jira] [Resolved] (HDFS-16400) Reconfig DataXceiver parameters for datanode

2022-01-13 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16400. - Fix Version/s: 3.4.0 Resolution: Fixed > Reconfig DataXceiver parameters for

[jira] [Resolved] (HDFS-16371) Exclude slow disks when choosing volume

2022-01-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16371. - Fix Version/s: 3.4.0 Resolution: Fixed > Exclude slow disks when choosing volume

[jira] [Resolved] (HDFS-16348) Mark slownode as badnode to recover pipeline

2021-12-29 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16348. - Fix Version/s: 3.4.0 Resolution: Fixed > Mark slownode as badnode to recover

[jira] [Resolved] (HDFS-16385) Fix Datanode retrieve slownode information bug.

2021-12-20 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16385. - Resolution: Fixed Merged the PR. Thanks for your contribution, [~JacksonWang]. I added

[jira] [Resolved] (HDFS-16377) Should CheckNotNull before access FsDatasetSpi

2021-12-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16377. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution:

[jira] [Resolved] (HDFS-16375) The FBR lease ID should be exposed to the log

2021-12-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16375. - Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed > The FBR lease

[jira] [Resolved] (HDFS-16373) Fix MiniDFSCluster restart in case of multiple namenodes

2021-12-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16373. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution:

[jira] [Resolved] (HDFS-16327) Make dfs.namenode.max.slowpeer.collect.nodes reconfigurable

2021-12-13 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16327. - Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed > Make

[jira] [Resolved] (HDFS-16333) fix balancer bug when transfer an EC block

2021-12-08 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16333. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution:

[jira] [Resolved] (HDFS-16331) Make dfs.blockreport.intervalMsec reconfigurable

2021-12-02 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16331. - Fix Version/s: 3.4.0 Resolution: Fixed > Make dfs.blockreport.intervalMsec

[jira] [Resolved] (HDFS-16344) Improve DirectoryScanner.Stats#toString

2021-11-29 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16344. - Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed > Improve

[jira] [Resolved] (HDFS-16339) Show the threshold when mover threads quota is exceeded

2021-11-26 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16339. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution:

[jira] [Resolved] (HDFS-16335) Fix HDFSCommands.md

2021-11-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16335. - Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed > Fix

[jira] [Resolved] (HDFS-16326) Simplify the code for DiskBalancer

2021-11-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16326. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution:

[jira] [Resolved] (HDFS-16310) RBF: Add client port to CallerContext for Router

2021-11-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16310. - Fix Version/s: 3.4.0 Resolution: Fixed > RBF: Add client port to CallerContext

[jira] [Resolved] (HDFS-16323) DatanodeHttpServer doesn't require handler state map while retrieving filter handlers

2021-11-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16323. - Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed >

[jira] [Resolved] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

2021-11-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16315. - Fix Version/s: 3.4.0 Resolution: Fixed > Add metrics related to Transfer and

[jira] [Resolved] (HDFS-16311) Metric metadataOperationRate calculation error in DataNodeVolumeMetrics

2021-11-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16311. - Fix Version/s: 3.4.0 2.10.2 3.3.2

[jira] [Resolved] (HDFS-16312) Fix typo for DataNodeVolumeMetrics and ProfilingFileIoEvents

2021-11-10 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16312. - Fix Version/s: 3.4.0 2.10.2 3.3.2

[jira] [Resolved] (HDFS-16298) Improve error msg for BlockMissingException

2021-11-10 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16298. - Fix Version/s: 3.4.0 2.10.2 3.3.2

[jira] [Resolved] (HDFS-16301) Improve BenchmarkThroughput#SIZE naming standardization

2021-11-09 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16301. - Fix Version/s: 3.4.0 2.10.2 3.3.2

[jira] [Resolved] (HDFS-16299) Fix bug for TestDataNodeVolumeMetrics#verifyDataNodeVolumeMetrics

2021-11-09 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16299. - Fix Version/s: 3.4.0 3.3.2 3.2.4 Resolution:

[jira] [Resolved] (HDFS-16273) RBF: RouterRpcFairnessPolicyController add availableHandleOnPerNs metrics

2021-11-07 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16273. - Fix Version/s: 3.4.0 Resolution: Fixed > RBF: RouterRpcFairnessPolicyController

[jira] [Resolved] (HDFS-16294) Remove invalid DataNode#CONFIG_PROPERTY_SIMULATED

2021-11-04 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16294. - Fix Version/s: 3.2.4 3.3.2 2.10.2

[jira] [Resolved] (HDFS-16266) Add remote port information to HDFS audit log

2021-11-03 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16266. - Fix Version/s: 3.4.0 Resolution: Fixed > Add remote port information to HDFS

[jira] [Resolved] (HDFS-16279) Print detail datanode info when process first storage report

2021-10-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16279. - Fix Version/s: 3.2.4 3.3.2 3.4.0 Resolution:

[jira] [Resolved] (HDFS-15018) DataNode doesn't shutdown although the number of failed disks reaches dfs.datanode.failed.volumes.tolerated

2021-10-06 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15018. - Resolution: Duplicate > DataNode doesn't shutdown although the number of failed disks

[jira] [Resolved] (HDFS-16203) Discover datanodes with unbalanced block pool usage by the standard deviation

2021-09-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16203. - Fix Version/s: 3.4.0 Resolution: Fixed > Discover datanodes with unbalanced block

[jira] [Resolved] (HDFS-16076) Avoid using slow DataNodes for reading by sorting locations

2021-06-23 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16076. - Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed > Avoid using

[jira] [Created] (HDFS-16068) WebHdfsFileSystem has a possible connection leak in connection with HttpFS

2021-06-14 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-16068: --- Summary: WebHdfsFileSystem has a possible connection leak in connection with HttpFS Key: HDFS-16068 URL: https://issues.apache.org/jira/browse/HDFS-16068

[jira] [Resolved] (HDFS-16057) Make sure the order for location in ENTERING_MAINTENANCE state

2021-06-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16057. - Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed > Make sure the

[jira] [Resolved] (HDFS-16054) Replace Guava Lists usage by Hadoop's own Lists in hadoop-hdfs-project

2021-06-09 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16054. - Fix Version/s: 3.4.0 Resolution: Fixed > Replace Guava Lists usage by Hadoop's

[jira] [Resolved] (HDFS-16048) RBF: Print network topology on the router web

2021-06-08 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16048. - Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed > RBF: Print

[jira] [Resolved] (HDFS-16050) Some dynamometer tests fail

2021-06-07 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16050. - Fix Version/s: 3.3.2 3.4.0 Target Version/s: 3.4.0, 3.3.2

[jira] [Resolved] (HDFS-16041) TestErasureCodingCLI fails

2021-05-26 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16041. - Fix Version/s: 3.4.0 Resolution: Fixed > TestErasureCodingCLI fails >

[jira] [Resolved] (HDFS-15991) Add location into datanode info for NameNodeMXBean

2021-04-26 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15991. - Fix Version/s: 3.4.0 Resolution: Fixed > Add location into datanode info for

[jira] [Resolved] (HDFS-15974) RBF: Unable to display the datanode UI of the router

2021-04-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15974. - Fix Version/s: 3.4.0 Resolution: Fixed > RBF: Unable to display the datanode UI

[jira] [Resolved] (HDFS-15989) Split TestBalancer into two classes

2021-04-21 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15989. - Resolution: Fixed > Split TestBalancer into two classes >

[jira] [Resolved] (HDFS-15970) Print network topology on the web

2021-04-19 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15970. - Fix Version/s: 3.4.0 Resolution: Fixed > Print network topology on the web >

[jira] [Resolved] (HDFS-15975) Use LongAdder instead of AtomicLong

2021-04-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15975. - Fix Version/s: 3.4.0 Resolution: Fixed > Use LongAdder instead of AtomicLong >

[jira] [Resolved] (HDFS-15883) Add a metric BlockReportQueueFullCount

2021-04-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15883. - Resolution: Won't Fix Closes as the PR closed. > Add a metric BlockReportQueueFullCount

[jira] [Resolved] (HDFS-15951) Remove unused parameters in NameNodeProxiesClient

2021-04-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15951. - Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed > Remove unused

  1   2   >