[jira] [Resolved] (HDFS-17358) EC: infinite lease recovery caused by the length of RWR equals to zero.

2024-02-29 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-17358. --- Fix Version/s: 3.5.0 Resolution: Fixed > EC: infinite lease recovery caused by the length of RWR

[jira] [Resolved] (HDFS-17242) Make congestion backoff time configurable

2023-12-13 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-17242. --- Fix Version/s: 3.4.0 Resolution: Fixed > Make congestion backoff time configurable >

[jira] [Commented] (HDFS-17267) Client send the smae packet multiple times when method markSlowNode throws IOException.

2023-11-30 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17791606#comment-17791606 ] Tao Li commented on HDFS-17267: --- There does seem to be a problem. Have you reproduced that? We can handle

[jira] [Resolved] (HDFS-17220) fix same available space policy in AvailableSpaceVolumeChoosingPolicy

2023-10-17 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-17220. --- Fix Version/s: 3.4.0 Resolution: Fixed > fix same available space policy in

[jira] [Resolved] (HDFS-17171) CONGESTION_RATIO should be configurable

2023-10-07 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-17171. --- Fix Version/s: 3.4.0 Resolution: Fixed > CONGESTION_RATIO should be configurable >

[jira] [Resolved] (HDFS-17087) Add Throttler for datanode reading block

2023-08-16 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-17087. --- Fix Version/s: 3.4.0 Resolution: Fixed > Add Throttler for datanode reading block >

[jira] [Resolved] (HDFS-17145) Fix description of property dfs.namenode.file.close.num-committed-allowed.

2023-08-10 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-17145. --- Fix Version/s: 3.4.0 Resolution: Fixed > Fix description of property

[jira] [Resolved] (HDFS-17144) Remove incorrect comment in method storeAllocatedBlock

2023-08-07 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-17144. --- Fix Version/s: 3.4.0 Resolution: Fixed > Remove incorrect comment in method storeAllocatedBlock >

[jira] [Resolved] (HDFS-17136) Fix annotation description and typo in BlockPlacementPolicyDefault Class

2023-07-30 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-17136. --- Fix Version/s: 3.4.0 Resolution: Fixed > Fix annotation description and typo in

[jira] [Assigned] (HDFS-17136) Fix annotation description and typo in BlockPlacementPolicyDefault Class

2023-07-30 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li reassigned HDFS-17136: - Assignee: huangzhaobo99 > Fix annotation description and typo in BlockPlacementPolicyDefault Class >

[jira] [Assigned] (HDFS-17136) Fix annotation description and typo in BlockPlacementPolicyDefault Class

2023-07-30 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li reassigned HDFS-17136: - Assignee: (was: Tao Li) > Fix annotation description and typo in BlockPlacementPolicyDefault Class

[jira] [Assigned] (HDFS-17136) Fix annotation description and typo in BlockPlacementPolicyDefault Class

2023-07-30 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li reassigned HDFS-17136: - Assignee: Tao Li > Fix annotation description and typo in BlockPlacementPolicyDefault Class >

[jira] [Resolved] (HDFS-17135) Update fsck -blockId to display excess state info of blocks

2023-07-30 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-17135. --- Fix Version/s: 3.4.0 Resolution: Fixed > Update fsck -blockId to display excess state info of blocks

[jira] [Commented] (HDFS-17092) Datanode Full Block Report failed can lead to missing and under replicated blocks

2023-07-19 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744836#comment-17744836 ] Tao Li commented on HDFS-17092: --- Seems duplicated with HDFS-17093. > Datanode Full Block Report failed can

[jira] [Resolved] (HDFS-17094) EC: Fix bug in block recovery when there are stale datanodes

2023-07-19 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-17094. --- Fix Version/s: 3.4.0 Resolution: Fixed > EC: Fix bug in block recovery when there are stale datanodes

[jira] [Commented] (HDFS-16422) Fix thread safety of EC decoding during concurrent preads

2023-04-26 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17716656#comment-17716656 ] Tao Li commented on HDFS-16422: --- Hi [~cndaimin] , have you tested the impact on performance? And have you

[jira] [Resolved] (HDFS-16925) Namenode audit log to only include IP address of client

2023-02-20 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16925. --- Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed > Namenode audit log to only include

[jira] [Resolved] (HDFS-16914) Add some logs for updateBlockForPipeline RPC.

2023-02-15 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16914. --- Fix Version/s: 3.4.0 Resolution: Fixed > Add some logs for updateBlockForPipeline RPC. >

[jira] [Resolved] (HDFS-16882) RBF: Add cache hit rate metric in MountTableResolver#getDestinationForPath

2023-02-10 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16882. --- Fix Version/s: 3.4.0 Resolution: Fixed > RBF: Add cache hit rate metric in

[jira] [Commented] (HDFS-16902) Add Namenode status to BPServiceActor metrics and improve logging in offerservice

2023-02-02 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17683628#comment-17683628 ] Tao Li commented on HDFS-16902: --- Backport to branch-3.3. > Add Namenode status to BPServiceActor metrics

[jira] [Resolved] (HDFS-16902) Add Namenode status to BPServiceActor metrics and improve logging in offerservice

2023-02-02 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16902. --- Fix Version/s: 3.3.9 Resolution: Fixed > Add Namenode status to BPServiceActor metrics and improve

[jira] [Reopened] (HDFS-16902) Add Namenode status to BPServiceActor metrics and improve logging in offerservice

2023-02-02 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li reopened HDFS-16902: --- > Add Namenode status to BPServiceActor metrics and improve logging in > offerservice >

[jira] [Updated] (HDFS-16902) Add Namenode status to BPServiceActor metrics and improve logging in offerservice

2023-02-02 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HDFS-16902: -- Fix Version/s: 3.2.5 > Add Namenode status to BPServiceActor metrics and improve logging in > offerservice >

[jira] [Resolved] (HDFS-16902) Add Namenode status to BPServiceActor metrics and improve logging in offerservice

2023-02-02 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16902. --- Fix Version/s: 3.4.0 Resolution: Fixed > Add Namenode status to BPServiceActor metrics and improve

[jira] [Resolved] (HDFS-16884) Fix TestFsDatasetImpl#testConcurrentWriteAndDeleteBlock failed

2023-01-10 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16884. --- Fix Version/s: 3.4.0 Resolution: Fixed > Fix TestFsDatasetImpl#testConcurrentWriteAndDeleteBlock

[jira] [Resolved] (HDFS-16861) RBF. Truncate API always fails when dirs use AllResolver oder on Router

2022-12-26 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16861. --- Fix Version/s: 3.3.9 Resolution: Fixed > RBF. Truncate API always fails when dirs use AllResolver

[jira] [Resolved] (HDFS-16866) Fix a typo in Dispatcher.

2022-12-15 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16866. --- Fix Version/s: 3.3.9 Resolution: Fixed > Fix a typo in Dispatcher. > - > >

[jira] [Resolved] (HDFS-16858) Dynamically adjust max slow disks to exclude

2022-12-08 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16858. --- Fix Version/s: 3.3.9 Resolution: Fixed > Dynamically adjust max slow disks to exclude >

[jira] [Resolved] (HDFS-16838) Fix NPE in testAddRplicaProcessorForAddingReplicaInMap

2022-11-23 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16838. --- Fix Version/s: 3.4.0 (was: 3.3.9) Resolution: Fixed > Fix NPE in

[jira] [Reopened] (HDFS-16838) Fix NPE in testAddRplicaProcessorForAddingReplicaInMap

2022-11-23 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li reopened HDFS-16838: --- > Fix NPE in testAddRplicaProcessorForAddingReplicaInMap >

[jira] [Resolved] (HDFS-16840) Enhance the usage description about oiv in HDFSCommands.md and OfflineImageViewerPB

2022-11-23 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16840. --- Fix Version/s: 3.4.0 (was: 3.3.9) Resolution: Fixed > Enhance the usage

[jira] [Reopened] (HDFS-16840) Enhance the usage description about oiv in HDFSCommands.md and OfflineImageViewerPB

2022-11-23 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li reopened HDFS-16840: --- > Enhance the usage description about oiv in HDFSCommands.md and > OfflineImageViewerPB >

[jira] [Resolved] (HDFS-16838) Fix NPE in testAddRplicaProcessorForAddingReplicaInMap

2022-11-23 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16838. --- Fix Version/s: 3.3.9 Resolution: Fixed > Fix NPE in testAddRplicaProcessorForAddingReplicaInMap >

[jira] [Resolved] (HDFS-16840) Enhance the usage description about oiv in HDFSCommands.md and OfflineImageViewerPB

2022-11-23 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16840. --- Fix Version/s: 3.3.9 Resolution: Fixed > Enhance the usage description about oiv in HDFSCommands.md

[jira] [Updated] (HDFS-16811) Support DecommissionBackoffMonitor parameters reconfigurable

2022-11-10 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HDFS-16811: -- Fix Version/s: 3.3.9 (was: 3.3.5) > Support DecommissionBackoffMonitor parameters

[jira] [Commented] (HDFS-16833) NameNode should log internal EC blocks instead of the EC block group when it receives block reports

2022-11-10 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632040#comment-17632040 ] Tao Li commented on HDFS-16833: --- Ok. Thanks [~tasanuma] . > NameNode should log internal EC blocks instead

[jira] [Commented] (HDFS-16833) NameNode should log internal EC blocks instead of the EC block group when it receives block reports

2022-11-10 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632019#comment-17632019 ] Tao Li commented on HDFS-16833: --- Hi [~tasanuma] , I am sorry.  I had set the resolve version number for

[jira] [Updated] (HDFS-16833) NameNode should log internal EC blocks instead of the EC block group when it receives block reports

2022-11-10 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HDFS-16833: -- Fix Version/s: (was: 3.3.5) > NameNode should log internal EC blocks instead of the EC block group when it

[jira] [Updated] (HDFS-16547) [SBN read] Namenode in safe mode should not be transfered to observer state

2022-11-10 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HDFS-16547: -- Issue Type: Bug (was: Improvement) > [SBN read] Namenode in safe mode should not be transfered to observer

[jira] [Updated] (HDFS-16811) Support DecommissionBackoffMonitor parameters reconfigurable

2022-11-09 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HDFS-16811: -- Fix Version/s: 3.3.5 > Support DecommissionBackoffMonitor parameters reconfigurable >

[jira] [Updated] (HDFS-16833) NameNode should log internal EC blocks instead of the EC block group when it receives block reports

2022-11-09 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HDFS-16833: -- Fix Version/s: 3.3.5 > NameNode should log internal EC blocks instead of the EC block group when it >

[jira] [Resolved] (HDFS-16811) Support DecommissionBackoffMonitor parameters reconfigurable

2022-11-06 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16811. --- Fix Version/s: 3.4.0 Resolution: Fixed > Support DecommissionBackoffMonitor parameters reconfigurable

[jira] [Updated] (HDFS-16811) Support DecommissionBackoffMonitor parameters reconfigurable

2022-11-04 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HDFS-16811: -- Summary: Support DecommissionBackoffMonitor parameters reconfigurable (was: Support

[jira] [Resolved] (HDFS-16716) Improve appendToFile command: support appending on file with new block

2022-10-27 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16716. --- Fix Version/s: 3.4.0 3.3.9 Target Version/s: 3.4.0, 3.3.9 Resolution:

[jira] [Assigned] (HDFS-16716) Improve appendToFile command: support appending on file with new block

2022-10-27 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li reassigned HDFS-16716: - Assignee: M1eyu2018 > Improve appendToFile command: support appending on file with new block >

[jira] [Updated] (HDFS-16716) Improve appendToFile command: support appending on file with new block

2022-10-27 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HDFS-16716: -- Issue Type: New Feature (was: Improvement) > Improve appendToFile command: support appending on file with new

[jira] [Updated] (HDFS-16550) [SBN read] Improper cache-size for journal node may cause cluster crash

2022-10-24 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HDFS-16550: -- Description: When we introduced {*}SBN Read{*}, we encountered a situation during upgrade the JournalNodes.

[jira] [Resolved] (HDFS-16634) Dynamically adjust slow peer report size on JMX metrics

2022-06-19 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16634. --- Fix Version/s: 3.4.0 Resolution: Resolved > Dynamically adjust slow peer report size on JMX metrics >

[jira] [Resolved] (HDFS-16581) Print node status when executing printTopology

2022-06-16 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16581. --- Fix Version/s: 3.4.0 3.3.4 Resolution: Resolved > Print node status when executing

[jira] [Resolved] (HDFS-16624) Fix org.apache.hadoop.hdfs.tools.TestDFSAdmin#testAllDatanodesReconfig ERROR

2022-06-08 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16624. --- Fix Version/s: 3.4.0 3.3.4 Resolution: Resolved > Fix

[jira] [Resolved] (HDFS-16618) sync_file_range error should include more volume and file info

2022-06-07 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16618. --- Fix Version/s: 3.4.0 3.2.4 3.3.4 Resolution: Fixed >

[jira] [Commented] (HDFS-16618) sync_file_range error should include more volume and file info

2022-06-07 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17550906#comment-17550906 ] Tao Li commented on HDFS-16618: --- Cherry-picked to branch-3.3 and branch-3.2. > sync_file_range error

[jira] [Assigned] (HDFS-16608) @Link in doc to private variable DataStreamer. pipelineRecoveryCount

2022-05-30 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li reassigned HDFS-16608: - Assignee: (was: Tao Li) > @Link in doc to private variable DataStreamer. pipelineRecoveryCount >

[jira] [Assigned] (HDFS-16608) @Link in doc to private variable DataStreamer. pipelineRecoveryCount

2022-05-30 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li reassigned HDFS-16608: - Assignee: Tao Li > @Link in doc to private variable DataStreamer. pipelineRecoveryCount >

[jira] [Created] (HDFS-16607) TestNameNodeMXBean.testDecommissioningNodes is flaky

2022-05-29 Thread Tao Li (Jira)
Tao Li created HDFS-16607: - Summary: TestNameNodeMXBean.testDecommissioningNodes is flaky Key: HDFS-16607 URL: https://issues.apache.org/jira/browse/HDFS-16607 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-16606) TestIncrementalBrVariations.testDataNodeDoesNotSplitReports is flaky

2022-05-29 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HDFS-16606: -- Description: {code:java} [ERROR] Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 37.602 s <<<

[jira] [Created] (HDFS-16606) TestIncrementalBrVariations.testDataNodeDoesNotSplitReports is flaky

2022-05-29 Thread Tao Li (Jira)
Tao Li created HDFS-16606: - Summary: TestIncrementalBrVariations.testDataNodeDoesNotSplitReports is flaky Key: HDFS-16606 URL: https://issues.apache.org/jira/browse/HDFS-16606 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-16582) Expose aggregate latency of slow node as perceived by the reporting node

2022-05-20 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16582. --- Fix Version/s: 3.4.0 3.3.4 Resolution: Fixed > Expose aggregate latency of slow

[jira] [Commented] (HDFS-16582) Expose aggregate latency of slow node as perceived by the reporting node

2022-05-20 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17540338#comment-17540338 ] Tao Li commented on HDFS-16582: --- Cherry-picked to branch-3.3. > Expose aggregate latency of slow node as

[jira] [Commented] (HDFS-16552) Fix NPE for TestBlockManager

2022-05-13 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536944#comment-17536944 ] Tao Li commented on HDFS-16552: ---  Hi [~aajisaka] , I'm sorry. I submitted a PR #4310 to fix the problem on

[jira] [Comment Edited] (HDFS-16552) Fix NPE for TestBlockManager

2022-05-13 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536944#comment-17536944 ] Tao Li edited comment on HDFS-16552 at 5/14/22 12:48 AM: -  Hi [~aajisaka] , I'm

[jira] [Created] (HDFS-16579) Fix build failure for TestBlockManager on branch-3.2

2022-05-13 Thread Tao Li (Jira)
Tao Li created HDFS-16579: - Summary: Fix build failure for TestBlockManager on branch-3.2 Key: HDFS-16579 URL: https://issues.apache.org/jira/browse/HDFS-16579 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-16568) dfsadmin -reconfig option to start/query reconfig on all live datanodes

2022-05-10 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534636#comment-17534636 ] Tao Li commented on HDFS-16568: --- Cherry-picked to branch-3.3. > dfsadmin -reconfig option to start/query

[jira] [Resolved] (HDFS-16568) dfsadmin -reconfig option to start/query reconfig on all live datanodes

2022-05-10 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16568. --- Fix Version/s: 3.3.4 Resolution: Fixed > dfsadmin -reconfig option to start/query reconfig on all

[jira] [Reopened] (HDFS-16568) dfsadmin -reconfig option to start/query reconfig on all live datanodes

2022-05-10 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li reopened HDFS-16568: --- > dfsadmin -reconfig option to start/query reconfig on all live datanodes >

[jira] [Resolved] (HDFS-16568) dfsadmin -reconfig option to start/query reconfig on all live datanodes

2022-05-10 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16568. --- Fix Version/s: 3.4.0 Resolution: Fixed > dfsadmin -reconfig option to start/query reconfig on all

[jira] [Commented] (HDFS-16573) Fix test TestDFSStripedInputStreamWithRandomECPolicy

2022-05-10 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534621#comment-17534621 ] Tao Li commented on HDFS-16573: --- Cherry-picked to branch-3.3. > Fix test

[jira] [Resolved] (HDFS-16573) Fix test TestDFSStripedInputStreamWithRandomECPolicy

2022-05-10 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16573. --- Fix Version/s: 3.3.4 Resolution: Fixed > Fix test TestDFSStripedInputStreamWithRandomECPolicy >

[jira] [Reopened] (HDFS-16573) Fix test TestDFSStripedInputStreamWithRandomECPolicy

2022-05-10 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li reopened HDFS-16573: --- > Fix test TestDFSStripedInputStreamWithRandomECPolicy > >

[jira] [Resolved] (HDFS-16573) Fix test TestDFSStripedInputStreamWithRandomECPolicy

2022-05-09 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16573. --- Fix Version/s: 3.4.0 Resolution: Resolved > Fix test TestDFSStripedInputStreamWithRandomECPolicy >

[jira] [Resolved] (HDFS-16256) Minor fixes in HDFS Fedbalance document

2022-05-01 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16256. --- Fix Version/s: 3.4.0 Resolution: Resolved > Minor fixes in HDFS Fedbalance document >

[jira] [Updated] (HDFS-16528) Reconfigure slow peer enable for Namenode

2022-05-01 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HDFS-16528: -- Fix Version/s: 3.3.0 > Reconfigure slow peer enable for Namenode > - >

[jira] [Commented] (HDFS-16528) Reconfigure slow peer enable for Namenode

2022-04-29 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529878#comment-17529878 ] Tao Li commented on HDFS-16528: --- Thanks [~vjasani] for your contribution. > Reconfigure slow peer enable

[jira] [Updated] (HDFS-16528) Reconfigure slow peer enable for Namenode

2022-04-29 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HDFS-16528: -- Fix Version/s: 3.4.0 Resolution: Resolved Status: Resolved (was: Patch Available) >

[jira] [Updated] (HDFS-16038) DataNode Unrecognized Observer Node when cluster add an observer node

2022-04-27 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HDFS-16038: -- Labels: Observer (was: ) > DataNode Unrecognized Observer Node when cluster add an observer node >

[jira] [Commented] (HDFS-16038) DataNode Unrecognized Observer Node when cluster add an observer node

2022-04-27 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529160#comment-17529160 ] Tao Li commented on HDFS-16038: --- In large clusters, this is a really tricky problem. We found this too. At

[jira] [Resolved] (HDFS-16560) [SPS]: Duplicate method names in TestExternalStoragePolicySatisfier

2022-04-24 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li resolved HDFS-16560. --- Resolution: Done > [SPS]: Duplicate method names in TestExternalStoragePolicySatisfier >

[jira] [Updated] (HDFS-16560) [SPS]: Duplicate method names in TestExternalStoragePolicySatisfier

2022-04-24 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HDFS-16560: -- Description: Duplicate method name testExternalSPSMetrics in TestExternalStoragePolicySatisfier.  

[jira] [Created] (HDFS-16560) [SPS]: Duplicate method names in TestExternalStoragePolicySatisfier

2022-04-24 Thread Tao Li (Jira)
Tao Li created HDFS-16560: - Summary: [SPS]: Duplicate method names in TestExternalStoragePolicySatisfier Key: HDFS-16560 URL: https://issues.apache.org/jira/browse/HDFS-16560 Project: Hadoop HDFS

[jira] [Updated] (HDFS-16557) BootstrapStandby failed because of checking gap for inprogress EditLogInputStream

2022-04-23 Thread Tao Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HDFS-16557: -- Description: The lastTxId of an inprogress EditLogInputStream lastTxId isn't necessarily

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

2017-09-03 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152045#comment-16152045 ] Tao Li commented on HDFS-10467: --- Tao Li liked your email Spark by Readdle > Router-based HDFS federation >