[jira] [Commented] (HDFS-17533) RBF: Unit tests that use embedded SQL failing in CI

2024-05-20 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17848013#comment-17848013 ] Shilun Fan commented on HDFS-17533: --- [~simbadzina] Thank you for the feedback! The upgrade from derby

[jira] [Resolved] (HDFS-17520) TestDFSAdmin.testAllDatanodesReconfig and TestDFSAdmin.testDecommissionDataNodesReconfig failed

2024-05-14 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HDFS-17520. --- Fix Version/s: 3.4.1 3.5.0 Hadoop Flags: Reviewed Target

[jira] [Updated] (HDFS-17520) TestDFSAdmin.testAllDatanodesReconfig and TestDFSAdmin.testDecommissionDataNodesReconfig failed

2024-05-14 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17520: -- Affects Version/s: 3.4.0 > TestDFSAdmin.testAllDatanodesReconfig and >

[jira] [Updated] (HDFS-17520) TestDFSAdmin.testAllDatanodesReconfig and TestDFSAdmin.testDecommissionDataNodesReconfig failed

2024-05-14 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17520: -- Component/s: hdfs > TestDFSAdmin.testAllDatanodesReconfig and >

[jira] [Updated] (HDFS-17522) JournalNode web interfaces lack configs for X-FRAME-OPTIONS protection

2024-05-12 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17522: -- Affects Version/s: 3.5.0 > JournalNode web interfaces lack configs for X-FRAME-OPTIONS protection >

[jira] [Commented] (HDFS-17366) NameNode Fine-Grained Locking via Namespace Tree

2024-05-07 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844480#comment-17844480 ] Shilun Fan commented on HDFS-17366: --- [~xuzq_zander] [~ferhui] I believe it is necessary to organize an

[jira] [Resolved] (HDFS-17367) Add PercentUsed for Different StorageTypes in JMX

2024-04-27 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HDFS-17367. --- Fix Version/s: 3.4.1 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed >

[jira] [Updated] (HDFS-17429) Datatransfer sender.java LOG variable uses interface's, causing log fileName mistake

2024-03-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17429: -- Affects Version/s: 3.4.0 > Datatransfer sender.java LOG variable uses interface's, causing log

[jira] [Updated] (HDFS-17429) Datatransfer sender.java LOG variable uses interface's, causing log fileName mistake

2024-03-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17429: -- Target Version/s: 3.4.1, 3.5.0 > Datatransfer sender.java LOG variable uses interface's, causing log

[jira] [Resolved] (HDFS-17429) Datatransfer sender.java LOG variable uses interface's, causing log fileName mistake

2024-03-26 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HDFS-17429. --- Fix Version/s: 3.4.1 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed >

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2024-03-06 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824205#comment-17824205 ] Shilun Fan commented on HDFS-17299: --- Don't worry, hadoop-3.4.0-RC3 is a release packaged using the tag

[jira] [Updated] (HDFS-15217) Add more information to longest write/read lock held log

2024-03-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15217: -- Affects Version/s: 3.4.0 > Add more information to longest write/read lock held log >

[jira] [Updated] (HDFS-15217) Add more information to longest write/read lock held log

2024-03-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15217: -- Target Version/s: 3.4.0 > Add more information to longest write/read lock held log >

[jira] [Updated] (HDFS-15217) Add more information to longest write/read lock held log

2024-03-03 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15217: -- Component/s: namanode > Add more information to longest write/read lock held log >

[jira] [Commented] (HDFS-17403) jenkins build failing for HDFS 3.5.0-SNAPSHOT

2024-02-29 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17822299#comment-17822299 ] Shilun Fan commented on HDFS-17403: --- [~szetszwo] This is due to a failed compilation of the Maven

[jira] [Updated] (HDFS-17146) Use the dfsadmin -reconfig command to initiate reconfiguration on all decommissioning datanodes.

2024-02-17 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17146: -- Component/s: dfsadmin Fix Version/s: 3.4.1 Target Version/s: 3.5.0 > Use the dfsadmin

[jira] [Resolved] (HDFS-17146) Use the dfsadmin -reconfig command to initiate reconfiguration on all decommissioning datanodes.

2024-02-17 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HDFS-17146. --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Use the dfsadmin

[jira] [Updated] (HDFS-16616) Remove the use if Sets#newHashSet and Sets#newTreeSet

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16616: -- Component/s: hdfs-common Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16522) Set Http and Ipc ports for Datanodes in MiniDFSCluster

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16522: -- Component/s: tets Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.4.0 Affects

[jira] [Updated] (HDFS-16502) Reconfigure Block Invalidate limit

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16502: -- Component/s: block placement Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.4.0

[jira] [Updated] (HDFS-16481) Provide support to set Http and Rpc ports in MiniJournalCluster

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16481: -- Component/s: test Target Version/s: 3.3.5, 3.4.0 Affects Version/s: 3.3.5

[jira] [Updated] (HDFS-16054) Replace Guava Lists usage by Hadoop's own Lists in hadoop-hdfs-project

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16054: -- Component/s: hdfs-common Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16435) Remove no need TODO comment for ObserverReadProxyProvider

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16435: -- Component/s: namanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Remove no need

[jira] [Updated] (HDFS-16541) Fix a typo in NameNodeLayoutVersion.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16541: -- Component/s: namanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix a typo in

[jira] [Updated] (HDFS-16587) Allow configuring Handler number for the JournalNodeRpcServer

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16587: -- Component/s: journal-node Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Allow

[jira] [Updated] (HDFS-16339) Show the threshold when mover threads quota is exceeded

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16339: -- Component/s: datanode Hadoop Flags: Reviewed Target Version/s: 3.2.4, 3.3.2, 3.4.0

[jira] [Updated] (HDFS-16335) Fix HDFSCommands.md

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16335: -- Component/s: documentation Hadoop Flags: Reviewed Target Version/s: 3.3.2, 3.4.0

[jira] [Updated] (HDFS-16326) Simplify the code for DiskBalancer

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16326: -- Component/s: diskbalancer Hadoop Flags: Reviewed Target Version/s: 3.2.4, 3.3.2,

[jira] [Updated] (HDFS-16319) Add metrics doc for ReadLockLongHoldCount and WriteLockLongHoldCount

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16319: -- Component/s: metrics Target Version/s: 3.3.2, 3.4.0 Affects Version/s: 3.3.2

[jira] [Updated] (HDFS-16298) Improve error msg for BlockMissingException

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16298: -- Component/s: hdfs-client Hadoop Flags: Reviewed Target Version/s: 3.2.4, 3.3.2,

[jira] [Updated] (HDFS-16312) Fix typo for DataNodeVolumeMetrics and ProfilingFileIoEvents

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16312: -- Component/s: datanode metrics Hadoop Flags: Reviewed Target

[jira] [Updated] (HDFS-16280) Fix typo for ShortCircuitReplica#isStale

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16280: -- Component/s: hdfs-client Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix typo

[jira] [Updated] (HDFS-16281) Fix flaky unit tests failed due to timeout

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16281: -- Component/s: test Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16194) Simplify the code with DatanodeID#getXferAddrWithHostname

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16194: -- Component/s: datanode metrics namanode Target

[jira] [Updated] (HDFS-16131) Show storage type for failed volumes on namenode web

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16131: -- Component/s: namanode ui Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16110) Remove unused method reportChecksumFailure in DFSClient

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16110: -- Component/s: dfsclient Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16106) Fix flaky unit test TestDFSShell

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16106: -- Component/s: test Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16089) EC: Add metric EcReconstructionValidateTimeMillis for StripedBlockReconstructor

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16089: -- Component/s: erasure-coding metrics Hadoop Flags: Reviewed

[jira] [Updated] (HDFS-16104) Remove unused parameter and fix java doc for DiskBalancerCLI

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16104: -- Component/s: diskbalancer documentation Target Version/s: 3.4.0

[jira] [Updated] (HDFS-16079) Improve the block state change log

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16079: -- Component/s: block placement Target Version/s: 3.3.2, 3.4.0 Affects Version/s: 3.3.2

[jira] [Updated] (HDFS-16078) Remove unused parameters for DatanodeManager.handleLifeline()

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16078: -- Component/s: namanode Target Version/s: 3.3.2, 3.2.3, 3.4.0 Affects Version/s: 3.3.2

[jira] [Updated] (HDFS-15991) Add location into datanode info for NameNodeMXBean

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15991: -- Component/s: metrics namanode Hadoop Flags: Reviewed Target

[jira] [Assigned] (HDFS-16535) SlotReleaser should reuse the domain socket based on socket paths

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan reassigned HDFS-16535: - Assignee: Quanlong Huang > SlotReleaser should reuse the domain socket based on socket paths >

[jira] [Updated] (HDFS-15951) Remove unused parameters in NameNodeProxiesClient

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15951: -- Component/s: hdfs-client Hadoop Flags: Reviewed Target Version/s: 3.3.1, 3.4.0

[jira] [Updated] (HDFS-15975) Use LongAdder instead of AtomicLong

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15975: -- Component/s: metrics Hadoop Flags: Reviewed Target Version/s: 3.3.1, 3.4.0

[jira] [Updated] (HDFS-15938) Fix java doc in FSEditLog

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15938: -- Component/s: documentation Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix java

[jira] [Updated] (HDFS-15906) Close FSImage and FSNamesystem after formatting is complete

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15906: -- Component/s: namanode Hadoop Flags: Reviewed Target Version/s: 3.2.3, 3.3.1, 3.4.0

[jira] [Updated] (HDFS-15892) Add metric for editPendingQ in FSEditLogAsync

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15892: -- Component/s: metrics Hadoop Flags: Reviewed Target Version/s: 3.2.3, 3.3.1, 3.4.0

[jira] [Updated] (HDFS-15870) Remove unused configuration dfs.namenode.stripe.min

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15870: -- Component/s: configuration Hadoop Flags: Reviewed Target Version/s: 3.2.3, 3.3.1,

[jira] [Updated] (HDFS-15854) Make some parameters configurable for SlowDiskTracker and SlowPeerTracker

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15854: -- Component/s: block placement Target Version/s: 3.3.5, 3.4.0 Affects Version/s: 3.3.5

[jira] [Updated] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-13274: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Extend

[jira] [Updated] (HDFS-16598) Fix DataNode FsDatasetImpl lock issue without GS checks.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16598: -- Component/s: datanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix DataNode

[jira] [Updated] (HDFS-16600) Fix deadlock of fine-grain lock for FsDatastImpl of DataNode.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16600: -- Component/s: datanode Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix deadlock

[jira] [Updated] (HDFS-16526) Add metrics for slow DataNode

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16526: -- Component/s: datanode metrics Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16488) [SPS]: Expose metrics to JMX for external SPS

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16488: -- Component/s: metrics sps Hadoop Flags: Reviewed Target

[jira] [Updated] (HDFS-16460) [SPS]: Handle failure retries for moving tasks

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16460: -- Component/s: sps Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-16484) [SPS]: Fix an infinite loop bug in SPSPathIdProcessor thread

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16484: -- Component/s: sps Hadoop Flags: Reviewed Target Version/s: 3.3.5, 3.2.4, 3.4.0

[jira] [Updated] (HDFS-15987) Improve oiv tool to parse fsimage file in parallel with delimited format

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15987: -- Component/s: tools Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Improve oiv tool

[jira] [Updated] (HDFS-16477) [SPS]: Add metric PendingSPSPaths for getting the number of paths to be processed by SPS

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16477: -- Component/s: sps Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > [SPS]: Add metric

[jira] [Updated] (HDFS-16499) [SPS]: Should not start indefinitely while another SPS process is running

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16499: -- Component/s: sps Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-13248) RBF: Namenode need to choose block location for the client

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-13248: -- Component/s: rbf Hadoop Flags: Reviewed Target Version/s: 3.3.5, 2.10.2, 3.4.0

[jira] [Updated] (HDFS-16458) [SPS]: Fix bug for unit test of reconfiguring SPS mode

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16458: -- Component/s: sps test Hadoop Flags: Reviewed Target

[jira] [Updated] (HDFS-16222) Fix ViewDFS with mount points for HDFS only API

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16222: -- Component/s: viewfs Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix ViewDFS with

[jira] [Updated] (HDFS-16231) Fix TestDataNodeMetrics#testReceivePacketSlowMetrics

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16231: -- Component/s: datanode metrics Hadoop Flags: Reviewed Target

[jira] [Updated] (HDFS-16192) ViewDistributedFileSystem#rename wrongly using src in the place of dst.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16192: -- Component/s: viewfs Hadoop Flags: Reviewed Target Version/s: 3.3.2, 3.4.0

[jira] [Updated] (HDFS-15671) TestBalancerRPCDelay#testBalancerRPCDelayQpsDefault fails on Trunk

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15671: -- Component/s: balancer test Hadoop Flags: Reviewed Target

[jira] [Updated] (HDFS-15973) RBF: Add permission check before doing router federation rename.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15973: -- Component/s: rbf Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-13975) TestBalancer#testMaxIterationTime fails sporadically

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-13975: -- Component/s: balancer test Target Version/s: 3.2.3, 2.10.2, 3.3.1, 3.4.0

[jira] [Updated] (HDFS-15848) Snapshot Operations: Add debug logs at the entry point

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15848: -- Component/s: snapshots Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-15847) create client protocol: add ecPolicyName & storagePolicy param to debug statement string

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15847: -- Component/s: erasure-coding namanode Target Version/s: 3.3.1, 3.4.0

[jira] [Updated] (HDFS-15834) Remove the usage of org.apache.log4j.Level

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15834: -- Component/s: hdfs-common Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-15820) Ensure snapshot root trash provisioning happens only post safe mode exit

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15820: -- Component/s: snapshots Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-15817) Rename snapshots while marking them deleted

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15817: -- Component/s: snapshots Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-15767) RBF: Router federation rename of directory.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15767: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Router

[jira] [Updated] (HDFS-15672) TestBalancerWithMultipleNameNodes#testBalancingBlockpoolsWithBlockPoolPolicy fails on trunk

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15672: -- Component/s: balancer test Target Version/s: 3.2.3, 3.3.1, 3.4.0

[jira] [Updated] (HDFS-15762) TestMultipleNNPortQOP#testMultipleNNPortOverwriteDownStream fails intermittently

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15762: -- Component/s: hdfs test Target Version/s: 3.2.3, 3.3.1, 3.4.0

[jira] [Updated] (HDFS-14558) RBF: Isolation/Fairness documentation

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14558: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF:

[jira] [Updated] (HDFS-15702) Fix intermittent falilure of TestDecommission#testAllocAndIBRWhileDecommission

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15702: -- Component/s: hdfs test Target Version/s: 3.4.0 Affects Version/s:

[jira] [Updated] (HDFS-15766) RBF: MockResolver.getMountPoints() breaks the semantic of FileSubclusterResolver.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15766: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF:

[jira] [Updated] (HDFS-15748) RBF: Move the router related part from hadoop-federation-balance module to hadoop-hdfs-rbf.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15748: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Move the

[jira] [Updated] (HDFS-15648) TestFileChecksum should be parameterized

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15648: -- Component/s: test Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > TestFileChecksum

[jira] [Updated] (HDFS-15677) TestRouterRpcMultiDestination#testGetCachedDatanodeReport fails on trunk

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15677: -- Component/s: rbf test Target Version/s: 3.4.0 Affects Version/s:

[jira] [Updated] (HDFS-15674) TestBPOfferService#testMissBlocksWhenReregister fails on trunk

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15674: -- Component/s: datanode test Target Version/s: 3.3.6, 3.4.0 Affects

[jira] [Updated] (HDFS-15643) EC: Fix checksum computation in case of native encoders

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15643: -- Component/s: erasure-coding Target Version/s: 3.2.3, 3.3.1, 3.2.2, 3.4.0 Affects

[jira] [Updated] (HDFS-15460) TestFileCreation#testServerDefaultsWithMinimalCaching fails intermittently

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15460: -- Component/s: hdfs test Target Version/s: 3.4.0 Affects Version/s:

[jira] [Updated] (HDFS-9776) TestHAAppend#testMultipleAppendsDuringCatchupTailing is flaky

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-9776: - Component/s: test Target Version/s: 3.2.3, 3.3.1, 3.2.2, 3.4.0 Affects Version/s: 3.2.3

[jira] [Updated] (HDFS-15640) Add diff threshold to FedBalance

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15640: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Add diff threshold

[jira] [Updated] (HDFS-15614) Initialize snapshot trash root during NameNode startup if enabled

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15614: -- Component/s: namanode snapshots Hadoop Flags: Reviewed

[jira] [Updated] (HDFS-15598) ViewHDFS#canonicalizeUri should not be restricted to DFS only API.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15598: -- Component/s: viewfs Target Version/s: 3.4.0 > ViewHDFS#canonicalizeUri should not be

[jira] [Updated] (HDFS-15585) ViewDFS#getDelegationToken should not throw UnsupportedOperationException.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15585: -- Component/s: viewfs Target Version/s: 3.3.1, 3.4.0 > ViewDFS#getDelegationToken should not

[jira] [Updated] (HDFS-15532) listFiles on root/InternalDir will fail if fallback root has file

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15532: -- Component/s: viewfs Target Version/s: 3.3.1, 3.4.0 > listFiles on root/InternalDir will fail

[jira] [Updated] (HDFS-15558) ViewDistributedFileSystem#recoverLease should call super.recoverLease when there are no mounts configured

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15558: -- Component/s: viewfs Target Version/s: 3.3.1, 3.4.0 Affects Version/s: 3.3.1

[jira] [Updated] (HDFS-15496) Add UI for deleted snapshots

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15496: -- Component/s: snapshots Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-15518) Wrong operation name in FsNamesystem for listSnapshots

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15518: -- Component/s: snapshots Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-15374) Add documentation for fedbalance tool

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15374: -- Component/s: documentation rbf Target Version/s: 3.4.0 Affects

[jira] [Updated] (HDFS-15410) Add separated config file hdfs-fedbalance-default.xml for fedbalance tool

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15410: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Add separated

[jira] [Updated] (HDFS-15346) FedBalance tool implementation

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15346: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > FedBalance tool

[jira] [Updated] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15340: -- Component/s: rbf Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > RBF: Implement

[jira] [Updated] (HDFS-15146) TestBalancerRPCDelay. testBalancerRPCDelayQpsDefault fails intermittently

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15146: -- Component/s: balancer test Target Version/s: 2.10.1, 3.2.2, 3.3.0,

[jira] [Updated] (HDFS-15898) Test case TestOfflineImageViewer fails

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15898: -- Component/s: test Hadoop Flags: Reviewed Target Version/s: 3.3.1, 3.4.0 Affects

  1   2   3   4   5   6   7   8   9   10   >