[jira] [Commented] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807610#comment-17807610 ] ASF GitHub Bot commented on HDFS-16016: --- yuanboliu commented on PR #6457: URL:

[jira] [Commented] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807606#comment-17807606 ] ASF GitHub Bot commented on HDFS-16016: --- slfan1989 commented on PR #6457: URL:

[jira] [Commented] (HDFS-17316) Compatibility Benchmark over HCFS Implementations

2024-01-16 Thread Han Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807603#comment-17807603 ] Han Liu commented on HDFS-17316: Thank you for the detailed comments from [~ste...@apache.org]  and

[jira] [Commented] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807593#comment-17807593 ] ASF GitHub Bot commented on HDFS-16016: --- tasanuma commented on PR #6457: URL:

[jira] [Commented] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807589#comment-17807589 ] ASF GitHub Bot commented on HDFS-16016: --- yuanboliu commented on PR #6457: URL:

[jira] [Commented] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807590#comment-17807590 ] ASF GitHub Bot commented on HDFS-16016: --- tasanuma commented on PR #6457: URL:

[jira] [Updated] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16016: -- Fix Version/s: (was: 3.4.0) > BPServiceActor add a new thread to handle IBR >

[jira] [Updated] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16016: -- Target Version/s: 3.5.0 (was: 3.4.0) > BPServiceActor add a new thread to handle IBR >

[jira] [Reopened] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan reopened HDFS-16016: --- > BPServiceActor add a new thread to handle IBR > - > >

[jira] [Commented] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807578#comment-17807578 ] ASF GitHub Bot commented on HDFS-16016: --- slfan1989 opened a new pull request, #6457: URL:

[jira] [Commented] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807567#comment-17807567 ] ASF GitHub Bot commented on HDFS-16016: --- slfan1989 commented on PR #2998: URL:

[jira] [Commented] (HDFS-17339) BPServiceActor should skip cacheReport when one blockPool does not have CacheBlock on this DataNode

2024-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807532#comment-17807532 ] ASF GitHub Bot commented on HDFS-17339: --- ThinkerLei commented on PR #6456: URL:

[jira] [Commented] (HDFS-17339) BPServiceActor should skip cacheReport when one blockPool does not have CacheBlock on this DataNode

2024-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807515#comment-17807515 ] ASF GitHub Bot commented on HDFS-17339: --- zhangshuyan0 commented on PR #6456: URL:

[jira] [Commented] (HDFS-17339) BPServiceActor should skip cacheReport when one blockPool does not have CacheBlock on this DataNode

2024-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807497#comment-17807497 ] ASF GitHub Bot commented on HDFS-17339: --- hadoop-yetus commented on PR #6456: URL:

[jira] [Commented] (HDFS-17331) Fix Blocks are always -1 and DataNode`s version are always UNKNOWN in federationhealth.html

2024-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807442#comment-17807442 ] ASF GitHub Bot commented on HDFS-17331: --- hadoop-yetus commented on PR #6429: URL:

[jira] [Updated] (HDFS-17340) transaction lag issue between aNN and oNN causing HDFS_DELEGATION_TOKEN can't be found in cache in oNN

2024-01-16 Thread Rohan Nimmagadda (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohan Nimmagadda updated HDFS-17340: Description: We experienced a transaction lag issue between aNN and oNN, causing problems

[jira] [Updated] (HDFS-17340) transaction lag issue between aNN and oNN causing HDFS_DELEGATION_TOKEN can't be found in cache in oNN

2024-01-16 Thread Rohan Nimmagadda (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohan Nimmagadda updated HDFS-17340: Description: We experienced a transaction lag issue between aNN and oNN, causing problems

[jira] [Commented] (HDFS-17340) transaction lag issue between aNN and oNN causing HDFS_DELEGATION_TOKEN can't be found in cache in oNN

2024-01-16 Thread Rohan Nimmagadda (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807295#comment-17807295 ] Rohan Nimmagadda commented on HDFS-17340: - hive error logs    {code:java} ERROR : Status: Failed

[jira] [Created] (HDFS-17340) transaction lag issue between aNN and oNN causing HDFS_DELEGATION_TOKEN can't be found in cache in oNN

2024-01-16 Thread Rohan Nimmagadda (Jira)
Rohan Nimmagadda created HDFS-17340: --- Summary: transaction lag issue between aNN and oNN causing HDFS_DELEGATION_TOKEN can't be found in cache in oNN Key: HDFS-17340 URL:

[jira] [Commented] (HDFS-17221) Add NNThroughputBenchmark params to specify subcluster load in RBF

2024-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807204#comment-17807204 ] ASF GitHub Bot commented on HDFS-17221: --- verdoga55 commented on PR #6230: URL:

[jira] [Updated] (HDFS-17221) Add NNThroughputBenchmark params to specify subcluster load in RBF

2024-01-16 Thread Alexander Bogdanov (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Bogdanov updated HDFS-17221: -- Status: Patch Available (was: Open) > Add NNThroughputBenchmark params to specify

[jira] [Updated] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-14694: -- Target Version/s: 3.3.2, 3.4.0 (was: 3.3.2) > Call recoverLease on DFSOutputStream close exception >

[jira] [Updated] (HDFS-15344) DataNode#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15344: -- Target Version/s: 3.3.2, 3.4.0 (was: 3.3.2) > DataNode#checkSuperuserPrivilege should use

[jira] [Updated] (HDFS-15345) RBF: RouterPermissionChecker#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15345: -- Target Version/s: 3.3.2, 3.4.0 (was: 3.3.2) > RBF: RouterPermissionChecker#checkSuperuserPrivilege

[jira] [Updated] (HDFS-15359) EC: Allow closing a file with committed blocks

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15359: -- Target Version/s: 3.3.2, 3.4.0 (was: 3.3.2) > EC: Allow closing a file with committed blocks >

[jira] [Updated] (HDFS-15371) Nonstandard characters exist in NameNode.java

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15371: -- Target Version/s: 3.1.0, 3.4.0 (was: 3.1.0) > Nonstandard characters exist in NameNode.java >

[jira] [Commented] (HDFS-16970) EC: client copy wrong buffer from decode output during pread

2024-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807123#comment-17807123 ] ASF GitHub Bot commented on HDFS-16970: --- LoseYSelf commented on PR #5526: URL:

[jira] [Updated] (HDFS-15492) Make trash root inside each snapshottable directory

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15492: -- Target Version/s: 3.3.1, 3.4.0 (was: 3.3.1) > Make trash root inside each snapshottable directory >

[jira] [Updated] (HDFS-15545) (S)Webhdfs will not use updated delegation tokens available in the ugi after the old ones expire

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15545: -- Target Version/s: 3.3.2, 3.4.0 (was: 3.3.2) > (S)Webhdfs will not use updated delegation tokens

[jira] [Updated] (HDFS-15561) RBF: Fix NullPointException when start dfsrouter

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15561: -- Target Version/s: 3.3.1, 3.4.0 (was: 3.3.1) > RBF: Fix NullPointException when start dfsrouter >

[jira] [Updated] (HDFS-15608) Rename variable DistCp#CLEANUP

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15608: -- Target Version/s: 3.3.0, 3.4.0 (was: 3.3.0) > Rename variable DistCp#CLEANUP >

[jira] [Updated] (HDFS-15596) ViewHDFS#create(f, permission, cflags, bufferSize, replication, blockSize, progress, checksumOpt) should not be restricted to DFS only.

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15596: -- Target Version/s: 3.3.1, 3.4.0 (was: 3.3.1) > ViewHDFS#create(f, permission, cflags, bufferSize,

[jira] [Updated] (HDFS-15684) EC: Call recoverLease on DFSStripedOutputStream close exception

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15684: -- Target Version/s: 3.3.2, 3.4.0 (was: 3.3.2) > EC: Call recoverLease on DFSStripedOutputStream close

[jira] [Updated] (HDFS-15850) Superuser actions should be reported to external enforcers

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15850: -- Target Version/s: 3.3.2, 3.4.0 (was: 3.3.2) > Superuser actions should be reported to external

[jira] [Updated] (HDFS-16422) Fix thread safety of EC decoding during concurrent preads

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16422: -- Target Version/s: 3.3.3, 3.4.0 (was: 3.3.3) > Fix thread safety of EC decoding during concurrent

[jira] [Updated] (HDFS-16652) Upgrade jquery datatable version references to v1.10.19

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16652: -- Target Version/s: 3.4.0, 3.3.9 (was: 3.3.9) > Upgrade jquery datatable version references to v1.10.19

[jira] [Updated] (HDFS-16740) Mini cluster test flakiness

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16740: -- Target Version/s: 3.4.0, 3.3.9 (was: 3.3.9) > Mini cluster test flakiness >

[jira] [Updated] (HDFS-16761) Namenode UI for Datanodes page not loading if any data node is down

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16761: -- Target Version/s: 3.2.2, 3.4.0 (was: 3.2.2) > Namenode UI for Datanodes page not loading if any data

[jira] [Updated] (HDFS-17024) Potential data race introduced by HDFS-15865

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17024: -- Target Version/s: 3.4.0, 3.3.9 (was: 3.3.9) > Potential data race introduced by HDFS-15865 >

[jira] [Updated] (HDFS-17312) packetsReceived metric should ignore heartbeat packet

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17312: -- Target Version/s: 3.4.0, 3.5.0 (was: 3.5.0) > packetsReceived metric should ignore heartbeat packet >

[jira] [Commented] (HDFS-15552) Let DeadNode Detector also work for EC cases

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807097#comment-17807097 ] Shilun Fan commented on HDFS-15552: --- We don't need to set a fix version. We can only confirm the fix

[jira] [Updated] (HDFS-15980) Fix tests for HDFS-15754 Create packet metrics for DataNode

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15980: -- Fix Version/s: (was: 3.4.0) > Fix tests for HDFS-15754 Create packet metrics for DataNode >

[jira] [Commented] (HDFS-15980) Fix tests for HDFS-15754 Create packet metrics for DataNode

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807096#comment-17807096 ] Shilun Fan commented on HDFS-15980: --- We don't need to set a fix version. We can only confirm the fix

[jira] [Updated] (HDFS-15552) Let DeadNode Detector also work for EC cases

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-15552: -- Fix Version/s: (was: 3.4.0) > Let DeadNode Detector also work for EC cases >

[jira] [Commented] (HDFS-16905) Provide default hadoop.log.dir for tests

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807095#comment-17807095 ] Shilun Fan commented on HDFS-16905: --- We don't need to set a fix version. We can only confirm the fix

[jira] [Updated] (HDFS-16905) Provide default hadoop.log.dir for tests

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16905: -- Fix Version/s: (was: 3.4.0) (was: 3.3.9) > Provide default hadoop.log.dir

[jira] [Updated] (HDFS-16970) EC: client copy wrong buffer from decode output during pread

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-16970: -- Fix Version/s: (was: 3.4.0) (was: 3.3.5) > EC: client copy wrong buffer

[jira] [Resolved] (HDFS-17290) HDFS: add client rpc backoff metrics due to disconnection from lowest priority queue

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HDFS-17290. --- Hadoop Flags: Reviewed Resolution: Fixed > HDFS: add client rpc backoff metrics due to

[jira] [Updated] (HDFS-17290) HDFS: add client rpc backoff metrics due to disconnection from lowest priority queue

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17290: -- Fix Version/s: 3.4.0 Target Version/s: 3.4.0 > HDFS: add client rpc backoff metrics due to

[jira] [Updated] (HDFS-17201) some methods in FsDatasetImpl should acquire readLock with LockLevel.VOLUME

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17201: -- Fix Version/s: (was: 3.4.0) > some methods in FsDatasetImpl should acquire readLock with

[jira] [Updated] (HDFS-17290) HDFS: add client rpc backoff metrics due to disconnection from lowest priority queue

2024-01-16 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HDFS-17290: -- Fix Version/s: (was: 3.4.0) > HDFS: add client rpc backoff metrics due to disconnection from