[jira] [Commented] (HDFS-17432) Fix junit dependency to enable JUnit4 tests to run in hadoop-hdfs-rbf

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829384#comment-17829384 ] ASF GitHub Bot commented on HDFS-17432: --- tasanuma commented on PR #6639: URL:

[jira] [Commented] (HDFS-17432) Fix junit dependency to enable JUnit4 tests to run in hadoop-hdfs-rbf

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829383#comment-17829383 ] ASF GitHub Bot commented on HDFS-17432: --- tasanuma merged PR #6639: URL:

[jira] [Commented] (HDFS-17432) Fix junit dependency to enable JUnit4 tests to run in hadoop-hdfs-rbf

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829381#comment-17829381 ] ASF GitHub Bot commented on HDFS-17432: --- tasanuma commented on PR #6639: URL:

[jira] [Created] (HDFS-17435) Fix TestRouterRpc#testClearStaleNamespacesInRouterStateIdContext() failed

2024-03-20 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-17435: --- Summary: Fix TestRouterRpc#testClearStaleNamespacesInRouterStateIdContext() failed Key: HDFS-17435 URL: https://issues.apache.org/jira/browse/HDFS-17435

[jira] [Resolved] (HDFS-17433) metrics sumOfActorCommandQueueLength should only record valid commands

2024-03-20 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia resolved HDFS-17433. -- Fix Version/s: 3.5.0 Resolution: Fixed > metrics sumOfActorCommandQueueLength

[jira] [Commented] (HDFS-17433) metrics sumOfActorCommandQueueLength should only record valid commands

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829368#comment-17829368 ] ASF GitHub Bot commented on HDFS-17433: --- dineshchitlangia merged PR #6644: URL:

[jira] [Commented] (HDFS-17433) metrics sumOfActorCommandQueueLength should only record valid commands

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829367#comment-17829367 ] ASF GitHub Bot commented on HDFS-17433: --- dineshchitlangia commented on PR #6644: URL:

[jira] [Commented] (HDFS-17434) Selector.select in SocketIOWithTimeout.java has significant overhead

2024-03-20 Thread farmmamba (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829366#comment-17829366 ] farmmamba commented on HDFS-17434: -- [~qinyuren] Hi, could you please show your createRbw avgTime? >

[jira] [Updated] (HDFS-17416) [FGL] Monitor threads in BlockManager.class support fine-grained lock

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17416: -- Labels: pull-request-available (was: ) > [FGL] Monitor threads in BlockManager.class support

[jira] [Commented] (HDFS-17416) [FGL] Monitor threads in BlockManager.class support fine-grained lock

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829365#comment-17829365 ] ASF GitHub Bot commented on HDFS-17416: --- ZanderXu opened a new pull request, #6647: URL:

[jira] [Commented] (HDFS-17430) RecoveringBlock will skip no live replicas when get block recovery command.

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829364#comment-17829364 ] ASF GitHub Bot commented on HDFS-17430: --- haiyang1987 commented on code in PR #6635: URL:

[jira] [Commented] (HDFS-17430) RecoveringBlock will skip no live replicas when get block recovery command.

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829363#comment-17829363 ] ASF GitHub Bot commented on HDFS-17430: --- haiyang1987 commented on code in PR #6635: URL:

[jira] [Commented] (HDFS-17426) Remove Invalid FileSystemECReadStats logic in DFSInputStream

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829358#comment-17829358 ] ASF GitHub Bot commented on HDFS-17426: --- haiyang1987 commented on PR #6628: URL:

[jira] [Resolved] (HDFS-17426) Remove Invalid FileSystemECReadStats logic in DFSInputStream

2024-03-20 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZanderXu resolved HDFS-17426. - Resolution: Fixed > Remove Invalid FileSystemECReadStats logic in DFSInputStream >

[jira] [Commented] (HDFS-17426) Remove Invalid FileSystemECReadStats logic in DFSInputStream

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829353#comment-17829353 ] ASF GitHub Bot commented on HDFS-17426: --- ZanderXu commented on PR #6628: URL:

[jira] [Commented] (HDFS-17426) Remove Invalid FileSystemECReadStats logic in DFSInputStream

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829352#comment-17829352 ] ASF GitHub Bot commented on HDFS-17426: --- ZanderXu merged PR #6628: URL:

[jira] [Commented] (HDFS-17103) messy file system cleanup in TestNameEditsConfigs

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829323#comment-17829323 ] ASF GitHub Bot commented on HDFS-17103: --- teamconfx commented on PR #6071: URL:

[jira] [Commented] (HDFS-17109) Null Pointer Exception when running TestBlockManager

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829321#comment-17829321 ] ASF GitHub Bot commented on HDFS-17109: --- teamconfx commented on PR #6046: URL:

[jira] [Commented] (HDFS-17099) Null Pointer Exception when stop namesystem in HDFS

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829319#comment-17829319 ] ASF GitHub Bot commented on HDFS-17099: --- teamconfx commented on PR #6034: URL:

[jira] [Commented] (HDFS-17098) DatanodeManager does not handle null storage type properly

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829316#comment-17829316 ] ASF GitHub Bot commented on HDFS-17098: --- teamconfx commented on code in PR #6035: URL:

[jira] [Commented] (HDFS-17098) DatanodeManager does not handle null storage type properly

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829314#comment-17829314 ] ASF GitHub Bot commented on HDFS-17098: --- teamconfx commented on code in PR #6035: URL:

[jira] [Commented] (HDFS-17433) metrics sumOfActorCommandQueueLength should only record valid commands

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829249#comment-17829249 ] ASF GitHub Bot commented on HDFS-17433: --- hadoop-yetus commented on PR #6644: URL:

[jira] [Commented] (HDFS-17423) [FGL] BlockManagerSafeMode supports fine-grained lock

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828953#comment-17828953 ] ASF GitHub Bot commented on HDFS-17423: --- hadoop-yetus commented on PR #6645: URL:

[jira] [Updated] (HDFS-17434) Selector.select in SocketIOWithTimeout.java has significant overhead

2024-03-20 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-17434: Description: In our cluster, the SendDataPacketBlockedOnNetworkNanosAvgTime metric ranges from 5ms to

[jira] [Updated] (HDFS-17434) Selector.select in SocketIOWithTimeout.java has significant overhead

2024-03-20 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-17434: Issue Type: Wish (was: Task) > Selector.select in SocketIOWithTimeout.java has significant overhead >

[jira] [Commented] (HDFS-17434) Selector.select in SocketIOWithTimeout.java has significant overhead

2024-03-20 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828925#comment-17828925 ] qinyuren commented on HDFS-17434: - [~hexiaoqiao] [~tasanuma] [~zanderxu]  Please take a look. >

[jira] [Updated] (HDFS-17129) mis-order of ibr and fbr on datanode

2024-03-20 Thread Xiping Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang updated HDFS-17129: Attachment: image-2024-03-20-18-07-42-155.png > mis-order of ibr and fbr on datanode >

[jira] [Updated] (HDFS-17434) Selector.select in SocketIOWithTimeout.java has significant overhead

2024-03-20 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-17434: Attachment: image-2024-03-20-19-55-18-378.png > Selector.select in SocketIOWithTimeout.java has

[jira] [Updated] (HDFS-17434) Selector.select in SocketIOWithTimeout.java has significant overhead

2024-03-20 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-17434: Issue Type: Test (was: Wish) > Selector.select in SocketIOWithTimeout.java has significant overhead >

[jira] [Commented] (HDFS-15413) DFSStripedInputStream throws exception when datanodes close idle connections

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828907#comment-17828907 ] ASF GitHub Bot commented on HDFS-15413: --- haiyang1987 commented on code in PR #5829: URL:

[jira] [Commented] (HDFS-15413) DFSStripedInputStream throws exception when datanodes close idle connections

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828905#comment-17828905 ] ASF GitHub Bot commented on HDFS-15413: --- haiyang1987 commented on code in PR #5829: URL:

[jira] [Updated] (HDFS-17434) Selector.select in SocketIOWithTimeout.java has significant overhead

2024-03-20 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-17434: Description: In our cluster, the SendDataPacketBlockedOnNetworkNanosAvgTime metric ranges from 5ms to

[jira] [Commented] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-03-20 Thread Xiping Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828914#comment-17828914 ] Xiping Zhang commented on HDFS-16016: - HDFS-16016 is a good improvement, and in our production

[jira] [Commented] (HDFS-17430) RecoveringBlock will skip no live replicas when get block recovery command.

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828912#comment-17828912 ] ASF GitHub Bot commented on HDFS-17430: --- Hexiaoqiao commented on code in PR #6635: URL:

[jira] [Commented] (HDFS-15413) DFSStripedInputStream throws exception when datanodes close idle connections

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828906#comment-17828906 ] ASF GitHub Bot commented on HDFS-15413: --- haiyang1987 commented on code in PR #5829: URL:

[jira] [Created] (HDFS-17434) Selector.select in SocketIOWithTimeout.java has significant overhead

2024-03-20 Thread qinyuren (Jira)
qinyuren created HDFS-17434: --- Summary: Selector.select in SocketIOWithTimeout.java has significant overhead Key: HDFS-17434 URL: https://issues.apache.org/jira/browse/HDFS-17434 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15413) DFSStripedInputStream throws exception when datanodes close idle connections

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828902#comment-17828902 ] ASF GitHub Bot commented on HDFS-15413: --- haiyang1987 commented on code in PR #5829: URL:

[jira] [Updated] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2024-03-20 Thread Xiping Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiping Zhang updated HDFS-16016: Attachment: image-2024-03-20-18-31-23-937.png > BPServiceActor add a new thread to handle IBR >

[jira] [Commented] (HDFS-15413) DFSStripedInputStream throws exception when datanodes close idle connections

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828904#comment-17828904 ] ASF GitHub Bot commented on HDFS-15413: --- haiyang1987 commented on code in PR #5829: URL:

[jira] [Commented] (HDFS-17433) metrics sumOfActorCommandQueueLength should only record valid commands

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828676#comment-17828676 ] ASF GitHub Bot commented on HDFS-17433: --- hadoop-yetus commented on PR #6644: URL:

[jira] [Updated] (HDFS-17423) [FGL] BlockManagerSafeMode supports fine-grained lock

2024-03-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-17423: -- Labels: pull-request-available (was: ) > [FGL] BlockManagerSafeMode supports fine-grained