[jira] [Commented] (HDFS-15555) RBF: Refresh cacheNS when SocketException occurs

2024-04-24 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840312#comment-17840312 ] Takanobu Asanuma commented on HDFS-1: - [~chuanjie.duan]  ConnectException is an instance of

[jira] [Created] (HDFS-17468) Update ISA-L to 2.31.0 in the build image

2024-04-15 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-17468: --- Summary: Update ISA-L to 2.31.0 in the build image Key: HDFS-17468 URL: https://issues.apache.org/jira/browse/HDFS-17468 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-17435) Fix TestRouterRpc failed

2024-03-25 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17435: Fix Version/s: 3.4.1 > Fix TestRouterRpc failed > > >

[jira] [Updated] (HDFS-17354) Delay invoke clearStaleNamespacesInRouterStateIdContext during router start up

2024-03-25 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17354: Fix Version/s: 3.4.1 > Delay invoke clearStaleNamespacesInRouterStateIdContext during

[jira] [Updated] (HDFS-17441) Fix junit dependency by adding missing library in hadoop-hdfs-rbf

2024-03-25 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17441: Fix Version/s: 3.4.1 > Fix junit dependency by adding missing library in hadoop-hdfs-rbf >

[jira] [Updated] (HDFS-17441) Fix junit dependency by adding missing library in hadoop-hdfs-rbf

2024-03-25 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17441: Fix Version/s: 3.5.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Resolved] (HDFS-17435) Fix TestRouterRpc failed

2024-03-25 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17435. - Fix Version/s: 3.5.0 Resolution: Fixed > Fix TestRouterRpc failed >

[jira] [Updated] (HDFS-17441) Fix junit dependency by adding missing library in hadoop-hdfs-rbf

2024-03-25 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17441: Status: Patch Available (was: Open) > Fix junit dependency by adding missing library in

[jira] [Created] (HDFS-17441) Fix junit dependency by adding missing library in hadoop-hdfs-rbf

2024-03-25 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-17441: --- Summary: Fix junit dependency by adding missing library in hadoop-hdfs-rbf Key: HDFS-17441 URL: https://issues.apache.org/jira/browse/HDFS-17441 Project:

[jira] [Updated] (HDFS-17435) Fix TestRouterRpc failed

2024-03-24 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17435: Summary: Fix TestRouterRpc failed (was: Fix

[jira] [Commented] (HDFS-17370) Fix junit dependency for running parameterized tests in hadoop-hdfs-rbf

2024-03-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829873#comment-17829873 ] Takanobu Asanuma commented on HDFS-17370: - Thanks again for sharing the problem, [~ayushtkn]. I

[jira] [Commented] (HDFS-17370) Fix junit dependency for running parameterized tests in hadoop-hdfs-rbf

2024-03-21 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829437#comment-17829437 ] Takanobu Asanuma commented on HDFS-17370: - The problem is fixed by HDFS-17432. > Fix junit

[jira] [Resolved] (HDFS-17354) Delay invoke clearStaleNamespacesInRouterStateIdContext during router start up

2024-03-21 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17354. - Fix Version/s: 3.5.0 Resolution: Fixed > Delay invoke

[jira] [Assigned] (HDFS-17435) Fix TestRouterRpc#testClearStaleNamespacesInRouterStateIdContext() failed

2024-03-21 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma reassigned HDFS-17435: --- Assignee: Takanobu Asanuma > Fix

[jira] [Resolved] (HDFS-17432) Fix junit dependency to enable JUnit4 tests to run in hadoop-hdfs-rbf

2024-03-21 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17432. - Fix Version/s: 3.4.1 3.5.0 Resolution: Fixed > Fix junit

[jira] [Created] (HDFS-17435) Fix TestRouterRpc#testClearStaleNamespacesInRouterStateIdContext() failed

2024-03-20 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-17435: --- Summary: Fix TestRouterRpc#testClearStaleNamespacesInRouterStateIdContext() failed Key: HDFS-17435 URL: https://issues.apache.org/jira/browse/HDFS-17435

[jira] [Created] (HDFS-17432) Fix junit dependency to enable JUnit4 tests to run in hadoop-hdfs-rbf

2024-03-18 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-17432: --- Summary: Fix junit dependency to enable JUnit4 tests to run in hadoop-hdfs-rbf Key: HDFS-17432 URL: https://issues.apache.org/jira/browse/HDFS-17432 Project:

[jira] [Commented] (HDFS-17370) Fix junit dependency for running parameterized tests in hadoop-hdfs-rbf

2024-03-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828144#comment-17828144 ] Takanobu Asanuma commented on HDFS-17370: - [~ayushtkn] Thank you for investigating. It indeed

[jira] [Updated] (HDFS-17333) DFSClient supports lazy resolution from hostname to IP.

2024-03-02 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17333: Fix Version/s: 3.4.1 3.5.0 > DFSClient supports lazy resolution from

[jira] [Updated] (HDFS-17333) DFSClient supports lazy resolution from hostname to IP.

2024-03-02 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17333: Summary: DFSClient supports lazy resolution from hostname to IP. (was: DFSClient support

[jira] [Resolved] (HDFS-17361) DiskBalancer: Query command support with multiple nodes

2024-02-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17361. - Fix Version/s: 3.5.0 Resolution: Fixed > DiskBalancer: Query command support with

[jira] [Updated] (HDFS-17362) RBF: Implement RouterObserverReadConfiguredFailoverProxyProvider

2024-02-12 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17362: Fix Version/s: 3.4.1 3.5.0 Resolution: Fixed Status:

[jira] [Updated] (HDFS-17362) RBF: Implement RouterObserverReadConfiguredFailoverProxyProvider

2024-02-07 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17362: Summary: RBF: Implement RouterObserverReadConfiguredFailoverProxyProvider (was: RBF:

[jira] [Updated] (HDFS-17370) Fix junit dependency for running parameterized tests in hadoop-hdfs-rbf

2024-02-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17370: Fix Version/s: 3.4.1 3.5.0 Resolution: Fixed Status:

[jira] [Updated] (HDFS-17370) Fix junit dependency for running parameterized tests in hadoop-hdfs-rbf

2024-02-02 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17370: Status: Patch Available (was: Open) > Fix junit dependency for running parameterized

[jira] [Created] (HDFS-17370) Fix junit dependency for running parameterized tests in hadoop-hdfs-rbf

2024-02-02 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-17370: --- Summary: Fix junit dependency for running parameterized tests in hadoop-hdfs-rbf Key: HDFS-17370 URL: https://issues.apache.org/jira/browse/HDFS-17370 Project:

[jira] [Resolved] (HDFS-17359) EC: recheck failed streamers should only after flushing all packets.

2024-02-01 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17359. - Fix Version/s: 3.3.9 3.4.1 3.5.0 Resolution:

[jira] [Reopened] (HDFS-17348) Enhance Log when checkLocations in RecoveryTaskStriped

2024-01-30 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma reopened HDFS-17348: - > Enhance Log when checkLocations in RecoveryTaskStriped >

[jira] [Resolved] (HDFS-17348) Enhance Log when checkLocations in RecoveryTaskStriped

2024-01-30 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17348. - Resolution: Duplicate I'd like to change the status to duplicate if HDFS-17358 fixes the

[jira] [Commented] (HDFS-17356) RBF: Add Configuration dfs.federation.router.ns.name Optimization

2024-01-29 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811863#comment-17811863 ] Takanobu Asanuma commented on HDFS-17356: - [~bigdata_zoodev] Thanks for your reply. In our

[jira] [Commented] (HDFS-17356) RBF: Add Configuration dfs.federation.router.ns.name Optimization

2024-01-29 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811768#comment-17811768 ] Takanobu Asanuma commented on HDFS-17356: - As the error log shows, dfs.nameservice.id and

[jira] [Updated] (HDFS-17362) RBF: RouterObserverReadProxyProvider should use ConfiguredFailoverProxyProvider internally

2024-01-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17362: Status: Patch Available (was: Open) > RBF: RouterObserverReadProxyProvider should use >

[jira] [Created] (HDFS-17362) RBF: RouterObserverReadProxyProvider should use ConfiguredFailoverProxyProvider internally

2024-01-28 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-17362: --- Summary: RBF: RouterObserverReadProxyProvider should use ConfiguredFailoverProxyProvider internally Key: HDFS-17362 URL: https://issues.apache.org/jira/browse/HDFS-17362

[jira] [Updated] (HDFS-17343) Revert HDFS-16016. BPServiceActor to provide new thread to handle IBR

2024-01-20 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17343: Fix Version/s: 3.5.0 > Revert HDFS-16016. BPServiceActor to provide new thread to handle

[jira] [Updated] (HDFS-17312) packetsReceived metric should ignore heartbeat packet

2024-01-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17312: Fix Version/s: 3.4.0 (was: 3.4.1) (was:

[jira] [Commented] (HDFS-17312) packetsReceived metric should ignore heartbeat packet

2024-01-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806579#comment-17806579 ] Takanobu Asanuma commented on HDFS-17312: - There seems to be another release candidate for 3.4.0,

[jira] [Updated] (HDFS-17312) packetsReceived metric should ignore heartbeat packet

2024-01-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17312: Fix Version/s: 3.4.1 > packetsReceived metric should ignore heartbeat packet >

[jira] [Resolved] (HDFS-17312) packetsReceived metric should ignore heartbeat packet

2024-01-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17312. - Fix Version/s: 3.5.0 Resolution: Fixed > packetsReceived metric should ignore

[jira] [Resolved] (HDFS-17315) Optimize the namenode format code logic.

2024-01-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17315. - Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed > Optimize the

[jira] [Updated] (HDFS-17277) Delete invalid code logic in namenode format

2023-12-29 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17277: Fix Version/s: 3.3.9 > Delete invalid code logic in namenode format >

[jira] [Assigned] (HDFS-17277) Delete invalid code logic in namenode format

2023-12-29 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma reassigned HDFS-17277: --- Assignee: zhangzhanchang > Delete invalid code logic in namenode format >

[jira] [Resolved] (HDFS-17277) Delete invalid code logic in namenode format

2023-12-29 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17277. - Fix Version/s: 3.4.0 Resolution: Fixed > Delete invalid code logic in namenode

[jira] [Resolved] (HDFS-17301) Add read and write dataXceiver threads count metrics to datanode.

2023-12-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17301. - Fix Version/s: 3.4.0 Resolution: Fixed > Add read and write dataXceiver threads

[jira] [Updated] (HDFS-17150) EC: Fix the bug of failed lease recovery.

2023-12-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17150: Fix Version/s: 3.3.9 > EC: Fix the bug of failed lease recovery. >

[jira] [Commented] (HDFS-17150) EC: Fix the bug of failed lease recovery.

2023-12-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17801009#comment-17801009 ] Takanobu Asanuma commented on HDFS-17150: - Cherry-picked to branch-3.3. > EC: Fix the bug of

[jira] [Updated] (HDFS-17297) The NameNode should remove block from the BlocksMap if the block is marked as deleted.

2023-12-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17297: Fix Version/s: 3.3.9 > The NameNode should remove block from the BlocksMap if the block is

[jira] [Resolved] (HDFS-17297) The NameNode should remove block from the BlocksMap if the block is marked as deleted.

2023-12-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17297. - Fix Version/s: 3.4.0 Resolution: Fixed > The NameNode should remove block from

[jira] [Resolved] (HDFS-17284) Fix int overflow in calculating numEcReplicatedTasks and numReplicationTasks during block recovery

2023-12-26 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17284. - Fix Version/s: 3.4.0 Resolution: Fixed > Fix int overflow in calculating

[jira] [Updated] (HDFS-17298) Fix NPE in DataNode.handleBadBlock and BlockSender

2023-12-25 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17298: Fix Version/s: 3.3.9 > Fix NPE in DataNode.handleBadBlock and BlockSender >

[jira] [Resolved] (HDFS-17298) Fix NPE in DataNode.handleBadBlock and BlockSender

2023-12-25 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17298. - Fix Version/s: 3.4.0 Resolution: Fixed > Fix NPE in DataNode.handleBadBlock and

[jira] [Commented] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file.

2023-12-25 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800322#comment-17800322 ] Takanobu Asanuma commented on HDFS-17299: - I also agree with the implementation of a bestEffort

[jira] [Resolved] (HDFS-17294) Reconfigure the scheduling cycle of the slowPeerCollectorDaemon thread.

2023-12-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17294. - Resolution: Fixed > Reconfigure the scheduling cycle of the slowPeerCollectorDaemon

[jira] [Updated] (HDFS-17294) Reconfigure the scheduling cycle of the slowPeerCollectorDaemon thread.

2023-12-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17294: Fix Version/s: 3.4.0 > Reconfigure the scheduling cycle of the slowPeerCollectorDaemon

[jira] [Updated] (HDFS-17042) Add rpcCallSuccesses and OverallRpcProcessingTime to RpcMetrics for Namenode

2023-12-13 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17042: Fix Version/s: 3.3.9 > Add rpcCallSuccesses and OverallRpcProcessingTime to RpcMetrics for

[jira] [Updated] (HDFS-17156) Client may receive old state ID which will lead to inconsistent reads

2023-08-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17156: Fix Version/s: 3.3.9 (was: 3.3.7) > Client may receive old state ID

[jira] [Updated] (HDFS-17030) Limit wait time for getHAServiceState in ObserverReaderProxy

2023-08-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17030: Fix Version/s: 3.3.9 > Limit wait time for getHAServiceState in ObserverReaderProxy >

[jira] [Updated] (HDFS-17156) Client may receive old state ID which will lead to inconsistent reads

2023-08-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17156: Fix Version/s: 3.3.7 > Client may receive old state ID which will lead to inconsistent

[jira] [Resolved] (HDFS-17156) Client may receive old state ID which will lead to inconsistent reads

2023-08-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-17156. - Fix Version/s: 3.4.0 Resolution: Fixed > Client may receive old state ID which

[jira] [Updated] (HDFS-17156) Client may receive old state ID which will lead to inconsistent reads

2023-08-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-17156: Summary: Client may receive old state ID which will lead to inconsistent reads (was:

[jira] [Commented] (HDFS-17156) mapreduce job encounters java.io.IOException when dfs.client.rbf.observer.read.enable is true

2023-08-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17754126#comment-17754126 ] Takanobu Asanuma commented on HDFS-17156: - [~chunyiyang] I added you to the contributor role and

[jira] [Assigned] (HDFS-17156) mapreduce job encounters java.io.IOException when dfs.client.rbf.observer.read.enable is true

2023-08-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma reassigned HDFS-17156: --- Assignee: Chunyi Yang > mapreduce job encounters java.io.IOException when >

[jira] [Commented] (HDFS-17156) mapreduce job encounters java.io.IOException when dfs.client.rbf.observer.read.enable is true

2023-08-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17753235#comment-17753235 ] Takanobu Asanuma commented on HDFS-17156: - It looked like a bug in RBF SBN, so I moved this jira

[jira] [Moved] (HDFS-17156) mapreduce job encounters java.io.IOException when dfs.client.rbf.observer.read.enable is true

2023-08-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma moved HADOOP-18847 to HDFS-17156: -- Component/s: rbf (was: common)

[jira] [Resolved] (HDFS-16967) RBF: File based state stores should allow concurrent access to the records

2023-04-04 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16967. - Fix Version/s: 3.4.0 Resolution: Fixed > RBF: File based state stores should

[jira] [Resolved] (HDFS-16958) EC: Fix bug in processing EC excess redundancy

2023-03-27 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16958. - Resolution: Not A Problem > EC: Fix bug in processing EC excess redundancy >

[jira] [Commented] (HDFS-16310) RBF: Add client port to CallerContext for Router

2023-02-23 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692558#comment-17692558 ] Takanobu Asanuma commented on HDFS-16310: - Hi [~omalley], I have found several JIRAs that you

[jira] [Updated] (HDFS-16310) RBF: Add client port to CallerContext for Router

2023-02-23 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16310: Fix Version/s: 3.3.5 > RBF: Add client port to CallerContext for Router >

[jira] [Commented] (HDFS-16310) RBF: Add client port to CallerContext for Router

2023-02-23 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692555#comment-17692555 ] Takanobu Asanuma commented on HDFS-16310: - I added 3.3.5 to fix versions. > RBF: Add client port

[jira] [Updated] (HDFS-16266) Add remote port information to HDFS audit log

2023-02-23 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16266: Fix Version/s: 3.3.5 > Add remote port information to HDFS audit log >

[jira] [Commented] (HDFS-16266) Add remote port information to HDFS audit log

2023-02-23 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692553#comment-17692553 ] Takanobu Asanuma commented on HDFS-16266: - I added 3.3.5 to fix versions. > Add remote port

[jira] [Commented] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

2023-02-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692552#comment-17692552 ] Takanobu Asanuma commented on HDFS-15630: - I added 3.3.5 to fix versions. > RBF: Fix wrong

[jira] [Updated] (HDFS-15630) RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations.

2023-02-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15630: Fix Version/s: 3.3.5 > RBF: Fix wrong client IP info in CallerContext when requests mount

[jira] [Updated] (HDFS-13293) RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer

2023-02-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-13293: Fix Version/s: 3.3.5 > RBF: The RouterRPCServer should transfer client IP via

[jira] [Commented] (HDFS-13293) RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer

2023-02-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692551#comment-17692551 ] Takanobu Asanuma commented on HDFS-13293: - I added 3.3.5 to fix versions. > RBF: The

[jira] [Commented] (HDFS-16845) Add configuration flag to enable observer reads on routers without using ObserverReadProxyProvider

2023-02-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692547#comment-17692547 ] Takanobu Asanuma commented on HDFS-16845: - It is only in trunk. I corrected the fixed versions.

[jira] [Updated] (HDFS-16845) Add configuration flag to enable observer reads on routers without using ObserverReadProxyProvider

2023-02-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16845: Fix Version/s: (was: 3.3.5) (was: 2.10.3) > Add configuration

[jira] [Commented] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2023-02-21 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691455#comment-17691455 ] Takanobu Asanuma commented on HDFS-13522: - [~simbadzina] Thanks for your comment. For

[jira] [Commented] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2023-02-20 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691247#comment-17691247 ] Takanobu Asanuma commented on HDFS-13522: - [~simbadzina] Thanks again for implementing this

[jira] [Resolved] (HDFS-16903) Fix javadoc of Class LightWeightResizableGSet

2023-02-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16903. - Fix Version/s: 3.4.0 Resolution: Fixed > Fix javadoc of Class

[jira] [Assigned] (HDFS-16903) Fix javadoc of Class LightWeightResizableGSet

2023-02-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma reassigned HDFS-16903: --- Assignee: ZhangHB > Fix javadoc of Class LightWeightResizableGSet >

[jira] [Updated] (HDFS-16903) Fix javadoc of Class LightWeightResizableGSet

2023-02-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16903: Description: After HDFS-16429 (Add DataSetLockManager to manage fine-grain locks for

[jira] [Resolved] (HDFS-16821) Fix regression in HDFS-13522 that enables observer reads by default.

2023-01-31 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16821. - Fix Version/s: 3.4.0 Resolution: Fixed > Fix regression in HDFS-13522 that

[jira] [Updated] (HDFS-16888) BlockManager#maxReplicationStreams, replicationStreamsHardLimit, blocksReplWorkMultiplier and PendingReconstructionBlocks#timeout should be volatile

2023-01-31 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16888: Fix Version/s: 3.3.9 > BlockManager#maxReplicationStreams, replicationStreamsHardLimit, >

[jira] [Resolved] (HDFS-16888) BlockManager#maxReplicationStreams, replicationStreamsHardLimit, blocksReplWorkMultiplier and PendingReconstructionBlocks#timeout should be volatile

2023-01-31 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16888. - Fix Version/s: 3.4.0 Resolution: Fixed > BlockManager#maxReplicationStreams,

[jira] [Commented] (HDFS-16889) Backport JIRAs related to RBF SBN to branch-3.3

2023-01-24 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680423#comment-17680423 ] Takanobu Asanuma commented on HDFS-16889: - It will be from trunk. When we plan to release 3.4.0,

[jira] [Updated] (HDFS-16886) Fix documentation for StateStoreRecordOperations#get(Class ..., Query ...)

2023-01-23 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16886: Fix Version/s: 3.3.9 (was: 3.3.5) > Fix documentation for

[jira] [Resolved] (HDFS-16876) Garbage collect map entries in shared RouterStateIdContext using information from namenodeResolver instead of the map of active connectionPools.

2023-01-23 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16876. - Fix Version/s: 3.4.0 Resolution: Fixed > Garbage collect map entries in shared

[jira] [Commented] (HDFS-16889) Backport JIRAs related to RBF SBN to branch-3.3

2023-01-20 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679157#comment-17679157 ] Takanobu Asanuma commented on HDFS-16889: - After looking deeper into the related JIRAs, and

[jira] [Commented] (HDFS-16889) Backport JIRAs related to RBF SBN to branch-3.3

2023-01-19 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678606#comment-17678606 ] Takanobu Asanuma commented on HDFS-16889: - Thanks for your comment, [~simbadzina]. - I think it

[jira] [Commented] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2023-01-12 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17676240#comment-17676240 ] Takanobu Asanuma commented on HDFS-13522: - Created the umbrella Jira by HDFS-16889. >

[jira] [Created] (HDFS-16889) Backport JIRAs related to RBF SBN to branch-3.3

2023-01-12 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-16889: --- Summary: Backport JIRAs related to RBF SBN to branch-3.3 Key: HDFS-16889 URL: https://issues.apache.org/jira/browse/HDFS-16889 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2023-01-06 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655438#comment-17655438 ] Takanobu Asanuma commented on HDFS-13522: - Thanks for sharing it, [~simbadzina]. I looked over

[jira] [Updated] (HDFS-16767) RBF: Support observer node from Router-Based Federation

2023-01-04 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16767: Fix Version/s: (was: 3.3.5) > RBF: Support observer node from Router-Based Federation

[jira] [Updated] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2023-01-04 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-13522: Fix Version/s: (was: 3.3.5) > HDFS-13522: Add federated nameservices states to client

[jira] [Commented] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2023-01-04 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17654706#comment-17654706 ] Takanobu Asanuma commented on HDFS-13522: - Thanks for your reply, [~simbadzina]. If I understand

[jira] [Commented] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2022-12-27 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17652362#comment-17652362 ] Takanobu Asanuma commented on HDFS-13522: - Hi, [~simbadzina] [~omalley]. The fix versions of

[jira] [Updated] (HDFS-16809) EC striped block is not sufficient when doing in maintenance

2022-12-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16809: Fix Version/s: 3.2.5 > EC striped block is not sufficient when doing in maintenance >

[jira] [Resolved] (HDFS-16809) EC striped block is not sufficient when doing in maintenance

2022-12-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16809. - Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed > EC striped

[jira] [Updated] (HDFS-16846) EC: Only EC blocks should be effected by max-streams-hard-limit configuration

2022-11-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16846: Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-16613) EC: Improve performance of decommissioning dn with many ec blocks

2022-11-16 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635068#comment-17635068 ] Takanobu Asanuma commented on HDFS-16613: - Thanks for your reply and the suggestion,

  1   2   3   4   5   6   7   8   9   10   >