[jira] [Assigned] (HDFS-17527) RBF: Routers should not allow observer reads when namenode stateId context is disabled

2024-05-14 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira reassigned HDFS-17527: - Assignee: Jian Zhang (was: Simbarashe Dzinamarira) > RBF: Routers

[jira] [Assigned] (HDFS-17527) RBF: Routers should not allow observer reads when namenode stateId context is disabled

2024-05-14 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira reassigned HDFS-17527: - Assignee: Simbarashe Dzinamarira > RBF: Routers should not allow

[jira] [Commented] (HDFS-17527) RBF: Routers should not allow observer reads when namenode stateId context is disabled

2024-05-14 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846381#comment-17846381 ] Simbarashe Dzinamarira commented on HDFS-17527: --- Great, I'll assign it to you. Thanks for

[jira] [Updated] (HDFS-17527) RBF: Routers should not allow observer reads when namenode stateId context is disabled

2024-05-14 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-17527: -- Description: HDFS-17514 addressed the case when state ID context is first

[jira] [Updated] (HDFS-17527) RBF: Routers should not allow observer reads when namenode stateId context is disabled

2024-05-14 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-17527: -- Description: HDFS-17514 addressed the case when state ID context is first

[jira] [Assigned] (HDFS-17527) RBF: Routers should not allow observer reads when namenode stateId context is disabled

2024-05-14 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira reassigned HDFS-17527: - Assignee: (was: Simbarashe Dzinamarira) > RBF: Routers should not

[jira] [Updated] (HDFS-17527) RBF: Routers should not allow observer reads when namenode stateId context is disabled

2024-05-14 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-17527: -- Description: HDFS-17514 address the case when state ID context is first

[jira] [Assigned] (HDFS-17527) RBF: Routers should not allow observer reads when namenode stateId context is disabled

2024-05-14 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira reassigned HDFS-17527: - Assignee: Simbarashe Dzinamarira > RBF: Routers should not allow

[jira] [Created] (HDFS-17527) RBF: Routers should not allow observer reads when namenode stateId context is disabled

2024-05-14 Thread Simbarashe Dzinamarira (Jira)
Simbarashe Dzinamarira created HDFS-17527: - Summary: RBF: Routers should not allow observer reads when namenode stateId context is disabled Key: HDFS-17527 URL:

[jira] [Resolved] (HDFS-17514) RBF: Routers keep using cached stateID even when active NN returns unset header

2024-05-14 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira resolved HDFS-17514. --- Resolution: Fixed > RBF: Routers keep using cached stateID even when active

[jira] [Updated] (HDFS-17514) RBF: Routers keep using cached stateID even when active NN returns unset header

2024-05-08 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-17514: -- Description: When a namenode that had "dfs.namenode.state.context.enabled" set

[jira] [Created] (HDFS-17514) RBF: Routers keep using cached stateID even when active NN returns unset header

2024-05-08 Thread Simbarashe Dzinamarira (Jira)
Simbarashe Dzinamarira created HDFS-17514: - Summary: RBF: Routers keep using cached stateID even when active NN returns unset header Key: HDFS-17514 URL: https://issues.apache.org/jira/browse/HDFS-17514

[jira] [Updated] (HDFS-17214) The Quota class's andByStorageType method res has an incorrect initial value

2023-10-02 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-17214: -- Summary: The Quota class's andByStorageType method res has an incorrect

[jira] [Updated] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2023-09-12 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-13522: -- Attachment: observer_reads_in_rbf_proposal_simbadzina_v2.pdf > HDFS-13522: Add

[jira] [Updated] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2023-09-12 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-13522: -- Attachment: (was: observer_reads_in_rbf_proposal_simbadzina_v2.pdf) >

[jira] [Updated] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2023-09-12 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-13522: -- Attachment: (was: observer_reads_in_rbf_proposal_simbadzina_v2.1.pdf) >

[jira] [Updated] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2023-09-12 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-13522: -- Attachment: (was: observer_reads_in_rbf_proposal_simbadzina_v2-1.pdf) >

[jira] [Updated] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2023-09-12 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-13522: -- Attachment: observer_reads_in_rbf_proposal_simbadzina_v2.1.pdf > HDFS-13522:

[jira] [Updated] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2023-09-12 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-13522: -- Attachment: observer_reads_in_rbf_proposal_simbadzina_v2-1.pdf > HDFS-13522:

[jira] [Updated] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2023-09-12 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-13522: -- Attachment: rbf_observer_reads - read_own_writes.pdf

[jira] [Comment Edited] (HDFS-17124) RBF: RouterObserverReadProxyProvider should respect observer read opt-out via dfs.client.rbf.observer.enable flag.

2023-08-01 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17747202#comment-17747202 ] Simbarashe Dzinamarira edited comment on HDFS-17124 at 8/1/23 5:46 PM:

[jira] [Commented] (HDFS-17124) RBF: RouterObserverReadProxyProvider should respect observer read opt-out via dfs.client.rbf.observer.enable flag.

2023-07-25 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17747202#comment-17747202 ] Simbarashe Dzinamarira commented on HDFS-17124: --- "dfs.client.rbf.observer.enable" was a

[jira] [Commented] (HDFS-17124) RBF: RouterObserverReadProxyProvider should respect observer read opt-out via dfs.client.rbf.observer.enable flag.

2023-07-25 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17747200#comment-17747200 ] Simbarashe Dzinamarira commented on HDFS-17124: --- Setting

[jira] [Updated] (HDFS-17124) RBF: RouterObserverReadProxyProvider should respect observer read opt-out via dfs.client.rbf.observer.enable flag.

2023-07-25 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-17124: -- Summary: RBF: RouterObserverReadProxyProvider should respect observer read

[jira] [Updated] (HDFS-17124) RBF: RouterObserverReadProxyProvider should respect observer read opt-out via dfs.client.rbf.observer.enable=false flag.

2023-07-25 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-17124: -- Description: The "dfs.client.rbf.observer.enable" flag was add to allow a

[jira] [Updated] (HDFS-17124) RBF: RouterObserverReadProxyProvider should respect observer read opt-out via dfs.client.rbf.observer.enable=false flag.

2023-07-25 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-17124: -- Summary: RBF: RouterObserverReadProxyProvider should respect observer read

[jira] [Updated] (HDFS-17124) RBF: RouterObserverReadProxyProvider should respect observer read opt-out via dfs.client.rbf.observer.enabled=false flag.

2023-07-25 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-17124: -- Summary: RBF: RouterObserverReadProxyProvider should respect observer read

[jira] [Moved] (HDFS-17124) RouterObserverReadProxyProvider should respect observer read opt-out via dfs.client.rbf.observer.enabled=false flag.

2023-07-25 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira moved HADOOP-18827 to HDFS-17124: Key: HDFS-17124 (was: HADOOP-18827)

[jira] [Updated] (HDFS-17111) RBF: Optimize msync to only call nameservices that have observer reads enabled.

2023-07-19 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-17111: -- Summary: RBF: Optimize msync to only call nameservices that have observer

[jira] [Assigned] (HDFS-17111) RBF: Optimize msync to only call nameservices with observer namenodes.

2023-07-19 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira reassigned HDFS-17111: - Assignee: Simbarashe Dzinamarira > RBF: Optimize msync to only call

[jira] [Created] (HDFS-17111) RBF: Optimize msync to only call nameservices with observer namenodes.

2023-07-19 Thread Simbarashe Dzinamarira (Jira)
Simbarashe Dzinamarira created HDFS-17111: - Summary: RBF: Optimize msync to only call nameservices with observer namenodes. Key: HDFS-17111 URL: https://issues.apache.org/jira/browse/HDFS-17111

[jira] [Assigned] (HDFS-17027) RBF: Add supports for observer.auto-msync-period when using routers

2023-05-26 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira reassigned HDFS-17027: - Assignee: Simbarashe Dzinamarira > RBF: Add supports for

[jira] [Created] (HDFS-17027) RBF: Add supports for observer.auto-msync-period when using routers

2023-05-26 Thread Simbarashe Dzinamarira (Jira)
Simbarashe Dzinamarira created HDFS-17027: - Summary: RBF: Add supports for observer.auto-msync-period when using routers Key: HDFS-17027 URL: https://issues.apache.org/jira/browse/HDFS-17027

[jira] [Updated] (HDFS-17025) RBF: Support port based selective encryption on routers.

2023-05-25 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-17025: -- Summary: RBF: Support port based selective encryption on routers. (was: RBF:

[jira] [Updated] (HDFS-17025) RBF: Support port based selective encryption from routers.

2023-05-24 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-17025: -- Description: HDFS-13541 implemented based selective encryption in the

[jira] [Updated] (HDFS-17025) RBF: Support port based selective encryption from routers.

2023-05-24 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-17025: -- Description: HDFS-13541 implemented based selective encryption in the

[jira] [Created] (HDFS-17025) RBF: Support port based selective encryption from routers.

2023-05-24 Thread Simbarashe Dzinamarira (Jira)
Simbarashe Dzinamarira created HDFS-17025: - Summary: RBF: Support port based selective encryption from routers. Key: HDFS-17025 URL: https://issues.apache.org/jira/browse/HDFS-17025 Project:

[jira] [Resolved] (HDFS-16943) RBF: Implement MySQL based StateStoreDriver

2023-04-05 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira resolved HDFS-16943. --- Hadoop Flags: Reviewed Resolution: Fixed > RBF: Implement MySQL based

[jira] [Updated] (HDFS-16943) RBF: Implement MySQL based StateStoreDriver

2023-04-05 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16943: -- Fix Version/s: 3.4.0 > RBF: Implement MySQL based StateStoreDriver >

[jira] [Commented] (HDFS-16943) RBF: Implement MySQL based StateStoreDriver

2023-03-31 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707377#comment-17707377 ] Simbarashe Dzinamarira commented on HDFS-16943: --- HDFS-13245 got closed with the comment

[jira] [Commented] (HDFS-16943) RBF: Implement MySQL based StateStoreDriver

2023-03-09 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698579#comment-17698579 ] Simbarashe Dzinamarira commented on HDFS-16943: --- Thanks for the pointer [~elgoiri] , I

[jira] [Assigned] (HDFS-16943) RBF: Implement MySQL based StateStoreDriver

2023-03-07 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira reassigned HDFS-16943: - Assignee: Simbarashe Dzinamarira > RBF: Implement MySQL based

[jira] [Updated] (HDFS-16943) RBF: Implement MySQL based StateStoreDriver

2023-03-07 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16943: -- Description: RBF supports two types of StateStoreDrivers # StateStoreFileImpl

[jira] [Created] (HDFS-16943) RBF: Implement MySQL based StateStoreDriver

2023-03-07 Thread Simbarashe Dzinamarira (Jira)
Simbarashe Dzinamarira created HDFS-16943: - Summary: RBF: Implement MySQL based StateStoreDriver Key: HDFS-16943 URL: https://issues.apache.org/jira/browse/HDFS-16943 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-16901) RBF: Routers should propagate the real user in the UGI via the caller context

2023-02-23 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692815#comment-17692815 ] Simbarashe Dzinamarira edited comment on HDFS-16901 at 2/23/23 5:56 PM:

[jira] [Comment Edited] (HDFS-16901) RBF: Routers should propagate the real user in the UGI via the caller context

2023-02-23 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692815#comment-17692815 ] Simbarashe Dzinamarira edited comment on HDFS-16901 at 2/23/23 5:56 PM:

[jira] [Commented] (HDFS-16901) RBF: Routers should propagate the real user in the UGI via the caller context

2023-02-23 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692815#comment-17692815 ] Simbarashe Dzinamarira commented on HDFS-16901: --- I believe this is because HDFS-16756

[jira] [Commented] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2023-02-22 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692377#comment-17692377 ] Simbarashe Dzinamarira commented on HDFS-13522: --- Hi [~tasanuma]  I agree porting back

[jira] [Commented] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2023-02-20 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691345#comment-17691345 ] Simbarashe Dzinamarira commented on HDFS-13522: --- On the client side you need to set

[jira] [Created] (HDFS-16901) RBF: Routers should propagate the real user in the UGI via the caller context

2023-01-31 Thread Simbarashe Dzinamarira (Jira)
Simbarashe Dzinamarira created HDFS-16901: - Summary: RBF: Routers should propagate the real user in the UGI via the caller context Key: HDFS-16901 URL: https://issues.apache.org/jira/browse/HDFS-16901

[jira] [Assigned] (HDFS-16901) RBF: Routers should propagate the real user in the UGI via the caller context

2023-01-31 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira reassigned HDFS-16901: - Assignee: Simbarashe Dzinamarira > RBF: Routers should propagate the

[jira] [Commented] (HDFS-16015) RBF: Read and write data through router select dn according to real user ip

2023-01-31 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17682778#comment-17682778 ] Simbarashe Dzinamarira commented on HDFS-16015: --- I believe this is now implement in

[jira] [Comment Edited] (HDFS-16015) RBF: Read and write data through router select dn according to real user ip

2023-01-31 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17682778#comment-17682778 ] Simbarashe Dzinamarira edited comment on HDFS-16015 at 1/31/23 10:35 PM:

[jira] [Commented] (HDFS-16889) Backport JIRAs related to RBF SBN to branch-3.3

2023-01-24 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17680416#comment-17680416 ] Simbarashe Dzinamarira commented on HDFS-16889: --- I see. Will the next 3.X version branch

[jira] [Comment Edited] (HDFS-16889) Backport JIRAs related to RBF SBN to branch-3.3

2023-01-18 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678405#comment-17678405 ] Simbarashe Dzinamarira edited comment on HDFS-16889 at 1/18/23 10:09 PM:

[jira] [Commented] (HDFS-16889) Backport JIRAs related to RBF SBN to branch-3.3

2023-01-18 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17678405#comment-17678405 ] Simbarashe Dzinamarira commented on HDFS-16889: --- That for creating this ticket [~tasanuma]

[jira] [Created] (HDFS-16890) Add period state refresh to keep router state near active namenode's

2023-01-12 Thread Simbarashe Dzinamarira (Jira)
Simbarashe Dzinamarira created HDFS-16890: - Summary: Add period state refresh to keep router state near active namenode's Key: HDFS-16890 URL: https://issues.apache.org/jira/browse/HDFS-16890

[jira] [Assigned] (HDFS-16890) Add period state refresh to keep router state near active namenode's

2023-01-12 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira reassigned HDFS-16890: - Assignee: Simbarashe Dzinamarira > Add period state refresh to keep

[jira] [Created] (HDFS-16886) Fix documentation for StateStoreRecordOperations#get(Class ..., Query ...)

2023-01-10 Thread Simbarashe Dzinamarira (Jira)
Simbarashe Dzinamarira created HDFS-16886: - Summary: Fix documentation for StateStoreRecordOperations#get(Class ..., Query ...) Key: HDFS-16886 URL: https://issues.apache.org/jira/browse/HDFS-16886

[jira] [Assigned] (HDFS-16886) Fix documentation for StateStoreRecordOperations#get(Class ..., Query ...)

2023-01-10 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira reassigned HDFS-16886: - Assignee: Simbarashe Dzinamarira > Fix documentation for

[jira] [Updated] (HDFS-16876) Garbage collect map entries in shared RouterStateIdContext using information from namenodeResolver instead of the map of active connectionPools.

2023-01-09 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16876: -- Description: An element in RouterStateIdContext#namespaceIdMap is deleted when

[jira] [Updated] (HDFS-16876) Garbage collect map entries in shared RouterStateIdContext using information from namenodeResolver instead of the map of active connectionPools.

2023-01-09 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16876: -- Description: An element in RouterStateIdContext#namespaceIdMap is deleted when

[jira] [Updated] (HDFS-16876) Garbage collect map entries in shared RouterStateIdContext using information from namenodeResolver instead of the map of active connectionPools.

2023-01-09 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16876: -- Description: An element in RouterStateIdContext#namespaceIdMap is deleted when

[jira] [Updated] (HDFS-16876) Garbage collect map entries in shared RouterStateIdContext using information from namenodeResolver instead of the map of active connectionPools.

2023-01-09 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16876: -- Description: An element in RouterStateIdContext#namespaceIdMap is deleted when

[jira] [Updated] (HDFS-16876) Garbage collect map entries in shared RouterStateIdContext using information from namenodeResolver instead of the map of active connectionPools.

2023-01-06 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16876: -- Summary: Garbage collect map entries in shared RouterStateIdContext using

[jira] [Updated] (HDFS-16876) ConnectionManager should not remove namespaceStateIds from the shared RouterStateIdContext during pool cleanup.

2023-01-06 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16876: -- Description: When cleaning up stale connection pools, the ConnectionManager

[jira] [Commented] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2023-01-06 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655503#comment-17655503 ] Simbarashe Dzinamarira commented on HDFS-13522: --- No objection from me. Thanks for looking

[jira] [Comment Edited] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2023-01-05 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655115#comment-17655115 ] Simbarashe Dzinamarira edited comment on HDFS-13522 at 1/5/23 7:55 PM:

[jira] [Commented] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2023-01-05 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655115#comment-17655115 ] Simbarashe Dzinamarira commented on HDFS-13522: --- Thanks [~tasanuma] for adjusting the fix

[jira] [Comment Edited] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2023-01-04 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17654691#comment-17654691 ] Simbarashe Dzinamarira edited comment on HDFS-13522 at 1/5/23 1:18 AM:

[jira] [Commented] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2023-01-04 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17654691#comment-17654691 ] Simbarashe Dzinamarira commented on HDFS-13522: --- Hi [~tasanuma]. We haven't backported

[jira] [Created] (HDFS-16877) Namenode doesn't use alignment context in TestObserverWithRouter

2022-12-23 Thread Simbarashe Dzinamarira (Jira)
Simbarashe Dzinamarira created HDFS-16877: - Summary: Namenode doesn't use alignment context in TestObserverWithRouter Key: HDFS-16877 URL: https://issues.apache.org/jira/browse/HDFS-16877

[jira] [Updated] (HDFS-16876) ConnectionManager should not remove namespaceStateIds from the shared RouterStateIdContext during pool cleanup.

2022-12-21 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16876: -- Summary: ConnectionManager should not remove namespaceStateIds from the shared

[jira] [Updated] (HDFS-16876) ConnectionManager should not remove namespaceStateIds from the shared RouterStateIdContext during pool cleanup.

2022-12-21 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16876: -- Description: When cleaning up stale connection pools, the ConnectionManager

[jira] [Created] (HDFS-16876) Connection manager should not remove namespaceStateId from shared RouterStateIdContext during pool cleanup.

2022-12-21 Thread Simbarashe Dzinamarira (Jira)
Simbarashe Dzinamarira created HDFS-16876: - Summary: Connection manager should not remove namespaceStateId from shared RouterStateIdContext during pool cleanup. Key: HDFS-16876 URL:

[jira] [Assigned] (HDFS-16876) Connection manager should not remove namespaceStateId from shared RouterStateIdContext during pool cleanup.

2022-12-21 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira reassigned HDFS-16876: - Assignee: Simbarashe Dzinamarira > Connection manager should not remove

[jira] [Comment Edited] (HDFS-16830) Improve router msync operation

2022-11-17 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635661#comment-17635661 ] Simbarashe Dzinamarira edited comment on HDFS-16830 at 11/18/22 7:46 AM:

[jira] [Commented] (HDFS-16830) Improve router msync operation

2022-11-17 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635661#comment-17635661 ] Simbarashe Dzinamarira commented on HDFS-16830: --- Sorry I missed you first comment on the

[jira] [Created] (HDFS-16847) StateStore writer should not commit tmp fail if there was an error in writing the file.

2022-11-17 Thread Simbarashe Dzinamarira (Jira)
Simbarashe Dzinamarira created HDFS-16847: - Summary: StateStore writer should not commit tmp fail if there was an error in writing the file. Key: HDFS-16847 URL:

[jira] [Updated] (HDFS-16847) StateStore writer should not commit tmp fail if there was an error in writing the file.

2022-11-17 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16847: -- Component/s: hdfs rbf > StateStore writer should not commit

[jira] [Assigned] (HDFS-16847) StateStore writer should not commit tmp fail if there was an error in writing the file.

2022-11-17 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira reassigned HDFS-16847: - Assignee: Simbarashe Dzinamarira > StateStore writer should not commit

[jira] [Updated] (HDFS-16845) Add configuration flag to enable observer reads on routers without using ObserverReadProxyProvider

2022-11-17 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16845: -- Priority: Critical (was: Major) > Add configuration flag to enable observer

[jira] [Updated] (HDFS-16845) Add configuration flag to enable observer reads on routers without using ObserverReadProxyProvider

2022-11-16 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16845: -- Description: In order for clients to have routers forward their reads to

[jira] [Updated] (HDFS-16845) Add configuration flag to enable observer reads on routers without using ObserverReadProxyProvider

2022-11-16 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16845: -- Summary: Add configuration flag to enable observer reads on routers without

[jira] [Assigned] (HDFS-16845) Add flag to enable observer reads on routers without using ObserverReadProxyProvider

2022-11-16 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira reassigned HDFS-16845: - Assignee: Simbarashe Dzinamarira > Add flag to enable observer reads on

[jira] [Created] (HDFS-16845) Add flag to enable observer reads on routers without using ObserverReadProxyProvider

2022-11-16 Thread Simbarashe Dzinamarira (Jira)
Simbarashe Dzinamarira created HDFS-16845: - Summary: Add flag to enable observer reads on routers without using ObserverReadProxyProvider Key: HDFS-16845 URL:

[jira] [Assigned] (HDFS-6334) Client failover proxy provider for IP failover based NN HA

2022-11-14 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira reassigned HDFS-6334: Assignee: Simbarashe Dzinamarira (was: Kihwal Lee) > Client failover

[jira] [Commented] (HDFS-16835) Define RouterFederatedStateProto with syntax that is backward compatible with protobuf v2.

2022-11-08 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630625#comment-17630625 ] Simbarashe Dzinamarira commented on HDFS-16835: --- Define RouterFederatedStateProto with

[jira] [Assigned] (HDFS-16835) Define RouterFederatedStateProto with syntax that is backward compatible with protobuf v2.

2022-11-08 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira reassigned HDFS-16835: - Assignee: Simbarashe Dzinamarira > Define RouterFederatedStateProto

[jira] [Created] (HDFS-16835) Define RouterFederatedStateProto with syntax that is backward compatible with protobuf v2.

2022-11-08 Thread Simbarashe Dzinamarira (Jira)
Simbarashe Dzinamarira created HDFS-16835: - Summary: Define RouterFederatedStateProto with syntax that is backward compatible with protobuf v2. Key: HDFS-16835 URL:

[jira] [Updated] (HDFS-16834) PoolAlignmentContext should not max poolLocalStateId with sharedGlobalStateId when sending requests to the namenode.

2022-11-08 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16834: -- Description: When sending requests to the namenode, we should only use the

[jira] [Updated] (HDFS-16834) PoolAlignmentContext should not max poolLocalStateId with sharedGlobalStateId when sending requests to the namenode.

2022-11-08 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16834: -- Summary: PoolAlignmentContext should not max poolLocalStateId with

[jira] [Assigned] (HDFS-16834) PoolAlignmentContext should not max poolStateId with sharedGlobalStateId when sending requests

2022-11-08 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira reassigned HDFS-16834: - Assignee: Simbarashe Dzinamarira > PoolAlignmentContext should not max

[jira] [Created] (HDFS-16834) PoolAlignmentContext should not max poolStateId with sharedGlobalStateId when sending requests

2022-11-08 Thread Simbarashe Dzinamarira (Jira)
Simbarashe Dzinamarira created HDFS-16834: - Summary: PoolAlignmentContext should not max poolStateId with sharedGlobalStateId when sending requests Key: HDFS-16834 URL:

[jira] [Commented] (HDFS-13522) HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.

2022-10-31 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626819#comment-17626819 ] Simbarashe Dzinamarira commented on HDFS-13522: --- Hi [~zhengchenyu]. Thanks. We don't yet

[jira] [Updated] (HDFS-16821) Fix regression in HDFS-13522 that enables observer reads by default.

2022-10-25 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16821: -- Summary: Fix regression in HDFS-13522 that enables observer reads by default.

[jira] [Assigned] (HDFS-16821) HDFS clients must not use ClientGSIContext unless explicit configured to do so.

2022-10-25 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira reassigned HDFS-16821: - Assignee: Simbarashe Dzinamarira > HDFS clients must not use

[jira] [Created] (HDFS-16821) HDFS clients must not use ClientGSIContext unless explicit configured to do so.

2022-10-25 Thread Simbarashe Dzinamarira (Jira)
Simbarashe Dzinamarira created HDFS-16821: - Summary: HDFS clients must not use ClientGSIContext unless explicit configured to do so. Key: HDFS-16821 URL: https://issues.apache.org/jira/browse/HDFS-16821

[jira] [Commented] (HDFS-16767) RBF: Support observer node from Router-Based Federation

2022-09-09 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17602582#comment-17602582 ] Simbarashe Dzinamarira commented on HDFS-16767: --- This PR I'll addition is a modification of

[jira] [Created] (HDFS-16767) RBF: Support observer node from Router-Based Federation

2022-09-09 Thread Simbarashe Dzinamarira (Jira)
Simbarashe Dzinamarira created HDFS-16767: - Summary: RBF: Support observer node from Router-Based Federation Key: HDFS-16767 URL: https://issues.apache.org/jira/browse/HDFS-16767 Project:

  1   2   >