adoroszlai opened a new pull request, #4645:
URL: https://github.com/apache/ozone/pull/4645
## What changes were proposed in this pull request?
When a datanode switches to a decommissioning state, it will adjust the size
of the replication supervisor thread pool higher, and if the node returns to
the In Service state, it will return to the lower thread pool limit.
Similarly when scheduling commands, SCM can allocate more commands to the
decommissioning host, as it should process them more quickly due to the lower
load and increased threadpool.
* Scale the size of executor thread pool and command queue for replication
in datanode if state changes between in-service and out-of-service
* Similarly scale the limit of pending replication commands at SCM
* Simplify `TestReplicationSupervisor#testMaxQueueSize` to avoid the use of
thread pool (possible source of intermittent failures recently
[1](https://github.com/apache/ozone/actions/runs/4866567976/jobs/8678244002#step:6:1219),
[2](https://github.com/apache/ozone/actions/runs/4869395310/jobs/8683855578#step:6:1219),
[3](https://github.com/apache/ozone/actions/runs/4870358276/jobs/8686015439#step:6:1219))
https://issues.apache.org/jira/browse/HDDS-8494
## How was this patch tested?
Added unit test.
Tested in `ozone` compose environment with 6 nodes: created RATIS and EC
keys, decommissioned and recommissioned one of the datanodes.
````
2023-05-02 16:37:20,303 [Command processor thread] INFO
replication.ReplicationSupervisor: Node state updated to DECOMMISSIONING,
scaling executor pool size to 20
...
2023-05-02 16:39:16,353 [Command processor thread] INFO
replication.ReplicationSupervisor: Node state updated to IN_SERVICE, scaling
executor pool size to 10
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
