Mark Gui created HDDS-5413:
------------------------------
Summary: Limit num of containers to process per round for
ReplicationManager.
Key: HDDS-5413
URL: https://issues.apache.org/jira/browse/HDDS-5413
Project: Apache Ozone
Issue Type: Improvement
Reporter: Mark Gui
Assignee: Mark Gui
For now, ReplicationManager process all containers at once, this will
potentially bring healthy load to datanodes if there are a lot of containers to
be replicated/deleted/closed.
So it is nice to have a bound for each round, HDFS has similar settings, and
this issue tries to implement sth like
'dfs.block.misreplication.processing.limit: 10000' in HDFS.
HDFS has 128MB block by default while Ozone has 5GB container by default, so
128MB * 10000 / (5 * 1024) = 250 should be reasonable.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
