Viraj Jasani created HDFS-16502:
-----------------------------------
Summary: Reconfigure Block Invalidate limit
Key: HDFS-16502
URL: https://issues.apache.org/jira/browse/HDFS-16502
Project: Hadoop HDFS
Issue Type: Task
Reporter: Viraj Jasani
Assignee: Viraj Jasani
Based on the cluster load, it would be helpful to consider tuning block
invalidate limit (dfs.block.invalidate.limit). The only way we can do this
without restarting Namenode as of today is by reconfiguring heartbeat interval
{code:java}
(Math.max(heartbeatInt*20, blockInvalidateLimit)){code}
, this logic is not straightforward and operators are usually not aware of it
(lack of documentation), also updating heartbeat interval is not desired in all
the cases.
We should provide the ability to alter block invalidation limit without
affecting heartbeat interval on the live cluster to adjust some load at
Datanode level.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
