[
https://issues.apache.org/jira/browse/HDFS-10593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15362863#comment-15362863
]
Andrew Wang commented on HDFS-10593:
------------------------------------
I recall we introduced this limit because it broke fsimage PB serde. The
configs you mention refer to ipc; did we make fsimage serde similarly
configurable?
> MAX_DIR_ITEMS should not be hard coded since RPC buff size is configurable
> ---------------------------------------------------------------------------
>
> Key: HDFS-10593
> URL: https://issues.apache.org/jira/browse/HDFS-10593
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Yuanbo Liu
>
> In HDFS, "dfs.namenode.fs-limits.max-directory-items" was introduced in
> HDFS-6102 to restrict max items of single directory, and the value of it can
> not be larger than the value of MAX_DIR_ITEMS. Since
> "ipc.maximum.data.length" was added in HADOOP-9676 and documented in
> HADOOP-13039 to make maximum RPC buffer size configurable, it's not proper to
> hard code the value of MAX_DIR_ITEMS in {{FSDirectory}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
