[
https://issues.apache.org/jira/browse/HDFS-13734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16543508#comment-16543508
]
Allen Wittenauer edited comment on HDFS-13734 at 7/13/18 5:49 PM:
------------------------------------------------------------------
bq. While still possible through adding the -Xmx to HDFS_DAEMON_OPTS, this is
not intuitive for this relatively common setting.
While I can appreciate the feeling, it leads to users configuring a lot more
environment variables than they need since _OPTS is almost always configured as
well. (Especially with zero hints in the *-env.sh files that this is mostly
unnecessary syntactic sugar.) In addition, it adds Yet More Shell Code and
increases the support burden. There is also the slippery slope problem: if
there is a dedicate var for heap should there be a dedicate var for other java
params as well? What is the barrier?
It was always my intent to deprecate the equivalent MR and YARN variables for
the exact same reasons but I just never got around to it.
was (Author: aw):
> While still possible through adding the -Xmx to HDFS_DAEMON_OPTS, this is not
> intuitive for this relatively common setting.
While I can appreciate the feeling, it leads to users configuring a lot more
environment variables than they need since _OPTS is almost always configured as
well. (Especially with zero hints in the *-env.sh files that this is mostly
unnecessary syntactic sugar.) In addition, it adds Yet More Shell Code and
increases the support burden. There is also the slippery slope problem: if
there is a dedicate var for heap should there be a dedicate var for other java
params as well? What is the barrier?
It was always my intent to deprecate the equivalent MR and YARN variables for
the exact same reasons but I just never got around to it.
> Add Heapsize variables for HDFS daemons
> ---------------------------------------
>
> Key: HDFS-13734
> URL: https://issues.apache.org/jira/browse/HDFS-13734
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: datanode, journal-node, namenode
> Affects Versions: 3.0.3
> Reporter: Brandon Scheller
> Priority: Major
>
> Currently there are no variables to set HDFS daemon heapsize differently.
> While still possible through adding the -Xmx to HDFS_*DAEMON*_OPTS, this is
> not intuitive for this relatively common setting.
> YARN currently has these separate YARN_*DAEMON*_HEAPSIZE variables supported
> so it seems natural for HDFS too.
> It also looks like HDFS use to have this for namenode with
> HADOOP_NAMENODE_INIT_HEAPSIZE
> This JIRA is to have these configurations added/supported
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
