Elukey has submitted this change and it was merged. ( https://gerrit.wikimedia.org/r/380957 )
Change subject: Raise HDFS's namenode maximum jvm heap size to 6G ...................................................................... Raise HDFS's namenode maximum jvm heap size to 6G This is needed due to the unprecedented amount of files currently stored in HDFS. The namenode daemon keeps all metadata about inodes and data blocks in memory. On the analytics100[12] nodes there is plenty of memory completely free (not even used for Caching). Change-Id: If71857270792ab8a7ee781eca9c126c96014c540 --- M hieradata/eqiad/cdh/hadoop.yaml 1 file changed, 3 insertions(+), 3 deletions(-) Approvals: Elukey: Looks good to me, approved jenkins-bot: Verified diff --git a/hieradata/eqiad/cdh/hadoop.yaml b/hieradata/eqiad/cdh/hadoop.yaml index f7b29a8..79acfd3 100644 --- a/hieradata/eqiad/cdh/hadoop.yaml +++ b/hieradata/eqiad/cdh/hadoop.yaml @@ -34,10 +34,10 @@ # Increase NameNode heapsize independent from other daemons. # Note that cdh::hadoop::hadoop_namenode_heapsize is NOT a cdh class parameter. # It exists so that we can configure icinga alerts properly, -# without having to parse the -Xmx4096m value. These +# without having to parse the -Xmx value. These # two should be set to the same megabyte value. -cdh::hadoop::namenode_heapsize: 4096 -cdh::hadoop::hadoop_namenode_opts: "-Xms4096m -Xmx4096m" +cdh::hadoop::namenode_heapsize: 6144 +cdh::hadoop::hadoop_namenode_opts: "-Xms6144m -Xmx6144m" cdh::hadoop::mapreduce_reduce_shuffle_parallelcopies: 10 cdh::hadoop::mapreduce_task_io_sort_mb: 200 -- To view, visit https://gerrit.wikimedia.org/r/380957 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: If71857270792ab8a7ee781eca9c126c96014c540 Gerrit-PatchSet: 2 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Elukey <[email protected]> Gerrit-Reviewer: Elukey <[email protected]> Gerrit-Reviewer: jenkins-bot <> _______________________________________________ MediaWiki-commits mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
