Ottomata has submitted this change and it was merged. Change subject: Update cdh submodule with yarn_heapsize fix, set yarn_heapsize to 2048m ......................................................................
Update cdh submodule with yarn_heapsize fix, set yarn_heapsize to 2048m Change-Id: Iabbd6b8305612207dfe3978d5f1f38300a0c8e42 --- M hieradata/eqiad/cdh/hadoop.yaml M modules/cdh 2 files changed, 6 insertions(+), 1 deletion(-) Approvals: Ottomata: Looks good to me, approved jenkins-bot: Verified diff --git a/hieradata/eqiad/cdh/hadoop.yaml b/hieradata/eqiad/cdh/hadoop.yaml index 1b25030..d3d7ed7 100644 --- a/hieradata/eqiad/cdh/hadoop.yaml +++ b/hieradata/eqiad/cdh/hadoop.yaml @@ -60,8 +60,13 @@ mapreduce_reduce_memory_mb: 4096 # 2 * 2G mapreduce_reduce_java_opts: -Xmx3276m # 0.8 * 2 * 2G +# This is the heap zize of YARN daemons ResourceManager and NodeManagers. +# This setting is used to configure the max heap size for both. +# The default is 1000m, we increase it to 2048m in production. +yarn_heapsize: 2048 + # Yarn ApplicationMaster container size and max heap size (-Xmx) -yarn_app_mapreduce_am_resource_mb: 4096 # 2 * 2G +yarn_app_mapreduce_am_resource_mb: 4096 # 2 * 2G yarn_app_mapreduce_am_command_opts: -Xmx3276m # 0.8 * 2 * 2G # Save 8G for OS and other processes. diff --git a/modules/cdh b/modules/cdh index ac900d9..8aaf2e4 160000 --- a/modules/cdh +++ b/modules/cdh -Subproject commit ac900d9dfea382f491a5a044d48a53a0fe6a7eeb +Subproject commit 8aaf2e4079440cf4cd0ae49ff54eba42a45281d7 -- To view, visit https://gerrit.wikimedia.org/r/283186 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: Iabbd6b8305612207dfe3978d5f1f38300a0c8e42 Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Ottomata <[email protected]> Gerrit-Reviewer: Elukey <[email protected]> Gerrit-Reviewer: Ottomata <[email protected]> Gerrit-Reviewer: jenkins-bot <> _______________________________________________ MediaWiki-commits mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
