Elukey has uploaded a new change for review. https://gerrit.wikimedia.org/r/297758
Change subject: Revert "Revert "Raise the Hadoop HDFS datanode heapsize to 2GB."" ...................................................................... Revert "Revert "Raise the Hadoop HDFS datanode heapsize to 2GB."" Restore the original commit because we ruled it out from the weird heap size decrease observed for the Hadoop namenodes. It turned out that we were deleting tons of files from HDFS at the same time. This reverts commit 13ad76089a73671243b88c281cde04b639712c4b. Change-Id: I3b1b35c795a479117da6c2350c1ffcd8784a7f19 --- M hieradata/eqiad/cdh/hadoop.yaml 1 file changed, 4 insertions(+), 0 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/58/297758/1 diff --git a/hieradata/eqiad/cdh/hadoop.yaml b/hieradata/eqiad/cdh/hadoop.yaml index d3d7ed7..8d0340c 100644 --- a/hieradata/eqiad/cdh/hadoop.yaml +++ b/hieradata/eqiad/cdh/hadoop.yaml @@ -65,6 +65,10 @@ # The default is 1000m, we increase it to 2048m in production. yarn_heapsize: 2048 +# Heap size for HDFS datanode. +# The default is 1000m, we increase it to 2048m in production. +hadoop_heapsize: 2048 + # Yarn ApplicationMaster container size and max heap size (-Xmx) yarn_app_mapreduce_am_resource_mb: 4096 # 2 * 2G yarn_app_mapreduce_am_command_opts: -Xmx3276m # 0.8 * 2 * 2G -- To view, visit https://gerrit.wikimedia.org/r/297758 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I3b1b35c795a479117da6c2350c1ffcd8784a7f19 Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Elukey <[email protected]> _______________________________________________ MediaWiki-commits mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
