Ottomata has submitted this change and it was merged.
Change subject: Revert 7c3af0d. This caused memory reservation errors in the
mediacounts job
......................................................................
Revert 7c3af0d. This caused memory reservation errors in the mediacounts job
Impala needs to be able to make smaller reservation requests than this.
I will investigate the ability for impala jobs themselves to set this to 0,
rather than setting it globally.
Bug: T97753
Change-Id: Ice76389078ab92e893a4dd504140e678d5bf5226
---
M manifests/role/analytics/hadoop.pp
1 file changed, 1 insertion(+), 2 deletions(-)
Approvals:
Ottomata: Verified; Looks good to me, approved
diff --git a/manifests/role/analytics/hadoop.pp
b/manifests/role/analytics/hadoop.pp
index ba69da3..c80603e 100644
--- a/manifests/role/analytics/hadoop.pp
+++ b/manifests/role/analytics/hadoop.pp
@@ -191,8 +191,7 @@
$yarn_app_mapreduce_am_command_opts =
"-Xmx${mapreduce_am_heap_size}m"
$yarn_nodemanager_resource_memory_mb =
floor($number_of_containers * $memory_per_container_mb)
- # Setting minimum allocation mb to 0 to allow Impala to submit small
reservation requests.
- $yarn_scheduler_minimum_allocation_mb = 0
+ $yarn_scheduler_minimum_allocation_mb =
floor($memory_per_container_mb)
$yarn_scheduler_maximum_allocation_mb =
floor($number_of_containers * $memory_per_container_mb)
# Setting minimum_allocation_vcores to 0 to allow Impala to submit
small reservation requests.
$yarn_scheduler_minimum_allocation_vcores = 0
--
To view, visit https://gerrit.wikimedia.org/r/208646
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: merged
Gerrit-Change-Id: Ice76389078ab92e893a4dd504140e678d5bf5226
Gerrit-PatchSet: 3
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: Ottomata <[email protected]>
Gerrit-Reviewer: Ottomata <[email protected]>
Gerrit-Reviewer: jenkins-bot <>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
