Hello Ottomata,
I'd like you to do a code review. Please visit
https://gerrit.wikimedia.org/r/188009
to review the following change.
Change subject: Grant more heap for maps of legacy_tsvs computation
......................................................................
Grant more heap for maps of legacy_tsvs computation
With the cluster-wide defaults the computation of the 5xx and
glam_nara tsvs runs out of heap space. Hence, we double the available
heap for legacy_tsvs, which allows to compute the tsvs and provides
enough reserves for the volume of production data to grow.
Change-Id: If39109798529950a2179b68c0375fa25691844da
---
M oozie/webrequest/legacy_tsvs/workflow.xml
1 file changed, 9 insertions(+), 0 deletions(-)
git pull ssh://gerrit.wikimedia.org:29418/analytics/refinery
refs/changes/09/188009/1
diff --git a/oozie/webrequest/legacy_tsvs/workflow.xml
b/oozie/webrequest/legacy_tsvs/workflow.xml
index 2d463c0..b74e957 100644
--- a/oozie/webrequest/legacy_tsvs/workflow.xml
+++ b/oozie/webrequest/legacy_tsvs/workflow.xml
@@ -73,6 +73,15 @@
<name>mapreduce.job.queuename</name>
<value>${queue_name}</value>
</property>
+ <property>
+ <!--
+ Doubling available heap for maps from cluster-wide default
+ of 592MB to 1184MB, as otherwise the 5xx and glam_nara tsvs
+ run out of heap space.
+ -->
+ <name>mapreduce.map.java.opts</name>
+ <value>-Xmx1184m</value>
+ </property>
</configuration>
<script>generate_${aspect_name}_tsv.hql</script>
--
To view, visit https://gerrit.wikimedia.org/r/188009
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: If39109798529950a2179b68c0375fa25691844da
Gerrit-PatchSet: 1
Gerrit-Project: analytics/refinery
Gerrit-Branch: master
Gerrit-Owner: QChris <[email protected]>
Gerrit-Reviewer: Ottomata <[email protected]>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
