[MediaWiki-commits] [Gerrit] Grant more heap for maps of legacy_tsvs computation - change (analytics/refinery)

2015-02-02 Thread Ottomata (Code Review) 
Ottomata has submitted this change and it was merged.

Change subject: Grant more heap for maps of legacy_tsvs computation
..


Grant more heap for maps of legacy_tsvs computation

With the cluster-wide defaults the computation of the 5xx and
glam_nara tsvs runs out of heap space. Hence, we double the available
heap for legacy_tsvs, which allows to compute the tsvs and provides
enough reserves for the volume of production data to grow.

Change-Id: If39109798529950a2179b68c0375fa25691844da
---
M oozie/webrequest/legacy_tsvs/workflow.xml
1 file changed, 9 insertions(+), 0 deletions(-)

Approvals:
  Ottomata: Verified; Looks good to me, approved



diff --git a/oozie/webrequest/legacy_tsvs/workflow.xml 
b/oozie/webrequest/legacy_tsvs/workflow.xml
index 2d463c0..b74e957 100644
--- a/oozie/webrequest/legacy_tsvs/workflow.xml
+++ b/oozie/webrequest/legacy_tsvs/workflow.xml
@@ -73,6 +73,15 @@
 namemapreduce.job.queuename/name
 value${queue_name}/value
 /property
+property
+!--
+Doubling available heap for maps from cluster-wide default
+of 592MB to 1184MB, as otherwise the 5xx and glam_nara tsvs
+run out of heap space.
+--
+namemapreduce.map.java.opts/name
+value-Xmx1184m/value
+/property
 /configuration
 
 scriptgenerate_${aspect_name}_tsv.hql/script

-- 
To view, visit https://gerrit.wikimedia.org/r/188009
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings

Gerrit-MessageType: merged
Gerrit-Change-Id: If39109798529950a2179b68c0375fa25691844da
Gerrit-PatchSet: 2
Gerrit-Project: analytics/refinery
Gerrit-Branch: master
Gerrit-Owner: QChris christ...@quelltextlich.at
Gerrit-Reviewer: Ottomata o...@wikimedia.org

___
MediaWiki-commits mailing list
MediaWiki-commits@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits

[MediaWiki-commits] [Gerrit] Grant more heap for maps of legacy_tsvs computation - change (analytics/refinery)

2015-02-01 Thread QChris (Code Review) 
Hello Ottomata,

I'd like you to do a code review.  Please visit

https://gerrit.wikimedia.org/r/188009

to review the following change.

Change subject: Grant more heap for maps of legacy_tsvs computation
..

Grant more heap for maps of legacy_tsvs computation

With the cluster-wide defaults the computation of the 5xx and
glam_nara tsvs runs out of heap space. Hence, we double the available
heap for legacy_tsvs, which allows to compute the tsvs and provides
enough reserves for the volume of production data to grow.

Change-Id: If39109798529950a2179b68c0375fa25691844da
---
M oozie/webrequest/legacy_tsvs/workflow.xml
1 file changed, 9 insertions(+), 0 deletions(-)


  git pull ssh://gerrit.wikimedia.org:29418/analytics/refinery 
refs/changes/09/188009/1

diff --git a/oozie/webrequest/legacy_tsvs/workflow.xml 
b/oozie/webrequest/legacy_tsvs/workflow.xml
index 2d463c0..b74e957 100644
--- a/oozie/webrequest/legacy_tsvs/workflow.xml
+++ b/oozie/webrequest/legacy_tsvs/workflow.xml
@@ -73,6 +73,15 @@
 namemapreduce.job.queuename/name
 value${queue_name}/value
 /property
+property
+!--
+Doubling available heap for maps from cluster-wide default
+of 592MB to 1184MB, as otherwise the 5xx and glam_nara tsvs
+run out of heap space.
+--
+namemapreduce.map.java.opts/name
+value-Xmx1184m/value
+/property
 /configuration
 
 scriptgenerate_${aspect_name}_tsv.hql/script

-- 
To view, visit https://gerrit.wikimedia.org/r/188009
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings

Gerrit-MessageType: newchange
Gerrit-Change-Id: If39109798529950a2179b68c0375fa25691844da
Gerrit-PatchSet: 1
Gerrit-Project: analytics/refinery
Gerrit-Branch: master
Gerrit-Owner: QChris christ...@quelltextlich.at
Gerrit-Reviewer: Ottomata o...@wikimedia.org

___
MediaWiki-commits mailing list
MediaWiki-commits@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits