Hello Ottomata,
I'd like you to do a code review. Please visit
https://gerrit.wikimedia.org/r/187293
to review the following change.
Change subject: Set a proper timeout for refining jobs
......................................................................
Set a proper timeout for refining jobs
The cluster currently has a default timeout of 2 hours. This timeout
gets in the way when backfilling, hence we bump it.
Change-Id: I33990904197058e2bec0978feb7257930970edbb
---
M oozie/webrequest/refine/coordinator.xml
1 file changed, 6 insertions(+), 0 deletions(-)
git pull ssh://gerrit.wikimedia.org:29418/analytics/refinery
refs/changes/93/187293/1
diff --git a/oozie/webrequest/refine/coordinator.xml
b/oozie/webrequest/refine/coordinator.xml
index 9489689..9b0c6eb 100644
--- a/oozie/webrequest/refine/coordinator.xml
+++ b/oozie/webrequest/refine/coordinator.xml
@@ -35,6 +35,12 @@
<controls>
<!--
+ By having materialized jobs not timeout, we ease backfilling incidents
+ after recoverable hiccups on the dataset producers.
+ -->
+ <timeout>-1</timeout>
+
+ <!--
Refining is not too cheap, so we limit
concurrency.
--
To view, visit https://gerrit.wikimedia.org/r/187293
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: I33990904197058e2bec0978feb7257930970edbb
Gerrit-PatchSet: 1
Gerrit-Project: analytics/refinery
Gerrit-Branch: master
Gerrit-Owner: QChris <[email protected]>
Gerrit-Reviewer: Ottomata <[email protected]>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
