EBernhardson has uploaded a new change for review.
https://gerrit.wikimedia.org/r/275749
Change subject: Build cirrus completion indices daily
......................................................................
Build cirrus completion indices daily
We have made some optimizations to the index building process,
bringing runtime down from over 12 hours to under 5 hours. This
should be low enough we can afford to rebuild these indices on
a daily basis.
Change-Id: I5d3ed3aada0fe05ce36e11d65c27b36c19076bbd
---
M modules/mediawiki/manifests/maintenance/cirrussearch.pp
1 file changed, 7 insertions(+), 9 deletions(-)
git pull ssh://gerrit.wikimedia.org:29418/operations/puppet
refs/changes/49/275749/1
diff --git a/modules/mediawiki/manifests/maintenance/cirrussearch.pp
b/modules/mediawiki/manifests/maintenance/cirrussearch.pp
index 0e88308..485e184 100644
--- a/modules/mediawiki/manifests/maintenance/cirrussearch.pp
+++ b/modules/mediawiki/manifests/maintenance/cirrussearch.pp
@@ -1,26 +1,24 @@
class mediawiki::maintenance::cirrussearch( $ensure = present ) {
require mediawiki::users
- # Rebuilds the completion suggester indices once a week. This is scheduled
- # to run during the low period of cirrus usage, which is generally 12am
+ # Rebuilds the completion suggester indices daily. This is scheduled
+ # to run during the low period of cirrus usage, which is generally 3am
# to 7am UTC. The `|| true` statement ensures one failing wiki doesn't
- # fail the entire job. This job, as of dec 2015, takes around 12 hours to
+ # fail the entire job. This job, as of mar 2015, takes around 5 hours
# to run.
cron { 'cirrus_build_completion_indices_eqiad':
ensure => $ensure,
user => $::mediawiki::users::web,
- minute => 20,
- hour => 0,
- weekday => 2,
+ minute => 30,
+ hour => 2,
command => '/usr/local/bin/expanddblist all | xargs -I{} -P 4 sh -c
\'/usr/local/bin/mwscript
extensions/CirrusSearch/maintenance/updateSuggesterIndex.php --wiki={}
--masterTimeout=10m --cluster=eqiad --optimize >
/var/log/mediawiki/cirrus-suggest/{}.eqiad.log 2>&1 || true\''
}
cron { 'cirrus_build_completion_indices_codfw':
ensure => $ensure,
user => $::mediawiki::users::web,
- minute => 20,
- hour => 0,
- weekday => 2,
+ minute => 30,
+ hour => 2,
command => '/usr/local/bin/expanddblist all | xargs -I{} -P 4 sh -c
\'/usr/local/bin/mwscript
extensions/CirrusSearch/maintenance/updateSuggesterIndex.php --wiki={}
--masterTimeout=10m --cluster=codfw --optimize >
/var/log/mediawiki/cirrus-suggest/{}.codfw.log 2>&1 || true\''
}
--
To view, visit https://gerrit.wikimedia.org/r/275749
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: I5d3ed3aada0fe05ce36e11d65c27b36c19076bbd
Gerrit-PatchSet: 1
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: EBernhardson <[email protected]>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
