EBernhardson has uploaded a new change for review.
https://gerrit.wikimedia.org/r/258068
Change subject: [WIP] Cron job to rebuild completion indices
......................................................................
[WIP] Cron job to rebuild completion indices
This will run once a week at 20 after midnight UTC. According to our
graphs it looks like midnight to 7am is the least busy time for the
server.
I don't know yet how long this will take, hence the WIP tag. We need
to deploy another fix (I8178ea1a) before these can be built in prod.
I'm hoping it will take under 7 hours with the 4 way parallelism, but
I'm just not sure.
Bug: T112028
Change-Id: I66c2723a366e988574b46ded4e1bdd9c3188a58e
---
A modules/mediawiki/files/maintenance/logrotate.d_cirrus-suggest
A modules/mediawiki/manifests/maintenance/cirrussearch.pp
2 files changed, 43 insertions(+), 0 deletions(-)
git pull ssh://gerrit.wikimedia.org:29418/operations/puppet
refs/changes/68/258068/1
diff --git a/modules/mediawiki/files/maintenance/logrotate.d_cirrus-suggest
b/modules/mediawiki/files/maintenance/logrotate.d_cirrus-suggest
new file mode 100644
index 0000000..ba127ce
--- /dev/null
+++ b/modules/mediawiki/files/maintenance/logrotate.d_cirrus-suggest
@@ -0,0 +1,13 @@
+#####################################################################
+### THIS FILE IS MANAGED BY PUPPET
+#####################################################################
+
+/var/log/mediawiki/cirrus-suggest/*.log {
+ daily
+ notifempty
+ maxage 30
+ rotate 5
+ dateext
+ compress
+ missingok
+}
diff --git a/modules/mediawiki/manifests/maintenance/cirrussearch.pp
b/modules/mediawiki/manifests/maintenance/cirrussearch.pp
new file mode 100644
index 0000000..3195920
--- /dev/null
+++ b/modules/mediawiki/manifests/maintenance/cirrussearch.pp
@@ -0,0 +1,30 @@
+class mediawiki::maintenance::cirrussearch( $ensure = present ) {
+ require mediawiki::users
+
+ # Rebuilds the completion suggester index once a week. This is scheduled
+ # to run during the low period of cirrus usage, which is generally 12am
+ # to 7am UTC.
+ cron { 'cirrus_build_completion_indices':
+ ensure => $ensure,
+ user => $::mediawiki::users::web,
+ minute => 20,
+ hour => 0,
+ weekday => 2,
+ command => '/usr/local/bin/expanddblist all | xargs -I{} -P 4
sh -c \'mwscript extensions/CirrusSearch/maintenance/updateSuggesterIndex.php
--wiki={} --optimize > /var/log/mediawiki/cirrus-suggest/{}.log\''
+ }
+
+ file { '/var/log/mediawiki/cirrus-suggest':
+ ensure => ensure_directory($ensure),
+ owner => $::mediawiki::users::web,
+ group => $::mediawiki::users::web,
+ mode => '0775'
+ }
+
+ file { '/etc/logrotate.d/cirrus-suggest':
+ ensure => $ensure,
+ source =>
'puppet:///modules/mediawiki/maintenance/logrotate.d_cirrus-suggest',
+ owner => 'root',
+ group => 'root',
+ mode => '0444',
+ }
+}
--
To view, visit https://gerrit.wikimedia.org/r/258068
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: I66c2723a366e988574b46ded4e1bdd9c3188a58e
Gerrit-PatchSet: 1
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: EBernhardson <[email protected]>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
