[MediaWiki-commits] [Gerrit] operations/dumps[master]: handle prereq properly when a previous dump task has failed ...

2016-08-24 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/306436 Change subject: handle prereq properly when a previous dump task has failed rather than not run .. handle prereq properly when a previous

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move command retry updating into its own method

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: scheduler: move command retry updating into its own method .. scheduler: move command retry updating into its own method Change-Id:

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move command retry updating into its own method

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/306291 Change subject: scheduler: move command retry updating into its own method .. scheduler: move command retry updating into its own method

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move population of dict for opts out to module fu...

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: scheduler: move population of dict for opts out to module function .. scheduler: move population of dict for opts out to module function also toss unused

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move population of dict for opts out to module fu...

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/306233 Change subject: scheduler: move population of dict for opts out to module function .. scheduler: move population of dict for opts out to

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move setup of stdin for commands out to a module ...

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: scheduler: move setup of stdin for commands out to a module function .. scheduler: move setup of stdin for commands out to a module function Change-Id:

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move setup of stdin for commands out to a module ...

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/306231 Change subject: scheduler: move setup of stdin for commands out to a module function .. scheduler: move setup of stdin for commands out

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move log level setup out to a module function

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: scheduler: move log level setup out to a module function .. scheduler: move log level setup out to a module function Change-Id:

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move log level setup out to a module function

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/306230 Change subject: scheduler: move log level setup out to a module function .. scheduler: move log level setup out to a module function

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move plugables setup out into a module function

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: scheduler: move plugables setup out into a module function .. scheduler: move plugables setup out into a module function Change-Id:

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move plugables setup out into a module function

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/306229 Change subject: scheduler: move plugables setup out into a module function .. scheduler: move plugables setup out into a module function

[MediaWiki-commits] [Gerrit] operations/dumps[master]: convert options and flags into dict for easier handling

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: convert options and flags into dict for easier handling .. convert options and flags into dict for easier handling Change-Id:

[MediaWiki-commits] [Gerrit] operations/dumps[master]: convert options and flags into dict for easier handling

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/306228 Change subject: convert options and flags into dict for easier handling .. convert options and flags into dict for easier handling

[MediaWiki-commits] [Gerrit] operations/dumps[master]: move id string setup into a module-level function

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: move id string setup into a module-level function .. move id string setup into a module-level function it's intended to be called once before anything

[MediaWiki-commits] [Gerrit] operations/dumps[master]: move id string setup into a module-level function

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/306227 Change subject: move id string setup into a module-level function .. move id string setup into a module-level function it's intended to

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: change scheduler class to take dict of plugables

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: scheduler: change scheduler class to take dict of plugables .. scheduler: change scheduler class to take dict of plugables We can add to this dict as

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: change scheduler class to take dict of plugables

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/306226 Change subject: scheduler: change scheduler class to take dict of plugables .. scheduler: change scheduler class to take dict of plugables

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move process result checking out to a class

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: scheduler: move process result checking out to a class .. scheduler: move process result checking out to a class Change-Id:

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move process result checking out to a class

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/306224 Change subject: scheduler: move process result checking out to a class .. scheduler: move process result checking out to a class

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: split up the check for running processses

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: scheduler: split up the check for running processses .. scheduler: split up the check for running processses We have two types of checks now, one by Popen

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: split up the check for running processses

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/306215 Change subject: scheduler: split up the check for running processses .. scheduler: split up the check for running processses We have two

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move generation of unique id string out to the mo...

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: scheduler: move generation of unique id string out to the module .. scheduler: move generation of unique id string out to the module We need this to get

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move generation of unique id string out to the mo...

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/306212 Change subject: scheduler: move generation of unique id string out to the module .. scheduler: move generation of unique id string out to

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move slot related stuff out into a class for reso...

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: scheduler: move slot related stuff out into a class for resource allocation .. scheduler: move slot related stuff out into a class for resource allocation

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move slot related stuff out into a class for reso...

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/306211 Change subject: scheduler: move slot related stuff out into a class for resource allocation .. scheduler: move slot related stuff out

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: make pylint not whine about unused args to signal...

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: scheduler: make pylint not whine about unused args to signal handler .. scheduler: make pylint not whine about unused args to signal handler also fix up

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: make pylint not whine about unused args to signal...

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/306207 Change subject: scheduler: make pylint not whine about unused args to signal handler .. scheduler: make pylint not whine about unused

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move email related methods into a class

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: scheduler: move email related methods into a class .. scheduler: move email related methods into a class also, break up the email sender function into

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move email related methods into a class

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/306203 Change subject: scheduler: move email related methods into a class .. scheduler: move email related methods into a class also, break up

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move cache related methods into a class

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: scheduler: move cache related methods into a class .. scheduler: move cache related methods into a class Change-Id:

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move cache related methods into a class

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/306201 Change subject: scheduler: move cache related methods into a class .. scheduler: move cache related methods into a class Change-Id:

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move methods out into module that don't need 'self'

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: scheduler: move methods out into module that don't need 'self' .. scheduler: move methods out into module that don't need 'self' Change-Id:

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: move methods out into module that don't need 'self'

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/306200 Change subject: scheduler: move methods out into module that don't need 'self' .. scheduler: move methods out into module that don't need

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: make all except clauses catch specific exceptions

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: scheduler: make all except clauses catch specific exceptions .. scheduler: make all except clauses catch specific exceptions Change-Id:

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: make all except clauses catch specific exceptions

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/306198 Change subject: scheduler: make all except clauses catch specific exceptions .. scheduler: make all except clauses catch specific

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: make json default object handler do something a b...

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: scheduler: make json default object handler do something a bit more useful .. scheduler: make json default object handler do something a bit more useful

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: make json default object handler do something a b...

2016-08-23 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/306197 Change subject: scheduler: make json default object handler do something a bit more useful .. scheduler: make json default object handler

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: on HUP, clean up zombies after killing child proc...

2016-08-22 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: scheduler: on HUP, clean up zombies after killing child processes .. scheduler: on HUP, clean up zombies after killing child processes Change-Id:

[MediaWiki-commits] [Gerrit] operations/dumps[master]: scheduler: on HUP, clean up zombies after killing child proc...

2016-08-22 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/305982 Change subject: scheduler: on HUP, clean up zombies after killing child processes .. scheduler: on HUP, clean up zombies after killing

[MediaWiki-commits] [Gerrit] operations/dumps[master]: fix up prereq option in bash wrapper script for dumps

2016-08-21 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: fix up prereq option in bash wrapper script for dumps .. fix up prereq option in bash wrapper script for dumps Change-Id:

[MediaWiki-commits] [Gerrit] operations/dumps[master]: fix up prereq option in bash wrapper script for dumps

2016-08-21 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/305893 Change subject: fix up prereq option in bash wrapper script for dumps .. fix up prereq option in bash wrapper script for dumps Change-Id:

[MediaWiki-commits] [Gerrit] operations/puppet[production]: enable runs of missing prereq steps for dumps at later step

2016-08-21 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: enable runs of missing prereq steps for dumps at later step .. enable runs of missing prereq steps for dumps at later step Change-Id:

[MediaWiki-commits] [Gerrit] operations/puppet[production]: enable runs of missing prereq steps for dumps at later step

2016-08-21 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/305872 Change subject: enable runs of missing prereq steps for dumps at later step .. enable runs of missing prereq steps for dumps at later step

[MediaWiki-commits] [Gerrit] operations/puppet[production]: reduce cronspam, eliminate dataset rsync whines about vanish...

2016-08-19 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: reduce cronspam, eliminate dataset rsync whines about vanished files .. reduce cronspam, eliminate dataset rsync whines about vanished files followup to

[MediaWiki-commits] [Gerrit] operations/puppet[production]: reduce cronspam, eliminate dataset rsync whines about vanish...

2016-08-19 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/305621 Change subject: reduce cronspam, eliminate dataset rsync whines about vanished files .. reduce cronspam, eliminate dataset rsync whines

[MediaWiki-commits] [Gerrit] operations/puppet[production]: reduce cronspam: filter out dataset rsync error messages abo...

2016-08-16 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: reduce cronspam: filter out dataset rsync error messages about vanishing files .. reduce cronspam: filter out dataset rsync error messages about vanishing

[MediaWiki-commits] [Gerrit] operations/puppet[production]: reduce cronspam: filter out dataset rsync error messages abo...

2016-08-16 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/304988 Change subject: reduce cronspam: filter out dataset rsync error messages about vanishing files .. reduce cronspam: filter out dataset

[MediaWiki-commits] [Gerrit] operations/dumps[master]: more pylint: no more filter, one more staticmethod decorator

2016-08-11 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: more pylint: no more filter, one more staticmethod decorator .. more pylint: no more filter, one more staticmethod decorator Change-Id:

[MediaWiki-commits] [Gerrit] operations/dumps[master]: check for empty output files, not just truncated ones

2016-08-11 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: check for empty output files, not just truncated ones .. check for empty output files, not just truncated ones Change-Id:

[MediaWiki-commits] [Gerrit] operations/dumps[master]: check for empty output files, not just truncated ones

2016-08-11 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/304281 Change subject: check for empty output files, not just truncated ones .. check for empty output files, not just truncated ones Change-Id:

[MediaWiki-commits] [Gerrit] operations/dumps[master]: more pylint: no more filter, one more staticmethod decorator

2016-08-11 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/304229 Change subject: more pylint: no more filter, one more staticmethod decorator .. more pylint: no more filter, one more staticmethod

[MediaWiki-commits] [Gerrit] operations/dumps[master]: remove wikiqueries script, replaced by onallwikis which does...

2016-08-11 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: remove wikiqueries script, replaced by onallwikis which does more .. remove wikiqueries script, replaced by onallwikis which does more * also remove docs

[MediaWiki-commits] [Gerrit] operations/dumps[master]: remove wikiqueries script, replaced by onallwikis which does...

2016-08-11 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/304187 Change subject: remove wikiqueries script, replaced by onallwikis which does more .. remove wikiqueries script, replaced by onallwikis

[MediaWiki-commits] [Gerrit] operations/dumps[master]: updated pylint means new pylint cleanup

2016-08-11 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: updated pylint means new pylint cleanup .. updated pylint means new pylint cleanup put imports in proper order replace some ifs with boolean tests use

[MediaWiki-commits] [Gerrit] operations/dumps[master]: updated pylint means new pylint cleanup

2016-08-11 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/304179 Change subject: updated pylint means new pylint cleanup .. updated pylint means new pylint cleanup put imports in proper order replace

[MediaWiki-commits] [Gerrit] operations/dumps[master]: Make scheduler hupable.

2016-08-10 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: Make scheduler hupable. .. Make scheduler hupable. HUP will have scheduler shoot all children and restart itself. All threads set to daemon so they will

[MediaWiki-commits] [Gerrit] operations/dumps[master]: make the 'force' (lock stealing) option for dumps useful

2016-08-10 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: make the 'force' (lock stealing) option for dumps useful .. make the 'force' (lock stealing) option for dumps useful * for regular runs, only remove the

[MediaWiki-commits] [Gerrit] operations/dumps[master]: make the 'force' (lock stealing) option for dumps useful

2016-08-10 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/304013 Change subject: make the 'force' (lock stealing) option for dumps useful .. make the 'force' (lock stealing) option for dumps useful *

[MediaWiki-commits] [Gerrit] operations/puppet[production]: turn on checkpointing for dumps of jawiki, commonswiki

2016-08-09 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: turn on checkpointing for dumps of jawiki, commonswiki .. turn on checkpointing for dumps of jawiki, commonswiki These now take a couple of days for the

[MediaWiki-commits] [Gerrit] operations/puppet[production]: turn on checkpointing for dumps of jawiki, commonswiki

2016-08-09 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/303813 Change subject: turn on checkpointing for dumps of jawiki, commonswiki .. turn on checkpointing for dumps of jawiki, commonswiki These

[MediaWiki-commits] [Gerrit] operations/dumps[master]: If a prereq job is missing, optionally run it instead of giv...

2016-08-09 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: If a prereq job is missing, optionally run it instead of giving up .. If a prereq job is missing, optionally run it instead of giving up Bug: T141981

[MediaWiki-commits] [Gerrit] operations/puppet[production]: fix up pgrep error check for rsyncs between dataset hosts

2016-08-09 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: fix up pgrep error check for rsyncs between dataset hosts .. fix up pgrep error check for rsyncs between dataset hosts Change-Id:

[MediaWiki-commits] [Gerrit] operations/puppet[production]: make dump run locks stale and therefore removable after 15 m...

2016-08-09 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: make dump run locks stale and therefore removable after 15 minutes .. make dump run locks stale and therefore removable after 15 minutes an hour just

[MediaWiki-commits] [Gerrit] operations/puppet[production]: generate and email a few fun dump-related stats each month

2016-08-08 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/303707 Change subject: generate and email a few fun dump-related stats each month .. generate and email a few fun dump-related stats each month

[MediaWiki-commits] [Gerrit] operations/puppet[production]: fix up pgrep error check for rsyncs between dataset hosts

2016-08-04 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/302910 Change subject: fix up pgrep error check for rsyncs between dataset hosts .. fix up pgrep error check for rsyncs between dataset hosts

[MediaWiki-commits] [Gerrit] operations/dumps[master]: Make scheduler hupable.

2016-08-03 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/302831 Change subject: Make scheduler hupable. .. Make scheduler hupable. [WIP] broken. here as a draft only. HUP will have it shoot all

[MediaWiki-commits] [Gerrit] operations/puppet[production]: capture dumps cron job output in log and add log rotation

2016-08-03 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/302827 Change subject: capture dumps cron job output in log and add log rotation .. capture dumps cron job output in log and add log rotation

[MediaWiki-commits] [Gerrit] operations/puppet[production]: make dump run locks stale and therefore removable after 15 m...

2016-08-03 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/302729 Change subject: make dump run locks stale and therefore removable after 15 minutes .. make dump run locks stale and therefore removable

[MediaWiki-commits] [Gerrit] operations/dumps[master]: If a prereq job is missing, run it instead of giving up

2016-08-03 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/302706 Change subject: If a prereq job is missing, run it instead of giving up .. If a prereq job is missing, run it instead of giving up [WIP

[MediaWiki-commits] [Gerrit] operations/puppet[production]: move management of pagetitles and mediatitles dirs to datase...

2016-08-02 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: move management of pagetitles and mediatitles dirs to datasets manifest .. move management of pagetitles and mediatitles dirs to datasets manifest these

[MediaWiki-commits] [Gerrit] operations/puppet[production]: move management of pagetitles and mediatitles dirs to datase...

2016-08-02 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/302603 Change subject: move management of pagetitles and mediatitles dirs to datasets manifest .. move management of pagetitles and mediatitles

[MediaWiki-commits] [Gerrit] operations/puppet[production]: add some missing directories to the datasets dir manifest

2016-08-02 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: add some missing directories to the datasets dir manifest .. add some missing directories to the datasets dir manifest use the opportunity to base the

[MediaWiki-commits] [Gerrit] operations/puppet[production]: add some missing directories to the datasets dir manifest

2016-08-02 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/302547 Change subject: add some missing directories to the datasets dir manifest .. add some missing directories to the datasets dir manifest

[MediaWiki-commits] [Gerrit] operations/puppet[production]: run the content translation dump job once a week

2016-08-02 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: run the content translation dump job once a week .. run the content translation dump job once a week instead of every day, heh Change-Id:

[MediaWiki-commits] [Gerrit] operations/puppet[production]: run the content translation dump job once a week

2016-08-02 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/302503 Change subject: run the content translation dump job once a week .. run the content translation dump job once a week instead of every

[MediaWiki-commits] [Gerrit] operations/puppet[production]: add cron job for Content Translation dumps

2016-08-02 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: add cron job for Content Translation dumps .. add cron job for Content Translation dumps Bug: T127793 Change-Id: I77ee28e9e08e365d2044a54eadfcc9d7f30a26d3

[MediaWiki-commits] [Gerrit] operations/dumps[master]: don't use -q arg for php, we run a modern version which does...

2016-08-02 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: don't use -q arg for php, we run a modern version which doesn't need it .. don't use -q arg for php, we run a modern version which doesn't need it

[MediaWiki-commits] [Gerrit] operations/dumps[master]: don't use -q arg for php, we run a modern version which does...

2016-08-02 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/302451 Change subject: don't use -q arg for php, we run a modern version which doesn't need it .. don't use -q arg for php, we run a modern

[MediaWiki-commits] [Gerrit] operations/dumps[master]: tiny script that retrieves config values from dump config files

2016-08-02 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: tiny script that retrieves config values from dump config files .. tiny script that retrieves config values from dump config files for use by bash

[MediaWiki-commits] [Gerrit] operations/puppet[production]: move ferm rules for dataset roles into common manifest

2016-08-01 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: move ferm rules for dataset roles into common manifest .. move ferm rules for dataset roles into common manifest also include standard and base::firewall

[MediaWiki-commits] [Gerrit] operations/puppet[production]: move ferm rules for dataset roles into common manifest

2016-08-01 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/302281 Change subject: move ferm rules for dataset roles into common manifest .. move ferm rules for dataset roles into common manifest also

[MediaWiki-commits] [Gerrit] operations/puppet[production]: include standard and base::firewall in manifest common to sn...

2016-08-01 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/302279 Change subject: include standard and base::firewall in manifest common to snapshots .. include standard and base::firewall in manifest

[MediaWiki-commits] [Gerrit] operations/puppet[production]: include standard and base::firewall in manifest common to sn...

2016-08-01 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: include standard and base::firewall in manifest common to snapshots .. include standard and base::firewall in manifest common to snapshots this gets it

[MediaWiki-commits] [Gerrit] operations/puppet[production]: remove all traces of snapshot1002 1003 1004

2016-08-01 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: remove all traces of snapshot1002 1003 1004 .. remove all traces of snapshot1002 1003 1004 these hosts are being decommissioned Change-Id:

[MediaWiki-commits] [Gerrit] operations/puppet[production]: remove all traces of snapshot1002 1003 1004

2016-08-01 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/302241 Change subject: remove all traces of snapshot1002 1003 1004 .. remove all traces of snapshot1002 1003 1004 these hosts are being

[MediaWiki-commits] [Gerrit] operations/puppet[production]: combine steps in dump stages for enwiki so that dependent st...

2016-08-01 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: combine steps in dump stages for enwiki so that dependent steps are together .. combine steps in dump stages for enwiki so that dependent steps are

[MediaWiki-commits] [Gerrit] operations/puppet[production]: combine steps in dump stages for enwiki so that dependent st...

2016-08-01 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/302230 Change subject: combine steps in dump stages for enwiki so that dependent steps are together .. combine steps in dump stages for enwiki

[MediaWiki-commits] [Gerrit] operations/puppet[production]: reduce cronspam from dataset pagecounts rsync

2016-08-01 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: reduce cronspam from dataset pagecounts rsync .. reduce cronspam from dataset pagecounts rsync we don't care if files have vanished so filter out those

[MediaWiki-commits] [Gerrit] operations/puppet[production]: reduce cronspam from dataset pagecounts rsync

2016-08-01 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/302225 Change subject: reduce cronspam from dataset pagecounts rsync .. reduce cronspam from dataset pagecounts rsync we don't care if files

[MediaWiki-commits] [Gerrit] operations/puppet[production]: add cron job for Content Translation dumps

2016-07-29 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/301773 Change subject: add cron job for Content Translation dumps .. add cron job for Content Translation dumps [WIP] prolly various errors,

[MediaWiki-commits] [Gerrit] operations/dumps[master]: tiny script that retrieves config values from dump config files

2016-07-28 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/301712 Change subject: tiny script that retrieves config values from dump config files .. tiny script that retrieves config values from dump

[MediaWiki-commits] [Gerrit] mediawiki...CentralAuth[master]: provide the equivalent of getSlaveServer.php for centralauth

2016-07-28 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/301670 Change subject: provide the equivalent of getSlaveServer.php for centralauth .. provide the equivalent of getSlaveServer.php for

[MediaWiki-commits] [Gerrit] operations/puppet[production]: add notes about manual additions needed for new snapshot nodes

2016-07-26 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/301182 Change subject: add notes about manual additions needed for new snapshot nodes .. add notes about manual additions needed for new snapshot

[MediaWiki-commits] [Gerrit] operations/puppet[production]: use fixed repodir setting for dumps jobs

2016-07-26 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/301181 Change subject: use fixed repodir setting for dumps jobs .. use fixed repodir setting for dumps jobs old hosts are gone, new hosts all

[MediaWiki-commits] [Gerrit] operations/puppet[production]: include the dumps packages in the dumps manifest in snapshot...

2016-07-26 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: include the dumps packages in the dumps manifest in snapshot module .. include the dumps packages in the dumps manifest in snapshot module treat it just

[MediaWiki-commits] [Gerrit] operations/puppet[production]: include the dumps packages in the dumps manifest in snapshot...

2016-07-26 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/301169 Change subject: include the dumps packages in the dumps manifest in snapshot module .. include the dumps packages in the dumps manifest

[MediaWiki-commits] [Gerrit] operations/puppet[production]: get rid of the useless snapshot cron role wrapper

2016-07-26 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: get rid of the useless snapshot cron role wrapper .. get rid of the useless snapshot cron role wrapper just include the cron class in the module directly

[MediaWiki-commits] [Gerrit] operations/puppet[production]: move cronjobs class from role to snapshot module and add use...

2016-07-26 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: move cronjobs class from role to snapshot module and add user param .. move cronjobs class from role to snapshot module and add user param this leaves us

[MediaWiki-commits] [Gerrit] operations/puppet[production]: clean up dumps dirs manifest for snapshots

2016-07-26 Thread ArielGlenn (Code Review)
ArielGlenn has submitted this change and it was merged. Change subject: clean up dumps dirs manifest for snapshots .. clean up dumps dirs manifest for snapshots remove user/group params, never used get rid of scriptsdir, no

[MediaWiki-commits] [Gerrit] operations/puppet[production]: clean up dumps dirs manifest for snapshots

2016-07-26 Thread ArielGlenn (Code Review)
ArielGlenn has uploaded a new change for review. https://gerrit.wikimedia.org/r/301150 Change subject: clean up dumps dirs manifest for snapshots .. clean up dumps dirs manifest for snapshots remove user/group params, never

<    5   6   7   8   9   10   11   12   13   14   >