ArielGlenn has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/326422 )
Change subject: list last n good dumps: implement rsynclisting option
..
list last n good dumps: implement rsynclisting option
this
ArielGlenn has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/326417 )
Change subject: list last n good dumps: add (unimplemented) option for dumping
for rsyncers
..
list last n good dumps: add
ArielGlenn has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/326416 )
Change subject: still more pylint of script that produces list of last good
dumps
..
still more pylint of script that produces list of
ArielGlenn has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/326415 )
Change subject: more pylint of script that produces list of last good dumps
..
more pylint of script that produces list of last good
ArielGlenn has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/325978 )
Change subject: use explicit exclude/include list for dumps mirrors
..
use explicit exclude/include list for dumps mirrors
This
ArielGlenn has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/325978 )
Change subject: use explicit exclude/include list for dumps mirrors
..
use explicit exclude/include list for dumps mirrors
This should
ArielGlenn has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/325947 )
Change subject: fix up silly handling of table job names
..
fix up silly handling of table job names
they should all end in 'table' but
ArielGlenn has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/325946 )
Change subject: remove halt, last reference to forcenormal configuration
settings
..
remove halt, last reference to forcenormal
ArielGlenn has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/325945 )
Change subject: cleanup of README for general configuration and sample config
file
..
cleanup of README for general configuration and
ArielGlenn has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/325944 )
Change subject: remove unneeded dblists and references to them
..
remove unneeded dblists and references to them
We no longer check 'is
ArielGlenn has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/325943 )
Change subject: document the new table jobs yaml file
..
document the new table jobs yaml file
Bug: T152679
Change-Id:
ArielGlenn has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/325941 )
Change subject: remove some dblist paths from dump config settings, no longer
needed
..
remove some dblist paths from dump config
ArielGlenn has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/325939 )
Change subject: move configuration of tables to be dumped out to a yaml file
..
move configuration of tables to be dumped out to a yaml
ArielGlenn has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/325844 )
Change subject: move table job info to a default config file and add setting
for override
..
move table job info to a default config
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/325766
Change subject: for sanitarium hosts, include a separate mysql cnf with private
wikis
..
for sanitarium hosts, include a separate mysql
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/325765
Change subject: generate separate mysql config with list of private wikis
..
generate separate mysql config with list of private wikis
ArielGlenn has submitted this change and it was merged.
Change subject: Fix flake8 errors
..
Fix flake8 errors
Bug: T152549
Change-Id: I4c8c2eb1eb3f19ff6f89ae913b3d0efe909f2d1c
---
M checkhosts/tox.ini
M
ArielGlenn has submitted this change and it was merged.
Change subject: dataset: Fix puppet URLs in comments
..
dataset: Fix puppet URLs in comments
Change-Id: I5a450a83b5851c352275512f1d750f81a39fa225
---
M
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324702
Change subject: allow dumps of private tables to be skipped via config setting
..
allow dumps of private tables to be skipped via config
ArielGlenn has submitted this change and it was merged.
Change subject: really fix db_user and db_password issue
..
really fix db_user and db_password issue
config file processing of these params should not blank
out values
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324694
Change subject: really fix db_user and db_password issue
..
really fix db_user and db_password issue
config file processing of these
ArielGlenn has submitted this change and it was merged.
Change subject: make sure db_user and db_password config attributes are
initialized
..
make sure db_user and db_password config attributes are initialized
Change-Id:
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324678
Change subject: make sure db_user and db_password config attributes are
initialized
..
make sure db_user and db_password config
ArielGlenn has submitted this change and it was merged.
Change subject: miscdumps: use log.info for verbose only
..
miscdumps: use log.info for verbose only
this was the default log level for everything, woops
Change-Id:
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324625
Change subject: miscdumps: use log.info for verbose only
..
miscdumps: use log.info for verbose only
this was the default log level for
ArielGlenn has submitted this change and it was merged.
Change subject: fix usage message
..
fix usage message
since the person who wrote this (me) can't remember options
they just added
Change-Id:
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324622
Change subject: fix usage message
..
fix usage message
since the person who wrote this (me) can't remember options
they just added
ArielGlenn has submitted this change and it was merged.
Change subject: tweak stale lock refresh interval for incr dumps
..
tweak stale lock refresh interval for incr dumps
Change-Id: I672eb4dae9c17e30e9c962ac4f76fa5637d84850
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324619
Change subject: tweak stale lock refresh interval for incr dumps
..
tweak stale lock refresh interval for incr dumps
Change-Id:
ArielGlenn has submitted this change and it was merged.
Change subject: start adds/changes dumps cron job earlier
..
start adds/changes dumps cron job earlier
Late start time was left over from when there were two phases with
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324618
Change subject: start adds/changes dumps cron job earlier
..
start adds/changes dumps cron job earlier
Late start time was left over from
ArielGlenn has submitted this change and it was merged.
Change subject: make lock stale time for incremental dumps a lot shorter
..
make lock stale time for incremental dumps a lot shorter
no need to wait 15 minutes, refreshes
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324617
Change subject: make lock stale time for incremental dumps a lot shorter
..
make lock stale time for incremental dumps a lot shorter
no
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324482
Change subject: pick up privatewikis fact from mediawiki config file
..
pick up privatewikis fact from mediawiki config file
the idea is
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324219
Change subject: fix up locking for misc dumps
..
fix up locking for misc dumps
This will allow multiple processes to run on multiple
ArielGlenn has submitted this change and it was merged.
Change subject: update cron command and config file for adds/changes dumps
..
update cron command and config file for adds/changes dumps
these now will use the misc dumps
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324409
Change subject: update cron command and config file for adds/changes dumps
..
update cron command and config file for adds/changes dumps
ArielGlenn has submitted this change and it was merged.
Change subject: miscdumps: fix up config defaults
..
miscdumps: fix up config defaults
toss some unused settings (holdovers from the regular dumps
that were copied over
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324406
Change subject: miscdumps: fix up config defaults
..
miscdumps: fix up config defaults
toss some unused settings (holdovers from the
ArielGlenn has submitted this change and it was merged.
Change subject: miscdumps: make refresh interval for lock a few seconds shorter
than stale time
..
miscdumps: make refresh interval for lock a few seconds shorter than
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324395
Change subject: miscdumps: make refresh interval for lock a few seconds shorter
than stale time
..
miscdumps: make refresh interval for
ArielGlenn has submitted this change and it was merged.
Change subject: add timeout and related callback to method for running proc
without output
..
add timeout and related callback to method for running proc without output
ArielGlenn has submitted this change and it was merged.
Change subject: fix check that file we have fcntl lock is empty
..
fix check that file we have fcntl lock is empty
don't read contents by path, check size of filehandle
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324246
Change subject: fix check that file we have fcntl lock is empty
..
fix check that file we have fcntl lock is empty
don't read contents by
ArielGlenn has submitted this change and it was merged.
Change subject: html dumps script using misc dump generation framework
..
html dumps script using misc dump generation framework
[WIP]: there is no appropriate nodejs
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324231
Change subject: html dumps script using misc dump generation framework
..
html dumps script using misc dump generation framework
[WIP]:
ArielGlenn has submitted this change and it was merged.
Change subject: fix up locking for misc dumps
..
fix up locking for misc dumps
This will allow multiple processes to run on multiple hosts doing
these dumps.
No
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324217
Change subject: add timeout and related callback to method for running proc
without output
..
add timeout and related callback to method
ArielGlenn has submitted this change and it was merged.
Change subject: for miscdumpslib add a method for running simple sql queries
and use it
..
for miscdumpslib add a method for running simple sql queries and use it
this
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324209
Change subject: for miscdumpslib add a method for running simple sql queries
and use it
..
for miscdumpslib add a method for running
ArielGlenn has submitted this change and it was merged.
Change subject: misc dumps: add sample_dumps module for an example
..
misc dumps: add sample_dumps module for an example
this module implements the classes necessary for
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324207
Change subject: misc dumps: add sample_dumps module for an example
..
misc dumps: add sample_dumps module for an example
this module
ArielGlenn has submitted this change and it was merged.
Change subject: for misc dumps, docstring cleanup and NotImplementedError for
base methods
..
for misc dumps, docstring cleanup and NotImplementedError for base methods
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324206
Change subject: for misc dumps, docstring cleanup and NotImplementedError for
base methods
..
for misc dumps, docstring cleanup and
ArielGlenn has submitted this change and it was merged.
Change subject: properly allow for multistep dumps,have a base class for dump
types
..
properly allow for multistep dumps,have a base class for dump types
there is now
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324195
Change subject: disable two pylint warnings for misc dump and incr dump modules
..
disable two pylint warnings for misc dump and incr dump
ArielGlenn has submitted this change and it was merged.
Change subject: disable two pylint warnings for misc dump and incr dump modules
..
disable two pylint warnings for misc dump and incr dump modules
Change-Id:
ArielGlenn has submitted this change and it was merged.
Change subject: pylint of modules for misc dumps: add/clean up doc strings
..
pylint of modules for misc dumps: add/clean up doc strings
Change-Id:
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324198
Change subject: properly allow for multistep dumps,have a base class for dump
types
..
properly allow for multistep dumps,have a base
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324193
Change subject: pylint of modules for misc dumps: add/clean up doc strings
..
pylint of modules for misc dumps: add/clean up doc strings
ArielGlenn has submitted this change and it was merged.
Change subject: misdcumps: clean up arg handling
..
misdcumps: clean up arg handling
* regular args go in 'standard_args' dict, secondary per dumptype
args go in
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324183
Change subject: misdcumps: clean up arg handling
..
misdcumps: clean up arg handling
* regular args go in 'standard_args' dict, secondary
ArielGlenn has submitted this change and it was merged.
Change subject: misc pylint and small cleanup
..
misc pylint and small cleanup
* make get_path for ContentFile subclasses always take the date arg
* make Indexfile not a
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324176
Change subject: misc pylint and small cleanup
..
misc pylint and small cleanup
* make get_path for ContentFile subclasses always take the
ArielGlenn has submitted this change and it was merged.
Change subject: decouple MiscDumpConfig from the wikidump config class
..
decouple MiscDumpConfig from the wikidump config class
this also entails making
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324174
Change subject: decouple MiscDumpConfig from the wikidump config class
..
decouple MiscDumpConfig from the wikidump config class
this
ArielGlenn has submitted this change and it was merged.
Change subject: clean up lockfile and locking class names, toss unused classes
..
clean up lockfile and locking class names, toss unused classes
Change-Id:
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324168
Change subject: clean up lockfile and locking class names, toss unused classes
..
clean up lockfile and locking class names, toss unused
ArielGlenn has submitted this change and it was merged.
Change subject: miscdumpslib Config becomes MiscDumpConfig
..
miscdumpslib Config becomes MiscDumpConfig
to distinguish it from the other Config classes floating around
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324158
Change subject: miscdumpslib Config becomes MiscDumpConfig
..
miscdumpslib Config becomes MiscDumpConfig
to distinguish it from the other
ArielGlenn has submitted this change and it was merged.
Change subject: miscdumps: use logging module instead of passing verbose var
around everywhere
..
miscdumps: use logging module instead of passing verbose var around
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324154
Change subject: miscdumps: use logging module instead of passing verbose var
around everywhere
..
miscdumps: use logging module instead
ArielGlenn has submitted this change and it was merged.
Change subject: move check for wikis we skip into a separate method
..
move check for wikis we skip into a separate method
Change-Id:
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324149
Change subject: move check for wikis we skip into a separate method
..
move check for wikis we skip into a separate method
Change-Id:
ArielGlenn has submitted this change and it was merged.
Change subject: add docstrings to generatemiscdumps and miscdumplib
..
add docstrings to generatemiscdumps and miscdumplib
Change-Id:
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324147
Change subject: add docstrings to generatemiscdumps and miscdumplib
..
add docstrings to generatemiscdumps and miscdumplib
Change-Id:
ArielGlenn has submitted this change and it was merged.
Change subject: make index html output nicer and include md5 sums of files
..
make index html output nicer and include md5 sums of files
Change-Id:
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324143
Change subject: make index html output nicer and include md5 sums of files
..
make index html output nicer and include md5 sums of files
ArielGlenn has submitted this change and it was merged.
Change subject: move md5-related methods to miscdumplib
..
move md5-related methods to miscdumplib
Change-Id: I5bf54289c524894759c03eea4647f15225c76811
---
M
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324141
Change subject: move md5-related methods to miscdumplib
..
move md5-related methods to miscdumplib
Change-Id:
ArielGlenn has submitted this change and it was merged.
Change subject: generateincrementals.py becomes generatemiscdumps.py at last
..
generateincrementals.py becomes generatemiscdumps.py at last
Bug: T133547
Change-Id:
ArielGlenn has submitted this change and it was merged.
Change subject: move last references to incr/Incr out of generateincrementals
module
..
move last references to incr/Incr out of generateincrementals module
there is now
ArielGlenn has submitted this change and it was merged.
Change subject: add MiscDumpFactory to manage different dump types
..
add MiscDumpFactory to manage different dump types
the next change will actually make use of this
ArielGlenn has submitted this change and it was merged.
Change subject: remove cutoff option from command line
..
remove cutoff option from command line
it should only be generated from the date of the wiki
dump run and the
ArielGlenn has submitted this change and it was merged.
Change subject: handle adds/changes-specifig args in incr_dumps module
..
handle adds/changes-specifig args in incr_dumps module
* set up secondary usage message for
ArielGlenn has submitted this change and it was merged.
Change subject: generate statusinfo and md5sums for generic set of dump output
files
..
generate statusinfo and md5sums for generic set of dump output files
the output
ArielGlenn has submitted this change and it was merged.
Change subject: move dump result constants to the miscdumpslib module
..
move dump result constants to the miscdumpslib module
Bug: T133547
Change-Id:
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324019
Change subject: generateincrementals.py becomes generatemiscdumps.py at last
..
generateincrementals.py becomes generatemiscdumps.py at
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324018
Change subject: move last references to incr/Incr out of generateincrementals
module
..
move last references to incr/Incr out of
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324016
Change subject: add MiscDumpFactory to manage different dump types
..
add MiscDumpFactory to manage different dump types
the next change
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324015
Change subject: remove cutoff option from command line
..
remove cutoff option from command line
it should only be generated from the
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324013
Change subject: handle adds/changes-specifig args in incr_dumps module
..
handle adds/changes-specifig args in incr_dumps module
* set up
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324011
Change subject: generate statusinfo and md5sums for generic set of dump output
files
..
generate statusinfo and md5sums for generic set
ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/324009
Change subject: move dump result constants to the miscdumpslib module
..
move dump result constants to the miscdumpslib module
Bug:
ArielGlenn has submitted this change and it was merged.
Change subject: a bit of pylint: order of imports, var initialization type
whines
..
a bit of pylint: order of imports, var initialization type whines
Change-Id:
ArielGlenn has submitted this change and it was merged.
Change subject: Change last few config options from 'incr' to 'misc'
..
Change last few config options from 'incr' to 'misc'
default name of index.html template, default
ArielGlenn has submitted this change and it was merged.
Change subject: move options specific to adds/changes into args dict
..
move options specific to adds/changes into args dict
this dict of args is passed through to the
ArielGlenn has submitted this change and it was merged.
Change subject: add run method to the IncrDump class to be used by the generate
wrapper
..
add run method to the IncrDump class to be used by the generate wrapper
once
ArielGlenn has submitted this change and it was merged.
Change subject: move methods that dump things into the IncrDump class in
incr_dump
..
move methods that dump things into the IncrDump class in incr_dump
this means
ArielGlenn has submitted this change and it was merged.
Change subject: move more incremental-related methods out to incr_dumps module
..
move more incremental-related methods out to incr_dumps module
the baby IncrDump class
701 - 800 of 3487 matches
Mail list logo
