Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-11-22T01:09:00Z] Cleaned out remaining T180934 related log blow up on snapshot1007 (dumpwikidatajson-wikidata-20171120-all-0.log)TASK DETAILhttps://phabricator.wikimedia.org/T180934EMAIL
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-11-20T10:23:19Z] Manually re-started the Wikidata entity JSON dump on snapshot1007 (T180934)TASK DETAILhttps://phabricator.wikimedia.org/T180934EMAIL
ArielGlenn added a comment.
@hoo if you don't see anything else amiss, feel free to start the job manually at any time. I'll clean up that temp log file I left laying around then, too.TASK DETAILhttps://phabricator.wikimedia.org/T180934EMAIL
gerritbot added a comment.
Change 392398 merged by ArielGlenn:
[operations/puppet@production] fix missing redirect for wikidata json dumps
https://gerrit.wikimedia.org/r/392398TASK DETAILhttps://phabricator.wikimedia.org/T180934EMAIL
gerritbot added a comment.
Change 392398 had a related patch set uploaded (by ArielGlenn; owner: ArielGlenn):
[operations/puppet@production] fix missing redirect for wikidata json dumps
https://gerrit.wikimedia.org/r/392398TASK DETAILhttps://phabricator.wikimedia.org/T180934EMAIL
ArielGlenn added a comment.
Contents of the output files in /mnt/data/xmldatadumps/temp:
-rw-rw-r-- 1 datasets datasets20 Nov 20 03:15 wikidataJson.3.gz
-rw-rw-r-- 1 datasets datasets20 Nov 20 03:15 wikidataJson.5.gz
-rw-rw-r-- 1 datasets datasets20 Nov 20 03:15 wikidataJson.2.gz
ArielGlenn added a comment.
The command that wrote the above log was this:
php5 /srv/mediawiki/multiversion/MWScript.php extensions/Wikidata/extensions/Wikibase/repo/maintenance/dumpJson.php --wiki wikidatawiki --shard 1 --sharding-factor 6 --batch-size 1000 --snippet 2 --no-cacheTASK