ArielGlenn has uploaded a new change for review.
https://gerrit.wikimedia.org/r/276412
Change subject: filter out summary lines from wget for wikitech dumps copy
......................................................................
filter out summary lines from wget for wikitech dumps copy
the never-ending quest to get this cron job not to spam while
still catching errors...
Change-Id: I5e99d3f5e75d3e7b7499273d6cdeb918fb7c2ce5
---
M modules/dataset/manifests/cron/wikitech_dumps.pp
1 file changed, 2 insertions(+), 2 deletions(-)
git pull ssh://gerrit.wikimedia.org:29418/operations/puppet
refs/changes/12/276412/1
diff --git a/modules/dataset/manifests/cron/wikitech_dumps.pp
b/modules/dataset/manifests/cron/wikitech_dumps.pp
index 7759a7a..38dcf03 100644
--- a/modules/dataset/manifests/cron/wikitech_dumps.pp
+++ b/modules/dataset/manifests/cron/wikitech_dumps.pp
@@ -27,8 +27,8 @@
$wgetreject = "--reject-regex '(.*)\?(.*)'"
$wgetargs = "-nv -e robots=off -k -nH --wait 30 -np -m ${url} -P
${wikitechdir}"
# filter out any whines about missing timestamp for index.html
- # as well as the url download announcements, we only care about anything
else
- $filter = "2>&1 | grep -E -v '(turned off|URL:http)'"
+ # as well url download announcements and summary, we only care about
anything else
+ $filter = "2>&1 | grep -E -v '(turned
off|URL:http|FINISHED|Total|Downloaded)'"
# toss wikitech's autogenerated index.html files when done
$cleanuphtml = "find ${wikitechdir} -name 'index.html*' -exec rm {} \\;"
# remove dumps older than 90 days
--
To view, visit https://gerrit.wikimedia.org/r/276412
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: I5e99d3f5e75d3e7b7499273d6cdeb918fb7c2ce5
Gerrit-PatchSet: 1
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: ArielGlenn <[email protected]>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
