ArielGlenn has submitted this change and it was merged.

Change subject: filter out summary lines from wget for wikitech dumps copy
......................................................................


filter out summary lines from wget for wikitech dumps copy

the never-ending quest to get this cron job not to spam while
still catching errors...

Change-Id: I5e99d3f5e75d3e7b7499273d6cdeb918fb7c2ce5
---
M modules/dataset/manifests/cron/wikitech_dumps.pp
1 file changed, 2 insertions(+), 2 deletions(-)

Approvals:
  ArielGlenn: Looks good to me, approved
  jenkins-bot: Verified



diff --git a/modules/dataset/manifests/cron/wikitech_dumps.pp 
b/modules/dataset/manifests/cron/wikitech_dumps.pp
index 7759a7a..38dcf03 100644
--- a/modules/dataset/manifests/cron/wikitech_dumps.pp
+++ b/modules/dataset/manifests/cron/wikitech_dumps.pp
@@ -27,8 +27,8 @@
     $wgetreject = "--reject-regex '(.*)\?(.*)'"
     $wgetargs = "-nv -e robots=off -k -nH --wait 30 -np -m ${url} -P 
${wikitechdir}"
     # filter out any whines about missing timestamp for index.html
-    # as well as the url download announcements, we only care about anything 
else
-    $filter = "2>&1  | grep -E -v '(turned off|URL:http)'"
+    # as well url download announcements and summary, we only care about 
anything else
+    $filter = "2>&1  | grep -E -v '(turned 
off|URL:http|FINISHED|Total|Downloaded)'"
     # toss wikitech's autogenerated index.html files when done
     $cleanuphtml = "find ${wikitechdir} -name 'index.html*' -exec rm {} \\;"
     # remove dumps older than 90 days

-- 
To view, visit https://gerrit.wikimedia.org/r/276412
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings

Gerrit-MessageType: merged
Gerrit-Change-Id: I5e99d3f5e75d3e7b7499273d6cdeb918fb7c2ce5
Gerrit-PatchSet: 1
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: ArielGlenn <[email protected]>
Gerrit-Reviewer: ArielGlenn <[email protected]>
Gerrit-Reviewer: jenkins-bot <>

_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits

Reply via email to