Nemo bis has uploaded a new change for review.
https://gerrit.wikimedia.org/r/92056
Change subject: Move download limiter to proper place and comment it as it's
only a test
......................................................................
Move download limiter to proper place and comment it as it's only a test
Per the comment, it's just a test; then comment it out.
The download should be skipped at this point and not later, probably,
otherwise the following gzip check makes no sense and you get nonsense
errors about the checked path not existing.
Change-Id: Ic7c1bede053bd7de960302461407cd88e5120f52
---
M mail-lists/CollectMailArchives.pl
1 file changed, 6 insertions(+), 2 deletions(-)
git pull ssh://gerrit.wikimedia.org:29418/analytics/wikistats
refs/changes/56/92056/1
diff --git a/mail-lists/CollectMailArchives.pl
b/mail-lists/CollectMailArchives.pl
index 7a4f5f0..967bd37 100644
--- a/mail-lists/CollectMailArchives.pl
+++ b/mail-lists/CollectMailArchives.pl
@@ -1,5 +1,8 @@
#!/usr/bin/perl
+# Requires CPAN modules: Crypt::SSLeay IO::Socket::SSL LWP::Protocol::https
+# Requires: EzLib.pm from analytics/wikistats/analytics/perl/EzLib.pm
+
use lib "/[.. path ..]/lib" ;
use EzLib ;
$trace_on_exit = $true ;
@@ -157,6 +160,9 @@
&Log("Skip $path\n") ;
next ;
}
+# test only: limit new files per folder to speed up process
+# if ($getcnt > 4)
+# { last ; } ;
$url2 = $url . $file ;
($succes, $content) = &GetPage ($url2, $checktext) ;
if ($succes)
@@ -166,8 +172,6 @@
# if (++$getcnt >= 2)
# { last ; }
$getcnt++ ; # only fetch newest two months always
- if ($getcnt > 4)
- { last ; } ; # test only: limit new files per folder to speed up
process
}
}
}
--
To view, visit https://gerrit.wikimedia.org/r/92056
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: Ic7c1bede053bd7de960302461407cd88e5120f52
Gerrit-PatchSet: 1
Gerrit-Project: analytics/wikistats
Gerrit-Branch: master
Gerrit-Owner: Nemo bis <federicol...@tiscali.it>
_______________________________________________
MediaWiki-commits mailing list
MediaWiki-commits@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
