[MediaWiki-commits] [Gerrit] Ignore VIA before 2014-03-22 (wasn't in X-Analytics) - change (analytics/zero-sms)

2014-09-21 Thread Yurik (Code Review) 
Yurik has uploaded a new change for review.

  https://gerrit.wikimedia.org/r/161804

Change subject: Ignore VIA before 2014-03-22 (wasn't in X-Analytics)
..

Ignore VIA before 2014-03-22 (wasn't in X-Analytics)

Change-Id: I035f2598d315bd4f19d46660b9a966d326469939
---
M scripts/weblogs.py
1 file changed, 5 insertions(+), 3 deletions(-)


  git pull ssh://gerrit.wikimedia.org:29418/analytics/zero-sms 
refs/changes/04/161804/1

diff --git a/scripts/weblogs.py b/scripts/weblogs.py
index ab5d3f1..1d0a136 100644
--- a/scripts/weblogs.py
+++ b/scripts/weblogs.py
@@ -216,6 +216,8 @@
 
 def combineStats(self):
 safePrint('Combine stat files')
+# Logs did not contain the VIA X-Analytics tag before this date
+ignoreViaBefore = datetime(2014, 3, 22)
 configs = self.downloadConfigs()
 stats = collections.defaultdict(int)
 for f in os.listdir(self.pathCache):
@@ -251,7 +253,7 @@
 (conf.https or https == u'http') and \
 (True == langs or lang in langs) and \
 (True == sites or site2 in sites) and \
-(via in conf.via) and \
+(dt  ignoreViaBefore or via in conf.via) 
and \
 (ipset in conf.ipsets):
 isZero = True
 break
@@ -351,5 +353,5 @@
 
 
 if __name__ == '__main__':
-WebLogProcessor(logDatePattern=(sys.argv[1] if len(sys.argv)  1 else 
False)).manualRun()
-# WebLogProcessor(logDatePattern=(sys.argv[1] if len(sys.argv)  1 else 
False)).safeRun()
+# WebLogProcessor(logDatePattern=(sys.argv[1] if len(sys.argv)  1 else 
False)).manualRun()
+WebLogProcessor(logDatePattern=(sys.argv[1] if len(sys.argv)  1 else 
False)).safeRun()

-- 
To view, visit https://gerrit.wikimedia.org/r/161804
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings

Gerrit-MessageType: newchange
Gerrit-Change-Id: I035f2598d315bd4f19d46660b9a966d326469939
Gerrit-PatchSet: 1
Gerrit-Project: analytics/zero-sms
Gerrit-Branch: master
Gerrit-Owner: Yurik yu...@wikimedia.org

___
MediaWiki-commits mailing list
MediaWiki-commits@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits

[MediaWiki-commits] [Gerrit] Ignore VIA before 2014-03-22 (wasn't in X-Analytics) - change (analytics/zero-sms)

2014-09-21 Thread Yurik (Code Review) 
Yurik has submitted this change and it was merged.

Change subject: Ignore VIA before 2014-03-22 (wasn't in X-Analytics)
..


Ignore VIA before 2014-03-22 (wasn't in X-Analytics)

Change-Id: I035f2598d315bd4f19d46660b9a966d326469939
---
M scripts/weblogs.py
1 file changed, 5 insertions(+), 3 deletions(-)

Approvals:
  Yurik: Verified; Looks good to me, approved



diff --git a/scripts/weblogs.py b/scripts/weblogs.py
index ab5d3f1..1d0a136 100644
--- a/scripts/weblogs.py
+++ b/scripts/weblogs.py
@@ -216,6 +216,8 @@
 
 def combineStats(self):
 safePrint('Combine stat files')
+# Logs did not contain the VIA X-Analytics tag before this date
+ignoreViaBefore = datetime(2014, 3, 22)
 configs = self.downloadConfigs()
 stats = collections.defaultdict(int)
 for f in os.listdir(self.pathCache):
@@ -251,7 +253,7 @@
 (conf.https or https == u'http') and \
 (True == langs or lang in langs) and \
 (True == sites or site2 in sites) and \
-(via in conf.via) and \
+(dt  ignoreViaBefore or via in conf.via) 
and \
 (ipset in conf.ipsets):
 isZero = True
 break
@@ -351,5 +353,5 @@
 
 
 if __name__ == '__main__':
-WebLogProcessor(logDatePattern=(sys.argv[1] if len(sys.argv)  1 else 
False)).manualRun()
-# WebLogProcessor(logDatePattern=(sys.argv[1] if len(sys.argv)  1 else 
False)).safeRun()
+# WebLogProcessor(logDatePattern=(sys.argv[1] if len(sys.argv)  1 else 
False)).manualRun()
+WebLogProcessor(logDatePattern=(sys.argv[1] if len(sys.argv)  1 else 
False)).safeRun()

-- 
To view, visit https://gerrit.wikimedia.org/r/161804
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings

Gerrit-MessageType: merged
Gerrit-Change-Id: I035f2598d315bd4f19d46660b9a966d326469939
Gerrit-PatchSet: 1
Gerrit-Project: analytics/zero-sms
Gerrit-Branch: master
Gerrit-Owner: Yurik yu...@wikimedia.org
Gerrit-Reviewer: Yurik yu...@wikimedia.org

___
MediaWiki-commits mailing list
MediaWiki-commits@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits