Mforns has uploaded a new change for review. https://gerrit.wikimedia.org/r/311961
Change subject: [WIP] Add 2 wikistats reports ...................................................................... [WIP] Add 2 wikistats reports Adds pages created and edits reports, broken down by namespace, to a new folder called wikistats. Also adds the corresponding configuration for weekly and monthly reports. Bug: T141479 Change-Id: Ic641cc5202d7731b192765a02b02a813ce3f9fcc --- A wikistats/config.yaml A wikistats/edits A wikistats/pages_created 3 files changed, 67 insertions(+), 0 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/analytics/reportupdater-queries refs/changes/61/311961/1 diff --git a/wikistats/config.yaml b/wikistats/config.yaml new file mode 100644 index 0000000..eeef107 --- /dev/null +++ b/wikistats/config.yaml @@ -0,0 +1,33 @@ +reports: + + pages_created_weekly: + type: script + execute: pages_created + funnel: true + granularity: weeks + starts: 2001-01-14 # sunday before launch of wikipedia + lag: 86400 # wait 1 day to compute past week + + pages_created_monthly: + type: script + execute: pages_created + funnel: true + granularity: months + starts: 2001-01-01 # first day of month before launch of wikipedia + lag: 86400 # wait 1 day to compute past month + + edits_weekly: + type: script + execute: edits + funnel: true + granularity: weeks + starts: 2001-01-14 # sunday before launch of wikipedia + lag: 86400 # wait 1 day to compute week + + edits_monthly: + type: script + execute: edits + funnel: true + granularity: months + starts: 2001-01-01 # first day of month before launch of wikipedia + lag: 86400 # wait 1 day to compute past month diff --git a/wikistats/edits b/wikistats/edits new file mode 100755 index 0000000..31e6d24 --- /dev/null +++ b/wikistats/edits @@ -0,0 +1,17 @@ +#!/bin/bash +hive -e " + SELECT + '$1' as date, + page_namespace as namespace, + COUNT(*) as edits + FROM mforns.edit_history + WHERE + event_entity = 'revision' AND + event_type = 'create' AND + event_timestamp >= '$1' AND + event_timestamp < '$2' + GROUP BY + '$1', + page_namespace + ; +" 2> /dev/null | grep -v parquet.hadoop diff --git a/wikistats/pages_created b/wikistats/pages_created new file mode 100755 index 0000000..24a3b2e --- /dev/null +++ b/wikistats/pages_created @@ -0,0 +1,17 @@ +#!/bin/bash +hive -e " + SELECT + '$1' as date, + page_namespace as namespace, + COUNT(*) as pages_created + FROM mforns.edit_history + WHERE + event_entity = 'page' AND + event_type = 'create' AND + event_timestamp >= '$1' AND + event_timestamp < '$2' + GROUP BY + '$1', + page_namespace + ; +" 2> /dev/null | grep -v parquet.hadoop -- To view, visit https://gerrit.wikimedia.org/r/311961 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ic641cc5202d7731b192765a02b02a813ce3f9fcc Gerrit-PatchSet: 1 Gerrit-Project: analytics/reportupdater-queries Gerrit-Branch: master Gerrit-Owner: Mforns <mfo...@wikimedia.org> _______________________________________________ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
