Ottomata has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/351666 )
Change subject: Fix broken select_missing_sequence_run_query
......................................................................
Fix broken select_missing_sequence_run_query
Change-Id: Ie3bd3f7abdd52aac36fe6d2a671e7a2f234bae53
---
M hive/webrequest/select_missing_sequence_runs.hql
1 file changed, 4 insertions(+), 2 deletions(-)
Approvals:
Ottomata: Verified; Looks good to me, approved
diff --git a/hive/webrequest/select_missing_sequence_runs.hql
b/hive/webrequest/select_missing_sequence_runs.hql
index 362adf9..1f5d903 100644
--- a/hive/webrequest/select_missing_sequence_runs.hql
+++ b/hive/webrequest/select_missing_sequence_runs.hql
@@ -24,6 +24,7 @@
--
-- Usage:
-- hive -f select_missing_sequence_runs.hql \
+-- -d table_name=wmf_raw.webrequest \
-- -d webrequest_source=bits \
-- -d year=2014 \
-- -d month=7 \
@@ -31,6 +32,7 @@
-- -d hour=14
--
+ADD JAR /usr/lib/hive-hcatalog/share/hcatalog/hive-hcatalog-core.jar;
SELECT
hostname,
@@ -50,7 +52,7 @@
LEAD(dt) OVER (
PARTITION BY hostname ORDER BY sequence ASC
) AS next_dt
- FROM wmf_raw.webrequest
+ FROM ${table_name}
WHERE webrequest_source = '${webrequest_source}'
AND year=${year}
AND month=${month}
@@ -63,6 +65,6 @@
-- for those.
AND next_sequence != sequence + 1 -- This condition drops the rows
-- for which the next sequence number is as expected.
-ORDER BY hostname, missing_start
+ORDER BY hostname, before_missing
LIMIT 10000000
;
--
To view, visit https://gerrit.wikimedia.org/r/351666
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: merged
Gerrit-Change-Id: Ie3bd3f7abdd52aac36fe6d2a671e7a2f234bae53
Gerrit-PatchSet: 2
Gerrit-Project: analytics/refinery
Gerrit-Branch: master
Gerrit-Owner: Ottomata <[email protected]>
Gerrit-Reviewer: Nuria <[email protected]>
Gerrit-Reviewer: Ottomata <[email protected]>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
