Anomie has uploaded a new change for review.
https://gerrit.wikimedia.org/r/173336
Change subject: Copy a sanitized version of api-feature-usage
......................................................................
Copy a sanitized version of api-feature-usage
At the moment this will go into the logstash ES, but (assuming things
work out right) we'll later adjust things to push the copy into an index
in the production ES for use by the in-development
Extension:ApiFeatureUsage.
Change-Id: I9bd675282be20404c562ed772b9979eaaac6398c
---
M files/logstash/filter-mw-via-udp2log.conf
1 file changed, 15 insertions(+), 0 deletions(-)
git pull ssh://gerrit.wikimedia.org:29418/operations/puppet
refs/changes/36/173336/1
diff --git a/files/logstash/filter-mw-via-udp2log.conf
b/files/logstash/filter-mw-via-udp2log.conf
index a7cb6f0..d87330c 100644
--- a/files/logstash/filter-mw-via-udp2log.conf
+++ b/files/logstash/filter-mw-via-udp2log.conf
@@ -218,6 +218,21 @@
if [feature] == "action=query&!rawcontinue&!continue" {
drop {}
}
+
+ # Make a sanitized copy for Extension:ApiFeatureUsage
+ # @todo Logstash 1.4.x has a bug where later filter-code will not see
+ # the changes to the copied event made by clone{}, but it will be
+ # reflected in the output. If we upgrade to 1.5 and it's really fixed
+ # there, we can use prune{} to whitelist fields instead.
+ clone {
+ clones => [ "api-feature-usage-sanitized" ]
+ remove_field => [
+ # Important to remove
+ "username", "ip", "referer",
+ # Not so important, but unneeded
+ "host", "sequence_id", "wikidb", "udp_sender"
+ ]
+ }
}
} # end [type] == "api-feature-usage"
--
To view, visit https://gerrit.wikimedia.org/r/173336
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: I9bd675282be20404c562ed772b9979eaaac6398c
Gerrit-PatchSet: 1
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: Anomie <[email protected]>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
