EBernhardson has uploaded a new change for review.
https://gerrit.wikimedia.org/r/298242
Change subject: logstash: Normalize a few more fields
......................................................................
logstash: Normalize a few more fields
Various fields are showing up in logstash that do not have the same
mapping from different sources. For elasticsearch 2.x this is a strict
requirement.
Normalize varied fields to a string which wastes a little space but allows
everything to live together in harmony. Normalize fields which are
always ints, but are sometimes sent in the json quoted to integer.
Change-Id: Iaf0b595fad0bc677cb49e3cc56edb337f50c44b8
---
M files/logstash/filter-normalize_fields.conf
1 file changed, 4 insertions(+), 0 deletions(-)
git pull ssh://gerrit.wikimedia.org:29418/operations/puppet
refs/changes/42/298242/1
diff --git a/files/logstash/filter-normalize_fields.conf
b/files/logstash/filter-normalize_fields.conf
index 9e992e5..b14dd5f 100644
--- a/files/logstash/filter-normalize_fields.conf
+++ b/files/logstash/filter-normalize_fields.conf
@@ -3,6 +3,10 @@
convert => {
"pid" => "integer"
"line" => "integer"
+ "oldId" => "integer"
+ "code" => "string"
+ "status" => "string"
+ "err_code" => "string"
}
remove_field => [ "timestamp" ]
}
--
To view, visit https://gerrit.wikimedia.org/r/298242
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: Iaf0b595fad0bc677cb49e3cc56edb337f50c44b8
Gerrit-PatchSet: 1
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: EBernhardson <[email protected]>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
