BryanDavis has uploaded a new change for review. https://gerrit.wikimedia.org/r/173209
Change subject: logstash: Use doc_values for normalized_message.raw ...................................................................... logstash: Use doc_values for normalized_message.raw Change the default mapping to store the normalized_message.raw field using the doc_values fielddata option which avoids loading values into memory. This change had previously been applied to all .raw mappings as shown in <https://phabricator.wikimedia.org/P57> but that was found to cause issues when the field contained >32k bytes. Bug: T1269 Change-Id: I6d421c2a8537395821116e238a9338420b0fbec6 --- M modules/logstash/files/elasticsearch-template.json 1 file changed, 15 insertions(+), 0 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/09/173209/1 diff --git a/modules/logstash/files/elasticsearch-template.json b/modules/logstash/files/elasticsearch-template.json index a3842dc..91fff22 100644 --- a/modules/logstash/files/elasticsearch-template.json +++ b/modules/logstash/files/elasticsearch-template.json @@ -53,6 +53,21 @@ "index" : "analyzed", "omit_norms" : true }, + "normalized_message" : { + "type": "multi_field", + "fields": { + "raw": { + "type": "string", + "index": "no", + "fielddata": { "format": "doc_values" } + }, + "normalized_message": { + "index" : "analyzed", + "omit_norms" : true, + "type" : "string" + } + } + }, "sequence_id" : { "type": "long" }, "tags" : { "type" : "string", -- To view, visit https://gerrit.wikimedia.org/r/173209 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I6d421c2a8537395821116e238a9338420b0fbec6 Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: BryanDavis <[email protected]> _______________________________________________ MediaWiki-commits mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
