[
https://issues.apache.org/jira/browse/FLUME-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13702095#comment-13702095
]
Edward Sargisson commented on FLUME-2099:
-----------------------------------------
Umm... no.
The Flume ElasticSearchSink aims to write to elasticsearch in exactly the same
way that logstash does. It currently does this by writing the logstash v0
schema.
Jordan Sissel, the logstash maintainer, has spent a lot of time logging with
elasticsearch and now has a shiny new improved schema that is more
storage-efficient and works better with the log viewing tool (Kibana) by not
prefixing everything with `@`.
This story is update the Flume ElasticSearchSink to write the logstash v1
schema (as well as logstash v0) so that users can decide to use either logstash
or Flume as their needs require.
> Add serializer to ElasticSearchSink for new logstash v1 format
> --------------------------------------------------------------
>
> Key: FLUME-2099
> URL: https://issues.apache.org/jira/browse/FLUME-2099
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: v1.4.0
> Reporter: Edward Sargisson
>
> The logstash maintainer has implemented an improved message schema for
> elasticsearch which he plans to deploy in the next version
> https://logstash.jira.com/browse/LOGSTASH-675
> The ElasticSearchSink aims to allow users to write just as if logstash does -
> largely so Kibana can work. A serializer should be added to allow the new
> format to be used.
> Benefits (from the logstash work item):
> * kibana isn't polluted with "@" symbols everywhere
> * most relevant data is in 'event fields' which is now top-level, no
> longer "@fields.somefield"
> * fewer "required" event fields.
> * the 'json' input format can go away or generally mean the same thing as
> json_event
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
