[ 
https://issues.apache.org/jira/browse/FLUME-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13807038#comment-13807038
 ] 

Hari Shreedharan commented on FLUME-2220:
-----------------------------------------

[~dib.ghosh] - Unfortunately, the author himself has to attach the patch to the 
jira, since that is what grants the ASF the license to include the patch in ASF 
projects. 

[~rore] - Please attach the patch to this jira

> ElasticSearch sink - duplicate fields in indexed document
> ---------------------------------------------------------
>
>                 Key: FLUME-2220
>                 URL: https://issues.apache.org/jira/browse/FLUME-2220
>             Project: Flume
>          Issue Type: Bug
>    Affects Versions: v1.4.0
>            Reporter: Rotem Hermon
>            Priority: Minor
>              Labels: ElasticSearch, sink
>             Fix For: v1.5.0
>
>
> The default serializer for the ElasticSearch sink 
> (ElasticSearchLogStashEventSerializer) duplicates fields that are mapped to 
> default logstash fields.
> For instance timestamp, source, host. Those appear both as logstash fields 
> ("@timestamp", "@source_host" etc.), and both as fields under the @fields 
> ("@fields.timestamp", "@fields.host").
> When inserting a field from the headers as a logstash system field it should 
> be removed from the dictionary so it wouldn't get written again under the 
> "@fields" field.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Reply via email to