I am using Flume to post data to ElasticSearch. When the data is xml it
works fine. But when the data is json it is loading incorrect data in the
message field.I checked the flume code. It looks like the issue may be with
the elasticsearch code XContentBuilder.
Instead of JSON message it is storing message data as
"org.elasticsearch.common.xcontent.XContentBuilder@32f4122e"
I tried using the DynamicSerializer and
ElasticSearchIndexRequestBuilderFactory but no luck.
Here is the sample data posted on Elastic Search when the data loaded is
JSON.
{
"_index": "test_flume-2014-04-07",
"_type": "logs",
"_id": "M9E-33RQTy2kA6QhW6mSUw",
"_score": null,
"_source": {
"@message": "org.elasticsearch.common.xcontent.XContentBuilder@58bf76d2",
"@timestamp": "2014-04-07T09:49:26.490Z",
"@fields": {
"timestamp": "1396864166490"
}
},
"sort": [
1396864166490,
1396864166490
]
--
Deepak Subhramanian
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CA%2BUubig41Nk%3DDkXK3H5WL8ceKHrEp%2B8%2BtQvFDDTq9Lz0Sa5ohA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
