Mukul Jain created NIFI-13678:
---------------------------------
Summary: ConsumeElasticSearch Processor giving full output inspite
of populating specific "Fields" in the properties
Key: NIFI-13678
URL: https://issues.apache.org/jira/browse/NIFI-13678
Project: Apache NiFi
Issue Type: Bug
Components: Core Framework
Affects Versions: 1.27.0
Environment: Dev
Reporter: Mukul Jain
Hi,
My ElasticSearch document looks like this:
'''
{
"_index": "registered_user",
"_id": "TymgdJEBFuEeXxQJEGRX",
"_version": 1,
"_score": 0,
"_source": {
"@timestamp": "2024-08-21T11:08:52.579701166Z",
"event": {
"original": "\{\"id\": \"9U9UWHHC6RLL9LGA9\", \"name\": \"Dakota Wilson\",
\"age\": 48, \"ts\": 723956240.4317286}"
},
"@version": "1",
"message": "\{\"id\": \"9U9UWHHC6RLL9LGA9\", \"name\": \"Dakota Wilson\",
\"age\": 48, \"ts\": 723956240.4317286}"
},
"fields": {
"@timestamp": [
"2024-08-21T11:08:52.579Z"
],
"event.original": [
"\{\"id\": \"9U9UWHHC6RLL9LGA9\", \"name\": \"Dakota Wilson\", \"age\": 48,
\"ts\": 723956240.4317286}"
],
"event.original.keyword": [
"\{\"id\": \"9U9UWHHC6RLL9LGA9\", \"name\": \"Dakota Wilson\", \"age\": 48,
\"ts\": 723956240.4317286}"
],
"message.keyword": [
"\{\"id\": \"9U9UWHHC6RLL9LGA9\", \"name\": \"Dakota Wilson\", \"age\": 48,
\"ts\": 723956240.4317286}"
],
"@version": [
"1"
],
"@version.keyword": [
"1"
],
"message": [
"\{\"id\": \"9U9UWHHC6RLL9LGA9\", \"name\": \"Dakota Wilson\", \"age\": 48,
\"ts\": 723956240.4317286}"
]
}
}
'''
I am using ConsumeElasticsearch 1.27.0 processor to extract records. I want to
extract only certain fields. For that, I mentioned Fields: ["_id","message"]in
the fields property of the processor.
However, on running, the processor is giving full output instead of only
mentioned fields.
Can you please help?
--
This message was sent by Atlassian Jira
(v8.20.10#820010)