Joseph Gresock created NIFI-2417:
------------------------------------
Summary: Implement Query and Scroll processors for ElasticSearch
Key: NIFI-2417
URL: https://issues.apache.org/jira/browse/NIFI-2417
Project: Apache NiFi
Issue Type: New Feature
Components: Extensions
Affects Versions: 1.0.0
Reporter: Joseph Gresock
Assignee: Joseph Gresock
Priority: Minor
FetchElasticsearchHttp allows users to select a single document from
Elasticsearch in NiFi, but there is no way to run a query to retrieve multiple
documents.
We should add a QueryElasticsearchHttp processor for running a query and
returning a flow file per result, for small result sets. This should allow
both input and non-input execution.
A separate ScrollElasticsearchHttp processor would also be useful for scrolling
through a huge result set. This should use the state manager to maintain the
scroll_id value, and use this as input to the next scroll page. As a result,
this processor should not allow flow file input, but should retrieve one page
per run.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
