Chris Sampson created NIFI-12063:
------------------------------------
Summary: Paginated Elasticsearch processors do not pass Dynamic
Properties as Request Parameters for SCROLL pagination
Key: NIFI-12063
URL: https://issues.apache.org/jira/browse/NIFI-12063
Project: Apache NiFi
Issue Type: Bug
Affects Versions: 1.23.2
Reporter: Chris Sampson
Fix For: 1.latest, 2.latest
Dynamic Properties added to the Paginated Elasticsearch processors are meant to
be used as Request Parameters when searching Elasticsearch.
This *does* happen, *except* for subsequent pages of a *SCROLL* type query.
This is because the [Elasticsearch Scroll
API|https://www.elastic.co/guide/en/elasticsearch/reference/current/scroll-api.html]
does not accept such request parameters.
NiFi should clarify this in its documentation for users. NiFi users can easily
change to using SEARCH_AFTER or POINT_IN_TIME (requires Elasticsearch 7.10+ and
X-Pack) instead of SCROLL, where the Request Parameters are used for every call
to the [Elasticsearch Search
API|https://www.elastic.co/guide/en/elasticsearch/reference/current/search-search.html].
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
