[
https://issues.apache.org/jira/browse/NIFI-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17618805#comment-17618805
]
Chris Sampson commented on NIFI-3264:
-------------------------------------
Think this was covered by NIFI-8001 where dynamic properties were enabled as
request parameters in (most of) the Elasticsearch based processors.
The {{ScrollElasticsearchHTTP}} processor has now been deprecated in favour of
the {{SearchElasticsearch}} processor (uses the Elasticsearch REST Client for
connections and more up-to-date pagination features of Elasticsearch),
{{PaginatedJsonQueryElasticsearch}} is another alternative that uses input
FlowFiles to generate the Elasticsearch query.
> ScrollElasticsearchHTTP support for sliced scroll
> -------------------------------------------------
>
> Key: NIFI-3264
> URL: https://issues.apache.org/jira/browse/NIFI-3264
> Project: Apache NiFi
> Issue Type: Improvement
> Reporter: Josh Harrison
> Priority: Major
>
> Elasticsearch 5.x supports sliced scrolls - adding functionality to the
> ScrollElasticsearchHTTP processor to take advantage of this has the potential
> to dramatically speed up extraction of data from an ES cluster with the
> ScrollElasticsearchHTTP processor.
> This could either be an explicit processor setting, or could be the default
> behavior when increasing the threading on a ScrollElasticsearchHTTP processor.
> See for reference:
> https://www.elastic.co/guide/en/elasticsearch/reference/5.1/search-request-scroll.html#sliced-scroll
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
