[
https://issues.apache.org/jira/browse/NIFI-11686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17844450#comment-17844450
]
Chris Sampson commented on NIFI-11686:
--------------------------------------
I upgraded the Eliastcsearch (low-level) REST Client library to {{8.13.3}} and
confirmed that various NiFi Elasticsearch components work against a local
Elasticsearch instance (hosted in Docker) - [^NiFi_Flow-2.json].
Confirmed the NiFi Elasticsearch {{integration-tests}} work with the upgraded
dependency version (against Elasticsearch {{8.13.3}} and {{7.17.21}} - Elastic
continue to support the latest minor/patch version of the last major release).
Created an AWS OpenSearch Domain (Free-Tier single instance}) version {{2.11}
with a {{master user}} (username & password for {{BASIC}} auth) and selected
the {{Only use fine-grained access control}} security setting with {{Public
access}} - i.e. the Domain was available to access over the internet (so I
could connect from my laptop) and the BASIC-Auth'd user was allowed to perform
all actions within the Domain (N.B. it appears the AWS OpenSearch defaults are
to only allow access from within a VPC and Deny all permissions by defualt -
which makes a lot of sense, but isn't what I wanted here). I was then able to
use the same Flow to {{Verify}} the {{ElasticsearchClientSerice}} controller
service and run the same set of processors as for Elasticsearch {{8.13.1}} -
[^NiFi_Flow-2-OpenSearch.json].
So it would appear that the previous move to using the Elasticsearch low-level
REST Client (rather than the high-level REST client that was originally part of
the NiFi components) means that the upgrade to the most recent client libraries
*doesn't* break use of non-Elastic services!
The only thing I couldn't do was use a {{Point in Time}} ({{_pit}}) search type
for pagination (as that's an Elastic XPack feature), so I've updated the NiFi
docs to indicate that PiT is not available for AWS OpenSearch.
> Update elasticsearch.client.version to 7.17.10
> ----------------------------------------------
>
> Key: NIFI-11686
> URL: https://issues.apache.org/jira/browse/NIFI-11686
> Project: Apache NiFi
> Issue Type: Improvement
> Affects Versions: 1.22.0
> Reporter: Mike R
> Assignee: Chris Sampson
> Priority: Major
> Attachments: NiFi_Flow-2-OpenSearch.json, NiFi_Flow-2.json
>
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> Update elasticsearch.client.version to 7.17.10
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
