Samir Desai created FLINK-11747:
-----------------------------------
Summary: Elasticsearch6 - Expose RestHighLevelClient to allow for
custom sniffing
Key: FLINK-11747
URL: https://issues.apache.org/jira/browse/FLINK-11747
Project: Flink
Issue Type: Wish
Components: ElasticSearch Connector
Reporter: Samir Desai
In the Elasticsearch6 connector, the
[RestClientFactory|https://github.com/apache/flink/blob/release-1.6/flink-connectors/flink-connector-elasticsearch6/src/main/java/org/apache/flink/streaming/connectors/elasticsearch6/RestClientFactory.java#L31]
allows users to customize the {{RestClientBuilder}}. However, certain
customizations like adding
[Sniffing|https://www.elastic.co/guide/en/elasticsearch/client/java-rest/master/_usage.html]
require access to the low-level rest client, which can be obtained through the
high level rest client. The {{RestHighLevelClient}} is
[instantiated|https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-elasticsearch-base/src/main/java/org/apache/flink/streaming/connectors/elasticsearch/ElasticsearchSinkBase.java#L191]
in the api call bridge, and is never exposed to the user.
To my knowledge, the current Elasticsearch6 connector does not utilize sniffing
or provide a way to add it in. The Elasticsearch6 connector should expose some
type of access to the RestHighLevelClient to allow for custom sniffing.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)