Julian Dimitrov created FLINK-38962:
---------------------------------------
Summary: Add OpenSearch 3.x connector support
Key: FLINK-38962
URL: https://issues.apache.org/jira/browse/FLINK-38962
Project: Flink
Issue Type: Improvement
Components: Connectors / Opensearch
Reporter: Julian Dimitrov
h2. Summary
Add support for OpenSearch 3.x to the Flink OpenSearch connector, using the new
opensearch-java client.
h2. Motivation
OpenSearch 3.0 was released and introduces breaking changes, including the
deprecation of the rest-high-level-client in favor of the new opensearch-java
client. Users running OpenSearch 3.x clusters cannot use the existing connector
modules.
h2. Implementation
This PR adds three new modules:
* *flink-connector-opensearch3* - Core connector using opensearch-java client
* *flink-connector-opensearch3-e2e-tests* - End-to-end integration tests
* *flink-sql-connector-opensearch3* - SQL/Table API support
h3. Key Changes:
* New {{Opensearch3Sink}} and {{Opensearch3Writer}} using the opensearch-java
client
* Custom {{BulkOperation}} wrapper for serializable bulk operations
* Integration tests with OpenSearch 3.0.0 container
* Proper dependency management for httpclient5/httpcore5
h2. Compatibility
* Requires JDK 11+
* Compatible with Flink 2.x
* Uses opensearch-java client 3.0.0
h2. Testing
* Unit tests for all new components
* Integration tests using Testcontainers with OpenSearch 3.0.0 image
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
