[
https://issues.apache.org/jira/browse/FLINK-38962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated FLINK-38962:
-----------------------------------
Labels: pull-request-available (was: )
> Add OpenSearch 3.x connector support
> ------------------------------------
>
> Key: FLINK-38962
> URL: https://issues.apache.org/jira/browse/FLINK-38962
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / Opensearch
> Reporter: Julian Dimitrov
> Priority: Major
> Labels: pull-request-available
>
> h2. Summary
> Add support for OpenSearch 3.x to the Flink OpenSearch connector, using the
> new opensearch-java client.
> h2. Motivation
> OpenSearch 3.0 was released and introduces breaking changes, including the
> deprecation of the rest-high-level-client in favor of the new opensearch-java
> client. Users running OpenSearch 3.x clusters cannot use the existing
> connector modules.
> h2. Implementation
> This PR adds three new modules:
> * *flink-connector-opensearch3* - Core connector using opensearch-java client
> * *flink-connector-opensearch3-e2e-tests* - End-to-end integration tests
> * *flink-sql-connector-opensearch3* - SQL/Table API support
> h3. Key Changes:
> * New {{Opensearch3Sink}} and {{Opensearch3Writer}} using the opensearch-java
> client
> * Custom {{BulkOperation}} wrapper for serializable bulk operations
> * Integration tests with OpenSearch 3.0.0 container
> * Proper dependency management for httpclient5/httpcore5
> h2. Compatibility
> * Requires JDK 11+
> * Compatible with Flink 2.x
> * Uses opensearch-java client 3.0.0
> h2. Testing
> * Unit tests for all new components
> * Integration tests using Testcontainers with OpenSearch 3.0.0 image
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
