Bharath Reddy Gunapati created FLINK-41221:
----------------------------------------------
Summary: Support changelog streams in the HTTP table sink
Key: FLINK-41221
URL: https://issues.apache.org/jira/browse/FLINK-41221
Project: Flink
Issue Type: Sub-task
Components: Connectors / HTTP
Reporter: Bharath Reddy Gunapati
The HTTP table sink only accepts inserts: every row becomes a request with the
configured {{insert-method}}. Upsert and CDC pipelines, which are common in
Flink SQL, cannot write to it because UPDATE_BEFORE, UPDATE_AFTER and DELETE
rows have no mapping.
h3. Proposed scope
* Declare the supported changelog modes in the sink factory and map each
RowKind to an HTTP method and body, for example INSERT and UPDATE_AFTER to the
insert method, DELETE to HTTP DELETE or to a configurable tombstone body,
UPDATE_BEFORE dropped by default.
* Options to configure the method per RowKind and whether UPDATE_BEFORE is sent.
* Batch submission already groups entries by method, so mixed changelogs split
into one request per method.
h3. Acceptance criteria
* A changelog source with inserts, updates and deletes produces the mapped
requests; verified with an embedded server.
* Unsupported mappings fail at table validation with a clear message.
* Default behaviour for insert-only tables is unchanged.
* Documented in the table sink section with an upsert example.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)