Bharath Reddy Gunapati created FLINK-41221:
----------------------------------------------

             Summary: Support changelog streams in the HTTP table sink
                 Key: FLINK-41221
                 URL: https://issues.apache.org/jira/browse/FLINK-41221
             Project: Flink
          Issue Type: Sub-task
          Components: Connectors / HTTP
            Reporter: Bharath Reddy Gunapati


The HTTP table sink only accepts inserts: every row becomes a request with the 
configured {{insert-method}}. Upsert and CDC pipelines, which are common in 
Flink SQL, cannot write to it because UPDATE_BEFORE, UPDATE_AFTER and DELETE 
rows have no mapping.

h3. Proposed scope
* Declare the supported changelog modes in the sink factory and map each 
RowKind to an HTTP method and body, for example INSERT and UPDATE_AFTER to the 
insert method, DELETE to HTTP DELETE or to a configurable tombstone body, 
UPDATE_BEFORE dropped by default.
* Options to configure the method per RowKind and whether UPDATE_BEFORE is sent.
* Batch submission already groups entries by method, so mixed changelogs split 
into one request per method.

h3. Acceptance criteria
* A changelog source with inserts, updates and deletes produces the mapped 
requests; verified with an embedded server.
* Unsupported mappings fail at table validation with a clear message.
* Default behaviour for insert-only tables is unchanged.
* Documented in the table sink section with an upsert example.



--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

Reply via email to