[ 
https://issues.apache.org/jira/browse/FLINK-26539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17512063#comment-17512063
 ] 

Zhenqiu Huang commented on FLINK-26539:
---------------------------------------

[~martijnvisser] [~ym]

What jean want to achieve is to prevent insert null fields into cassandra table 
sink. Inserting a null value creates a tombstone. Tombstone needs to be 
prevented due to these reason.

1. Tombstone take up space and can substantially increase the amount of storage 
you require.
2. Querying tables with a large number of tombstones causes performance 
problems and it causes Latency and heap pressure.

In the implementation, Jean used an operator to mark out null field as 
NON_PRESENT explicitly. I think we need a smarter way to identify what are 
those null fields in a Row, so that the compact CQL can be generated 
accordingly. 



> Support dynamic partial features update in Cassandra connector
> --------------------------------------------------------------
>
>                 Key: FLINK-26539
>                 URL: https://issues.apache.org/jira/browse/FLINK-26539
>             Project: Flink
>          Issue Type: New Feature
>          Components: Connectors / Cassandra
>            Reporter: Zhenqiu Huang
>            Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to