e-rudic opened a new issue, #6488:
URL: https://github.com/apache/iceberg/issues/6488

   ### Query engine
   
   Spark
   Flink
   
   ### Question
   
   Hello,
   
   according to the Iceberg documentation for Flink to be able to perform 
upsert operation on the table primary key needs to be defined like this:
   ` PRIMARY KEY(`id`) NOT ENFORCED
   `
   
   However Spark DDL does not support this kind of syntax. Furthermore, as 
stated in [this 
comment](https://github.com/apache/iceberg/issues/5069#issuecomment-1215041789) 
primary keys as stored as equality keys and used in upsert operation. 
[Specs](https://iceberg.apache.org/spec/#manifests) define that equality_ids 
are part of the manifest files and not a table property.
   
   How can one set table's equality keys using Spark so that Flink can be able 
to upsert data into it?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to