Can someone confirm if there's any way I can set
"validate_from_snapshot_id" for iceberg merge query? By default it picks up
the latest snapshot id of a table, but as I have a multi step process (
merge being the last step ), I want to set this explicitly.  Was expecting
to set this as options as part of mergeinto dataframe api, but don't see
that option. I have tried setting this in sql conf for current thread but
this doesn't work. Upon debugging more, I could see that this is only read
from write conf only for certain actions like overwrite partitions, dynamic
overwrite etc. Is there no absolute way to achieve this for merge query/api?

Reply via email to