Hi Y'all, We've been working on a new proposal to add Row Lineage to Iceberg in the V3 Spec. The general idea is to give every row a unique identifier as well as a marker of what version of the row it is. This should let us build a variety of features related to CDC, Incremental Processing and Audit Logging. If you are interested please check out the linked proposal below. This will require compliance from all engines to be really useful so It's important we come to consensus on whether or not this is possible.
https://docs.google.com/document/d/146YuAnU17prnIhyuvbCtCtVSavyd5N7hKryyVRaFDTE/edit?usp=sharing Thank you for your consideration, Russ
