Hi, all. Currently, every Fluss lake table is automatically provisioned with three mandatory system columns, __bucket , __offset , __timstamp (intended for bucket and offset-based subscription as well as addition informartion check). While originally designed to allow clients to pinpoint specific data offsets of specific buckets, the practical evolution of the ecosystem has rendered this default behavior suboptimal for the dowstream since the dowstream warehouse or BI tools do not expect these internal metadata fields.
So, I'd like to propose FIP-27: Remove Mandatory System Columns From Fluss Lake Tables [1] to remove the three mandatory system columns while still keep compability. Welcome your feedback and suggestions on this proposal. Looking forward to a productive discussion! [1]: https://cwiki.apache.org/confluence/display/FLUSS/FIP-27%3A+Remove+Mandatory+System+Columns+From+Fluss+Lake+Tables Best regards, Yuxia
