Re: Iceberg table maintenance

2024-04-11 Thread Brian Olsen
Hey everyone, Following up from this meeting, we decided due to the distributed nature of everyone involved on Flink, it would be best to achieve consensus on some critical points that Péter outlined for us. - Do you have concerns with the Maintenance Tasks execution infrastructure? The

Iceberg Summit CfP closes tomorrow night!

2024-04-11 Thread Ryan Blue
Hi everyone, If you've been putting off submitting your talk for Iceberg Summit until the last minute, it's time! The call for proposals ends tomorrow at midnight. You can submit here: https://sessionize.com/Iceberg-Summit-2024 Ryan -- Ryan Blue Tabular

RE: Flink table maintenance

2024-04-11 Thread ismail simsek
- Technically would it be possible not to force partition cols into the PK? I believe this is possible, but probably less performant. It is mentioned in the docs https://iceberg.apache.org/spec/#scan-planning >From the documentation: "An equality delete file must be applied to a data file when

RE: Iceberg table maintenance

2024-04-11 Thread wenjin
Hi Peter, I am interested in your proposal and have clarified some confusions with your help in Flink community, thanks for your answers. I participated in yesterday’s discussion, but since I am not a native English speaker, I am concerned that I may have missed some details regarding the