Hey Iceberg Community, Here are the minutes and recording from our Iceberg Sync that took place today on *August 17th, 9am-10am PT*.
Always remember, anyone can join the discussion so feel free to share the Iceberg-Sync <https://groups.google.com/g/iceberg-sync> google group with anyone who is seeking an invite. The notes and the agenda are posted in the live doc <https://docs.google.com/document/d/1YuGhUdukLP5gGiqCbk0A5_Wifqe2CZWgOd3TbhY3UQg/edit?usp=drive_web> that's also attached to the meeting invitation and it's a good place to add items as you see fit so we can discuss them in the next community sync. Meeting Recording <https://drive.google.com/file/d/1IMnL4Bu-Nk_3PqqNx4Yp0LrZwBjCJVxf/view?usp=sharing> ⭕ - Highlights - Added a Python CLI (Thanks, Fokko!) - SnapshotProducer supports branch writes (Thanks, Namratha!) - FLIP-27 reader is supported in SQL (Thanks, Steven!) - Added job planning metrics (Thanks, Eduard!) - Spark FunctionCatalog was added (Thanks, Kyle!) - Releases - 1.0.0 - Moving forward with Spotless - Python 0.1.0 - Discussion - [Feature Proposal] metadata location provider - Details https://lists.apache.org/thread/ptdoqzzgt37hdphks0nl8oo2osmqk0zk - How does the community like the idea? Any red flag about this change? - No red flags - Considerations required for orphan file cleanup - Multiple table locations - Need to own table locations - Branch writes - CDC reads & partition stats - File sequence number / data sequence number - Delete file compaction - Equality to position - Position delete rewrites - FLIP-143 <https://cwiki.apache.org/confluence/display/FLINK/FLIP-143%3A+Unified+Sink+API> Unified Data Sink - call for review - Design Doc <https://docs.google.com/document/d/1G4O6JidAoKgbIdy8Ts73OfG_KBEMpsW-LkXIb89I5k8> - Current PR with design doc: https://github.com/apache/iceberg/pull/4904 - FLIP-191 <https://cwiki.apache.org/confluence/display/FLINK/FLIP-191%3A+Extend+unified+Sink+interface+to+support+small+file+compaction> extends to allow for small file compaction and indexing etc post-processing topology in same job - Priority based commit ordering on partitions - call for review - Proposal Doc <https://docs.google.com/document/d/1pSqxf5A59J062j9VFF5rcCpbW9vdTbBKTmjps80D-B0/edit> - Symlink Manifest API: https://github.com/apache/iceberg/pull/5516 Thank you all!
