Thanks again to Ryan for preparing the report! +1 on adding *Flink: Introduced support for regular data file compaction, snapshot expiration, and orphan file cleanup*
Really appreciate the rollout of this feature — it brings tangible improvements to data file management and performance optimization. Best, Shilun Fan On Thu, Oct 9, 2025 at 4:44 PM Péter Váry <[email protected]> wrote: > Thanks Ryan for preparing the report! > > Maybe add: > - Flink: Introduced support for regular data file compaction, snapshot > expiration, and orphan file cleanup. > > Renjie Liu <[email protected]> ezt írta (időpont: 2025. okt. 9., > Cs, 8:50): > >> Hi, Ryan: >> >> The rust part looks good to me. >> >> On Thu, Oct 9, 2025 at 5:15 AM Steven Wu <[email protected]> wrote: >> >>> > Flink: Merged dynamic sync supporting multiple tables and schema >>> evolution >>> >>> Typo: dynamic sync -> dynamic sink >>> >>> We can also add this bullet for Flink >>> * Flink: add support for Flink 2.0 >>> >>> On Wed, Oct 8, 2025 at 2:08 PM Ryan Blue <[email protected]> wrote: >>> >>>> Hi everyone, >>>> >>>> Here is my initial draft for the October report. As usual, if you have >>>> anything to add or highlight, please reply. >>>> >>>> Ryan >>>> Description: >>>> >>>> Apache Iceberg is a table format for huge analytic datasets that is >>>> designed >>>> for high performance and ease of use. >>>> Project Status: >>>> >>>> Current project status: Ongoing >>>> Issues for the board: None >>>> Membership Data: >>>> >>>> Apache Iceberg was founded 2020-05-19 (5 years ago) >>>> There are currently 35 committers and 21 PMC members in this project. >>>> The Committer-to-PMC ratio is 5:3. >>>> >>>> Community changes, past quarter: >>>> >>>> - No new PMC members. Last addition was Amogh Jahagirdar on >>>> 2024-08-12. >>>> - Prashant Singh was added as committer on 2025-07-21 >>>> >>>> Project Activity: >>>> >>>> Releases: >>>> >>>> - C++ 0.1.0: 2025-09-15 >>>> - 1.10.0: 2025-09-11 >>>> - PyIceberg 0.10.0: 2025-09-11 >>>> - Rust 0.6.0: 2025-07-30 >>>> - 1.9.2: 2025-07-18 >>>> - Rust 0.5.1: 2025-05-31 >>>> - Go 0.3.0: 2025-05-29 >>>> >>>> v4 Spec: >>>> >>>> - Making progress on designs for relative paths, columnar stats, >>>> Parquet >>>> metadata, and adaptive metadata tree proposals. >>>> - Working on prototype implementations of new metadata >>>> >>>> REST catalog spec: >>>> >>>> - Implementation of server-side planning progressing >>>> - Consensus on a design for /events endpoint >>>> - Discussing fine-grained access control decisions from loadTable >>>> - Ongoing collaboration on SQL UDF support >>>> - Adding idempotency tokens to recover from transient errors >>>> - Added REST spec to iceberg.apache.org >>>> >>>> Java: >>>> >>>> - Ongoing work to build an API for plugging in new file formats >>>> - Fixed dropping columns referenced by stale partition fields >>>> - Fixed column metrics limits with nested structs >>>> - Committed manifest list encryption >>>> - Spark: Added support for Spark 4, with row lineage metadata and >>>> variants >>>> - Flink: Merged dynamic sync supporting multiple tables and schema >>>> evolution >>>> - Flink: Added row lineage readers >>>> - Added Google Auth support >>>> >>>> Python: >>>> >>>> - Added support for writing to branches >>>> - Working on v3 implementation >>>> - Added DataFusion integration >>>> - Moving some functionality to iceberg-rust >>>> - Added custom AuthManager support >>>> - Added ADLS support >>>> >>>> Rust: >>>> >>>> - Working on v3 implementation >>>> - Added support for positional deletes, parsing equality deletes >>>> - Added metadata tables for DataFusion >>>> - Improved DataFusion write support >>>> - Added REST catalog loader and builder >>>> - Added registerTable support for REST catalog >>>> - Added retry logic for transactions >>>> >>>> Go: >>>> >>>> - Enabled Iceberg/Spark integration tests >>>> - Added support for v3 manifests >>>> - Added fanout partition writer and rolling data writer >>>> >>>> C++: >>>> >>>> - First C++ release! >>>> >>>> Community Health: >>>> >>>> The initial C++ release highlights that the community continues to >>>> expand with >>>> new languages and contributors interested in those implementations. The >>>> community is also collaborating on the next iteration of the Iceberg >>>> spec. >>>> Metrics also indicate general community health. >>>> >>>
