Hey Iceberg Nation, Here are the meeting minutes from last few meeting's minutes. I've had some adjustments after moving on from Tabular, thanks for bearing with me.
Transcription/Recording https://youtu.be/5xkhGDfFvGU Summary 0:12 Iceberg Summit was a big success with great community participation 8:44 Planning for 1.6 release, JB volunteered as release manager 16:47 Need to clarify and document materialized views proposal 30:34 Discussed concerns around OAuth2 endpoint in REST catalog spec and need for flexibility in authentication mechanisms Iceberg Summit Recap 0:35 Twice as many talks as planned due to high interest 1:26 Videos will be posted to YouTube soon 1:17 Great sponsorship and plan to make it a yearly event Release Updates 8:49 1.5.3 patch release for Jackson issue deferred to 1.6 release 11:54 Milestone for 1.6 release to be created to track issues Java Highlights 2:30 Rev API fixes moved out of Gradle 4:12 Connection retries added to JDBC catalog 4:39 Bloom filter sensitivity configuration added 4:47 Support for partitioning by UUID 5:12 Coercing underlying Parquet types Python Highlights 5:43 Entire logic fixes 5:55 Reading tables from Glue catalog 6:00 Initial manifest table implementation 6:09 Hierarchical SQL catalog namespaces 6:21 Categorical type support Rust Highlights 6:42 Inclusive metrics evaluator progress 7:05 File predicate pushdown to Arrow reader 6:36 Expression support added Go Highlights 8:01 Expression and literal support added Materialized Views Proposal 16:47 Need to document current state and next decision points 16:47 Separate meeting to discuss storage approach details REST Catalog Security 30:34 Discussed concerns around OAuth2 endpoint specification 30:34 Need to clarify intent and optionality 30:34 Potentially remove endpoint and rely on client config 30:34 Ensure flexibility for different authentication flows Notes * Highlights * Iceberg Summit 🎉 (Videos [@ApacheIceberg]( https://www.youtube.com/@ApacheIceberg) YouTube later today) * Java * Moved RevAPI outside of Gradle, to unblock Gradle upgrades ([#10386]( https://github.com/apache/iceberg/pull/10386)) (Thanks JB!) * Core: Retry connections in JDBC catalog with user configured error code list ([#10140](https://github.com/apache/iceberg/pull/10140)) (Thanks Amogh Jahagirdar!) * Parquet: Add Bloom filter FPP config ([#10149]( https://github.com/apache/iceberg/pull/10149)) (Thanks Huaxin Gao!) * Spark: Fix issue when partitioning by UUID ([#8250]( https://github.com/apache/iceberg/pull/8250)) (Thanks Eduard Tudenhoefner!) * Spark: Coerce shorts and bytes into ints in Parquet Writer ([#10349]( https://github.com/apache/iceberg/pull/10349)) (Thanks Shardul Mahadik) * Add REST Catalog Iceberg Views to Trino ([trinodb/trino#19818]( https://github.com/trinodb/trino/pull/19818)) * Python * Hive catalog: Add retry logic for hive locking ([#701]( https://github.com/apache/iceberg-python/pull/701)) (Thanks frankliee!) * Glue: register table using iceberg metadata file via pyiceberg ([#711](https://github.com/apache/iceberg-python/pull/711)) (Thanks Mehul Batra!) * Initial implementation of the manifest table ([#717]( https://github.com/apache/iceberg-python/pull/717)) (Thanks Drew Gallardo!) * Introduce hierarchical namespaces into SqlCatalog ([#591]( https://github.com/apache/iceberg-python/pull/591)) (Thanks Eric L!) * Add support for Arrow categorical type ([#693]( https://github.com/apache/iceberg-python/pull/693)) (Thanks Sung!) * Rust * Implement InclusiveMetricsEvaluator ([#347]( https://github.com/apache/iceberg-rust/pull/347)) (Thanks Scott!) * Push down predicate into Parquet reader ([#295]( https://github.com/apache/iceberg-rust/pull/295)) (Thanks Liang-Chi) * Go * Add Literals ([#76](https://github.com/apache/iceberg-go/pull/76/)) (Thanks, Matt!) * Releases * 1.5.3 Release? * Prevent deadlock in Jackson [#10379]( https://github.com/apache/iceberg/pull/10379) * 1.6.0 Release target date? * June 2024 * Discussion ([all proposals]( https://github.com/apache/iceberg/labels/proposal)) * Materialized Views ([#10043]( https://github.com/apache/iceberg/issues/10043)) * REST Topics / Status Updates * Security questions raised on [the mailing list]( https://lists.apache.org/thread/twk84xx7v0xy5q5tfd9x5torgr82vv50) * (Pre)Plan Endpoints ([#9695]( https://github.com/apache/iceberg/pull/9695)) * Append Endpoints ([#10202]( https://github.com/apache/iceberg/pull/10202)) * Server Capabilities ([#9940]( https://github.com/apache/iceberg/pull/9940)) * Client-side purge in REST catalog ([#10089]( https://github.com/apache/iceberg/issues/10089)) * SQL UDFs [mailing list discussion]( https://lists.apache.org/thread/gzofnqqpq5m0cjpts8z5k9rkz4y8gv10) * Access decision exchange ([#10395]( https://github.com/apache/iceberg/issues/10395)) * Go Over Geo Proposal [#10260]( http://github.com/apache/iceberg/issues/10260) * Variant Data Type Proposal [#10392]( https://github.com/apache/iceberg/issues/10392)
