huaxingao commented on code in PR #14055: URL: https://github.com/apache/iceberg/pull/14055#discussion_r2342368910
########## site/docs/releases.md: ########## @@ -69,132 +70,132 @@ To add a dependency on Iceberg in Maven, add the following to your `pom.xml`: ### 1.10.0 release -Apache Iceberg 1.10.0 was released on September ??, 2025. +Apache Iceberg 1.10.0 was released on September 11, 2025. The 1.10.0 release contains bug fixes and new features. For full release notes visit [Github](https://github.com/apache/iceberg/releases/tag/apache-iceberg-1.10.0) * Deprecation / End of Support - - Flink: Remove Flink 1.18 support ([\#12527](https://github.com/apache/iceberg/pull/12527)) - - Common: Remove public visibility for deprecated methods in DynConstructors and DynMethods since 1.7.0 ([\#13053](https://github.com/apache/iceberg/pull/13053)) - - AWS, Core, Flink, Parquet: Remove deprecations targeted for 1.10.0 ([\#12909](https://github.com/apache/iceberg/pull/12909)) + - Flink: Remove Flink 1.18 support ([\#12527](https://github.com/apache/iceberg/pull/12527)) + - Common: Remove public visibility for deprecated methods in DynConstructors and DynMethods since 1.7.0 ([\#13053](https://github.com/apache/iceberg/pull/13053)) + - AWS, Core, Flink, Parquet: Remove deprecations targeted for 1.10.0 ([\#12909](https://github.com/apache/iceberg/pull/12909)) * Behavior change - - Hive: Throw NoSuchNamespaceException when listing a non-exist namespace ([\#13130](https://github.com/apache/iceberg/pull/13130)). + - Hive: Throw NoSuchNamespaceException when listing a non-exist namespace ([\#13130](https://github.com/apache/iceberg/pull/13130)). Previously, an empty list was returned. - - Core: fix spec non-confirming field ids for partition stats files ([\#13329](https://github.com/apache/iceberg/pull/13329)) + - Core: fix spec non-confirming field ids for partition stats files ([\#13329](https://github.com/apache/iceberg/pull/13329)) * Spec - - Table: Clarify write requirement to prevent orphaned DVs ([\#13042](https://github.com/apache/iceberg/pull/13042)) - - Table: Clarify behavior of special geo objects for lower and upper bounds ([\#12956](https://github.com/apache/iceberg/pull/12956)) - - Table: Add encryption keys ([\#12162](https://github.com/apache/iceberg/pull/12162)) - - Table: Avoid struct field conflicts in default values ([\#12841](https://github.com/apache/iceberg/pull/12841)) - - REST: Add row lineage fields ([\#13010](https://github.com/apache/iceberg/pull/13010)) - - REST: Add encryption keys ([\#12987](https://github.com/apache/iceberg/pull/12987)) - - REST: remove update to enable row lineage as it is always on for V3 table ([\#12986](https://github.com/apache/iceberg/pull/12986)) - - REST: mark 503 as non retryable ([\#13619](https://github.com/apache/iceberg/pull/13619)) + - Table: Clarify write requirement to prevent orphaned DVs ([\#13042](https://github.com/apache/iceberg/pull/13042)) + - Table: Clarify behavior of special geo objects for lower and upper bounds ([\#12956](https://github.com/apache/iceberg/pull/12956)) + - Table: Add encryption keys ([\#12162](https://github.com/apache/iceberg/pull/12162)) + - Table: Avoid struct field conflicts in default values ([\#12841](https://github.com/apache/iceberg/pull/12841)) + - REST: Add row lineage fields ([\#13010](https://github.com/apache/iceberg/pull/13010)) + - REST: Add encryption keys ([\#12987](https://github.com/apache/iceberg/pull/12987)) + - REST: remove update to enable row lineage as it is always on for V3 table ([\#12986](https://github.com/apache/iceberg/pull/12986)) + - REST: mark 503 as non retryable ([\#13619](https://github.com/apache/iceberg/pull/13619)) * API - - Add table metadata keys for encryption ([\#12927](https://github.com/apache/iceberg/pull/12927)) - - Add deleteFile to RowDelta API ([\#12861](https://github.com/apache/iceberg/pull/12861)) - - Expose cleanExpiredMetadata in ExpireSnapshots ([\#13509](https://github.com/apache/iceberg/pull/13509)) - - Preserve original type for upper/lower bounds in metrics ([\#13695](https://github.com/apache/iceberg/pull/13695)) - - Fix timestamp(9) with identity partitioning ([\#13746](https://github.com/apache/iceberg/pull/13746)) - - Add expression factory methods for timestamp literals ([\#13747](https://github.com/apache/iceberg/pull/13747)) + - Add table metadata keys for encryption ([\#12927](https://github.com/apache/iceberg/pull/12927)) + - Add deleteFile to RowDelta API ([\#12861](https://github.com/apache/iceberg/pull/12861)) + - Expose cleanExpiredMetadata in ExpireSnapshots ([\#13509](https://github.com/apache/iceberg/pull/13509)) + - Preserve original type for upper/lower bounds in metrics ([\#13695](https://github.com/apache/iceberg/pull/13695)) + - Fix timestamp(9) with identity partitioning ([\#13746](https://github.com/apache/iceberg/pull/13746)) + - Add expression factory methods for timestamp literals ([\#13747](https://github.com/apache/iceberg/pull/13747)) * Core - - Fix a race condition in the JDBC catalog initialization with creating system tables ([\#13345](https://github.com/apache/iceberg/pull/13345)) - - Properly close resources when REST catalog initialization fails ([\#13384](https://github.com/apache/iceberg/pull/13384)) - - Fix spec non-confirming field ids for partition stats files ([\#13329](https://github.com/apache/iceberg/pull/13329)) - - Partitions metadata returns incomplete list in case of partition evolution and null partition value ([\#12528](https://github.com/apache/iceberg/pull/12528)) - - Support incremental refresh for partition stats ([\#12629](https://github.com/apache/iceberg/pull/12629)) - - Add max number of files rewrite option ([\#12824](https://github.com/apache/iceberg/pull/12824)) - - Add table property of column prefix to enable Parquet column statistics ([\#12770](https://github.com/apache/iceberg/pull/12770)) - - Ignore partition fields that are dropped from current schema ([\#11868](https://github.com/apache/iceberg/pull/11868)) - - Propagate and delete dangling DVs when rewriting data files ([\#13245](https://github.com/apache/iceberg/pull/13245/)) - - Support DV in partition stats ([\#13425](https://github.com/apache/iceberg/pull/13425)) - - Track data files to be removed for orphaned DV cleanup ([\#13222](https://github.com/apache/iceberg/pull/13222)) - - Use bulk deletion for cleaning up uncommitted files in BaseTransaction ([\#13653](https://github.com/apache/iceberg/pull/13653)) - - Use zero copy wrapper for equalityFieldIds in BaseFile ([\#13212](https://github.com/apache/iceberg/pull/13212)) - - Prevent empty Puffin file creation in DV writer ([\#13666](https://github.com/apache/iceberg/pull/13666)) - - Fix incorrect selection of incremental cleanup in ExpireSnapshots ([\#13614](https://github.com/apache/iceberg/pull/13614)) - - Fix metrics column limit with nested column ([\#13039](https://github.com/apache/iceberg/pull/13039)) - - Support timestamp(9) in single value parser ([\#13487](https://github.com/apache/iceberg/pull/13487)) - - Batch load new files for validation of cherry-pick replace partition ([\#13556](https://github.com/apache/iceberg/pull/13556)) - - Add planWith to FindFiles to leverage ParallelIterable ([\#13836](https://github.com/apache/iceberg/pull/13836)) - - REST: Add context aware response parsing ([\#13191](https://github.com/apache/iceberg/pull/13191)) - - REST: Add property to configure user agent in http client ([\#13234](https://github.com/apache/iceberg/pull/13234)) - - REST: add option to configure TLS settings in REST client ([\#13190](https://github.com/apache/iceberg/pull/13190)) - - REST: Avoid table corruption by stop retrying on 502 and 504 ([\#13352](https://github.com/apache/iceberg/pull/13352)) - - REST: Add HTTP proxy support for REST client ([\#12406](https://github.com/apache/iceberg/pull/12406)) - - REST: make metrics reporting async ([\#13507](https://github.com/apache/iceberg/pull/13507)) - - REST: allow retries for idempotent requests with some status codes ([\#13449](https://github.com/apache/iceberg/pull/13449)) - - REST: introduce shared auth refresh executor ([\#12563](https://github.com/apache/iceberg/pull/12563)) - - REST: allow disabling token exchange as refresh ([\#13809](https://github.com/apache/iceberg/pull/13809)) - - REST: request/response models and parsers for scan planning ([\#13004](https://github.com/apache/iceberg/pull/13004)) + - Fix a race condition in the JDBC catalog initialization with creating system tables ([\#13345](https://github.com/apache/iceberg/pull/13345)) + - Properly close resources when REST catalog initialization fails ([\#13384](https://github.com/apache/iceberg/pull/13384)) + - Fix spec non-confirming field ids for partition stats files ([\#13329](https://github.com/apache/iceberg/pull/13329)) + - Partitions metadata returns incomplete list in case of partition evolution and null partition value ([\#12528](https://github.com/apache/iceberg/pull/12528)) + - Support incremental refresh for partition stats ([\#12629](https://github.com/apache/iceberg/pull/12629)) + - Add max number of files rewrite option ([\#12824](https://github.com/apache/iceberg/pull/12824)) + - Add table property of column prefix to enable Parquet column statistics ([\#12770](https://github.com/apache/iceberg/pull/12770)) + - Ignore partition fields that are dropped from current schema ([\#11868](https://github.com/apache/iceberg/pull/11868)) + - Propagate and delete dangling DVs when rewriting data files ([\#13245](https://github.com/apache/iceberg/pull/13245/)) + - Support DV in partition stats ([\#13425](https://github.com/apache/iceberg/pull/13425)) + - Track data files to be removed for orphaned DV cleanup ([\#13222](https://github.com/apache/iceberg/pull/13222)) + - Use bulk deletion for cleaning up uncommitted files in BaseTransaction ([\#13653](https://github.com/apache/iceberg/pull/13653)) + - Use zero copy wrapper for equalityFieldIds in BaseFile ([\#13212](https://github.com/apache/iceberg/pull/13212)) + - Prevent empty Puffin file creation in DV writer ([\#13666](https://github.com/apache/iceberg/pull/13666)) + - Fix incorrect selection of incremental cleanup in ExpireSnapshots ([\#13614](https://github.com/apache/iceberg/pull/13614)) + - Fix metrics column limit with nested column ([\#13039](https://github.com/apache/iceberg/pull/13039)) + - Support timestamp(9) in single value parser ([\#13487](https://github.com/apache/iceberg/pull/13487)) + - Batch load new files for validation of cherry-pick replace partition ([\#13556](https://github.com/apache/iceberg/pull/13556)) + - Add planWith to FindFiles to leverage ParallelIterable ([\#13836](https://github.com/apache/iceberg/pull/13836)) + - REST: Add context aware response parsing ([\#13191](https://github.com/apache/iceberg/pull/13191)) + - REST: Add property to configure user agent in http client ([\#13234](https://github.com/apache/iceberg/pull/13234)) + - REST: add option to configure TLS settings in REST client ([\#13190](https://github.com/apache/iceberg/pull/13190)) + - REST: Avoid table corruption by stop retrying on 502 and 504 ([\#13352](https://github.com/apache/iceberg/pull/13352)) + - REST: Add HTTP proxy support for REST client ([\#12406](https://github.com/apache/iceberg/pull/12406)) + - REST: make metrics reporting async ([\#13507](https://github.com/apache/iceberg/pull/13507)) + - REST: allow retries for idempotent requests with some status codes ([\#13449](https://github.com/apache/iceberg/pull/13449)) + - REST: introduce shared auth refresh executor ([\#12563](https://github.com/apache/iceberg/pull/12563)) + - REST: allow disabling token exchange as refresh ([\#13809](https://github.com/apache/iceberg/pull/13809)) + - REST: request/response models and parsers for scan planning ([\#13004](https://github.com/apache/iceberg/pull/13004)) * Arrow - - Refactor Parquet readers for v2 support ([\#13290](https://github.com/apache/iceberg/pull/13290)) - - Add support for DELTA_BINARY_PACKED Parquet encoding ([\#13391](https://github.com/apache/iceberg/pull/13391)) - - Add nano timestamp support ([\#13562](https://github.com/apache/iceberg/pull/13562)) - - Fix direct memory leak with mixed encoding pages ([\#13935](https://github.com/apache/iceberg/pull/13935)) + - Refactor Parquet readers for v2 support ([\#13290](https://github.com/apache/iceberg/pull/13290)) + - Add support for DELTA_BINARY_PACKED Parquet encoding ([\#13391](https://github.com/apache/iceberg/pull/13391)) + - Add nano timestamp support ([\#13562](https://github.com/apache/iceberg/pull/13562)) + - Fix direct memory leak with mixed encoding pages ([\#13935](https://github.com/apache/iceberg/pull/13935)) * Parquet - - Use variant logical annotation added in Parquet 1.16.0 ([\#13941](https://github.com/apache/iceberg/pull/13941)) + - Use variant logical annotation added in Parquet 1.16.0 ([\#13941](https://github.com/apache/iceberg/pull/13941)) * Spark - - Support Spark 4.0 ([\#12494](https://github.com/apache/iceberg/pull/12494)) - - V3: Add row lineage support in Avro reader ([\#13070](https://github.com/apache/iceberg/pull/13070)) - - V3: Add row lineage support in Parquet vectorized Arrow reader ([\#12928](https://github.com/apache/iceberg/pull/12928)) - - Streaming: make maxRecordPerMicrobatch a soft limit ([\#12988](https://github.com/apache/iceberg/pull/12988)) - - V3: Fix row lineage inheritance for distributed planning ([\#13061](https://github.com/apache/iceberg/pull/13061)) - - Storage partitioned join: add bucket reducer ([\#13167](https://github.com/apache/iceberg/pull/13167)) and hour to day reducer ([\#13166](https://github.com/apache/iceberg/pull/13166)) - - Rewrite table path action: filter content files by snapshot id in incremental mode REST: Add context aware response parsing ([\#12885](https://github.com/apache/iceberg/pull/12885)) - - Fix DML query failure with identifier fields ([\#13535](https://github.com/apache/iceberg/pull/13435)) - - Add action and procedure to compute partition stats ([\#12450](https://github.com/apache/iceberg/pull/12450))([\#13480](https://github.com/apache/iceberg/pull/13480)) - - Throw unsupported exception for ADD COLUMN with default value ([\#13464](https://github.com/apache/iceberg/pull/13464)) - - 4.0: migrate Iceberg stored procedures to Spark built-in implementation ([\#13106](https://github.com/apache/iceberg/pull/13106)) - - Use Iceberg FileIO (instead of Hadoop) when writing file list in RewriteTablePathSparkAction ([\#13459](https://github.com/apache/iceberg/pull/13459)) - - Support Parquet dictionary encoded UUIDs ([\#13324](https://github.com/apache/iceberg/pull/13324)) - - 4.0: Add row lineage support using conditional nullification mechanism introduced in Spark 4.0 ([\#13310](https://github.com/apache/iceberg/pull/13310)) - - Use bulk deletion operation for deleting manifests when importing files from partitions ([\#13620](https://github.com/apache/iceberg/pull/13620)) - - Preserve row lineage on compaction ([\#13555](https://github.com/apache/iceberg/pull/13555)) - - Refactor DeleteOrphanFilesSparkAction to to use common code from core ([\#13429](https://github.com/apache/iceberg/pull/13429)) - - Add variant read support ([\#13219](https://github.com/apache/iceberg/pull/13219)) - - Add config to disable executor cache for deleting files ([\#12893](https://github.com/apache/iceberg/pull/12893)) - - Accept custom partition order in RewriteManifest ([\#12840](https://github.com/apache/iceberg/pull/12840)) - - 4.0: read and write unknown type ([\#13445](https://github.com/apache/iceberg/pull/13445)) + - Support Spark 4.0 ([\#12494](https://github.com/apache/iceberg/pull/12494)) + - V3: Add row lineage support in Avro reader ([\#13070](https://github.com/apache/iceberg/pull/13070)) + - V3: Add row lineage support in Parquet vectorized Arrow reader ([\#12928](https://github.com/apache/iceberg/pull/12928)) + - Streaming: make maxRecordPerMicrobatch a soft limit ([\#12988](https://github.com/apache/iceberg/pull/12988)) + - V3: Fix row lineage inheritance for distributed planning ([\#13061](https://github.com/apache/iceberg/pull/13061)) + - Storage partitioned join: add bucket reducer ([\#13167](https://github.com/apache/iceberg/pull/13167)) and hour to day reducer ([\#13166](https://github.com/apache/iceberg/pull/13166)) + - Rewrite table path action: filter content files by snapshot id in incremental mode REST: Add context aware response parsing ([\#12885](https://github.com/apache/iceberg/pull/12885)) Review Comment: remove `REST: Add context aware response parsing` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
