zhang-arvin opened a new pull request, #9497: URL: https://github.com/apache/paimon/pull/9497
## What changes were proposed in this pull request? Fix #9012: Paimon's Iceberg manifest files (Avro format) were missing the required Avro file-level metadata (`schema`, `partition-spec`, `partition-spec-id`, `format-version`) that Snowflake and other Iceberg readers require. ### Changes 1. **AvroFileFormat**: Added `AVRO_METADATA` config option and `setAvroMetadata()` static method to allow setting Avro file-level metadata key-value pairs in the container file header. 2. **IcebergManifestFile**: Added `create(FileStoreTable, IcebergPathFactory, Map<String, String>)` overload that passes Avro metadata through to the Avro format writer. 3. **IcebergCommitCallback**: Computes the Iceberg schema and partition spec from the table schema at construction time and passes them as Avro metadata when creating the manifest file. ## How was this patch tested? - Compiled successfully with `mvn -pl paimon-format,paimon-core -am -Pfast-build compile` - The metadata now conforms to the Iceberg spec requirements for manifest files -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
