jatorre opened a new issue, #3640: URL: https://github.com/apache/iceberg-rust/issues/3640
### Apache Iceberg Rust version main (5994664) ### Describe the bug `ManifestWriter` and `ManifestListWriter` create their Avro writers with `Writer::new`, so the files carry no `avro.codec` entry (uncompressed). The Avro specification makes `null` the default, but PyIceberg 0.12 falls back to the Iceberg table-property default `gzip`, which is not an Avro codec name, and raises `ValueError: Unsupported codec: gzip`. A table with one snapshot written by iceberg-rust then cannot be scanned from PyIceberg (the PyIceberg side is apache/iceberg-python, issue to follow). ### To Reproduce Commit a fast append with iceberg-rust to a table, then `table.scan().to_arrow()` with PyIceberg 0.12. ### Expected behavior Manifests compressed with `deflate` (what other writers produce for manifests; DuckDB's in the same table were deflate), which also makes them smaller. ### Willingness to contribute I can contribute a fix for this bug independently (PR to follow). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
