laskoviymishka opened a new issue, #1005: URL: https://github.com/apache/iceberg-go/issues/1005
Parent: #589 The v3 spec allows zstd-compressed `metadata.json`. iceberg-go's metadata-location codec layer handles `gzip` and `none` and returns `unsupported write metadata compression codec` for anything else. Add zstd on both read (decompress when reading a `.metadata.json.zstd`) and write (compress when `write.metadata.compression-codec=zstd`). `klauspost/compress/zstd` is already a transitive dependency via parquet, so no new go.mod entry. Add a new `MetadataCompressionCodecZstd` constant alongside the existing gzip / none, and thread it through both directions of the codec helper. Tests: round-trip a zstd-compressed metadata.json end-to-end; golden-fixture test against a Java-produced zstd metadata.json pins the exact byte format. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
