jackylee-ch opened a new pull request, #842: URL: https://github.com/apache/paimon-rust/pull/842
`avro_codec` rejected `deflate` and the OCF reader's codec whitelist did too, so a table whose schema carries `manifest.compression=deflate` could be neither written nor read: every scan failed with `avro ocf: unsupported codec: deflate`. The option comes from the persisted schema, so a table created by Java brings it along to every paimon-rust process. Java accepts deflate through `CodecFactory.fromString`. Read support is a regression: `553e4a3` (#281) advertised "snappy/deflate/zstd" in its own message while shipping only three arms, replacing a reader that did handle deflate. Write support is parity work. At HEAD the crate already reads deflate-compressed Avro *data* files, so only manifests were refused. No upstream report; found by inspection. `bzip2` and `xz` are the same gap and stay rejected. Drive-by: the snappy mismatch message said CRC32C where the code computes CRC-32. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
