Hi devs, I'd like to discuss removing the `manifest.format` option and standardizing Paimon manifest files on Avro.
The related PR is: https://github.com/apache/paimon/pull/9154 The main reasons are: 1. Avro is the default and de facto manifest format. 2. PyPaimon currently supports Avro manifests only. 3. Allowing alternative formats introduces unnecessary compatibility risks across implementations. 4. We checked our managed production tables and found no usage of `manifest.format`. The proposal is to: - Remove `manifest.format` from `CoreOptions` and the documentation. - Always use Avro for manifest files. - Keep `manifest.compression` configurable. The compatibility concern is that tables whose manifests were actually written in another format, such as ORC, would no longer be readable after upgrading. We have not found such usage, but would like to confirm whether anyone in the community relies on non-Avro manifests. Please share your concerns or use cases if you depend on this option. Best, Junhao
