+1

On Mon, Aug 10, 2026 at 9:02 PM JUNHAO YE <[email protected]> wrote:
>
> Hi devs,
>
> I'd like to discuss removing the `manifest.format` option and standardizing 
> Paimon manifest files on Avro.
>
> The related PR is:
> https://github.com/apache/paimon/pull/9154
>
> The main reasons are:
>
> 1. Avro is the default and de facto manifest format.
> 2. PyPaimon currently supports Avro manifests only.
> 3. Allowing alternative formats introduces unnecessary compatibility risks 
> across implementations.
> 4. We checked our managed production tables and found no usage of 
> `manifest.format`.
>
> The proposal is to:
>
> - Remove `manifest.format` from `CoreOptions` and the documentation.
> - Always use Avro for manifest files.
> - Keep `manifest.compression` configurable.
>
> The compatibility concern is that tables whose manifests were actually 
> written in another format, such as ORC, would no longer be readable after 
> upgrading. We have not found such usage, but would like to confirm whether 
> anyone in the community relies on non-Avro manifests.
>
> Please share your concerns or use cases if you depend on this option.
>
> Best,
> Junhao

Reply via email to