jackylee-ch opened a new pull request, #978: URL: https://github.com/apache/paimon-rust/pull/978
`arrow_to_paimon_type` had no arm for `Dictionary` or `FixedSizeBinary`, so any Arrow schema carrying them fell through to `_ => Unsupported`. DataFusion encodes low-cardinality string columns as `Dictionary(Int32, Utf8)`, so `CREATE VIEW v AS SELECT ...` (and any other `arrow_fields_to_paimon` caller) failed with "Unsupported Arrow type for Paimon conversion" even though the same query ran fine. This resolves a dictionary to its value type — the key is a physical encoding detail, matching how the codebase already unwraps dictionaries in `residual.rs` / `vortex.rs` / `update_input.rs` — and maps `FixedSizeBinary(n)` to `BINARY(n)`, rejecting a non-positive length. Tested at both levels: `arrow_to_paimon_type` unit cases, and an end-to-end `CREATE VIEW` over a `Dictionary(Int32, Utf8)` column that now infers a `VARCHAR` field instead of erroring. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
