raghuvanshraj commented on PR #26145: URL: https://github.com/apache/datafusion/pull/26145#issuecomment-6629913096
One end-to-end data point with a struct-backed extension type, since the `metadata.slt` cases here and in #26895 use `Utf8` with `with_metadata`/`arrow_metadata`: a Parquet Variant column (`ARROW:extension:name = arrow.parquet.variant` on `Struct<metadata, value, typed_value<...>>`), read through `datafusion-variant`, whose `variant_get` checks the tag on its input field at execution. Same program on `branch-56` (`1635ed9`) and on the head of #26158 (`3018e53`, carrying this PR at `bd6ab71`): | | `branch-56` | #26145 + #26158 | |---|---|---| | `variant_get(CASE WHEN event:status >= 500 THEN event ELSE event END, 'service')` | `Execution error: field does not have extension type VariantType` | `api`, `api`, `db` | | `variant_get(CASE WHEN event:status >= 500 THEN event END, 'service')` | same error | `NULL`, `api`, `db` | | `variant_get(COALESCE(event, event), 'service')` | same error | `api`, `api`, `db` | | `variant_get(CASE WHEN false THEN event END, 'service')` | same error | same error (#26951) | Reproducer is a standalone `cargo run` that writes the file with arrow-rs `shred_variant`; can paste it or add a struct-backed case to the slt if useful. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
