tobixdev commented on issue #8730: URL: https://github.com/apache/arrow-rs/issues/8730#issuecomment-3773059467
> I think the challenge with this approach will be nested types like ListArray and StructArray, which contain Field I haven't thought about that. Thanks for pointing it out! Could you maybe elaborate what you think will be the most difficult part? Maybe the `values: ArrayRef` field should be a `NativeOrExtensionArray` in, for example, `GenericListArray`? After all, we can have associated extension type metadata with the inner arrays and interpreting them just as the underlying physical type may work for some function (e.g., select item of the inner list) but may not work for another function (e.g., pretty-printing). Currently, there are no guard rails for just using the physical arrays and ignoring the metadata of the `Field`. But yeah, this makes the breaking change likely bigger. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
