jorisvandenbossche commented on issue #39489: URL: https://github.com/apache/arrow/issues/39489#issuecomment-1884730021
> I do think Arrow already has an independent solution to this case. The metadata associated with the `ARROW:schema` key _should_ be able to preserve this information on roundtrip, and I was actually surprised that it didn't in your example. This additional `ARROW:schema` metadata was only added around the same time that we started to support LogicalType (around Arrow 0.14.0), so unfortunately it doesn't help for this use case. When it is present, it indeed allows to preserve the actual timezone (also for logical types, which otherwise only knows if it is UTC or not). But so when `ARROW:schema` is present, the file thus also has LogicalType annotations, and this whole discussion of course only applies to older files that only have ConvertedTypes. So while I certainly agree with your "desired behaviour" being desired, it's not possible to distinguish with or without tz (even for files written by Arrow), because the only information there is in the file is the ConvertedType. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
