masonh22 commented on PR #8028: URL: https://github.com/apache/arrow-rs/pull/8028#issuecomment-3156768218
@alamb I tried this out and it is definitely possible, but it adds some complexity that I'd want to avoid. Specifically, when iterating over both arrow `Fields` and parquet `TypePtr`s, you need to deal with the fact that list types can be represented multiple ways in parquet (see [this section](https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#backward-compatibility-rules) on the backward-compatibility rules for lists if you're not familiar). This would be easier if something like `parquet::schema::complex::Visitor` was public and more generic. Still, I think the simplest solution for what I'm trying to do is putting the "adjusted_to_utc" key in the arrow field metadata. This goes along with how arrow-rs handles parquet field IDs, which is another piece of parquet-specific metadata that could be handled by the methods you describe. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
