albertlockett commented on PR #7446: URL: https://github.com/apache/arrow-rs/pull/7446#issuecomment-2849267829
> I think the idea of this function is to allow round tripping of Dictionary arrow types via parquet. > > I am not sure we have documented the behavior of metadata anywhere -- we probably should > > Since the arrow type system and the parquet type system are different, to ensure that arrow-rs parquet can recover the original arrow types if data was written to parquet, it adds metadata into the parquet file to help choose which arrow type to use when there are several potential types for a parquet type (e.g. parquet Binary can go to BinaryView or Binary for example) @alamb yes, that's the idea with this change. Thanks for the explainer on the metadata -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
