alamb commented on issue #7299: URL: https://github.com/apache/arrow-rs/issues/7299#issuecomment-3438322971
> Because this is a special column, we need to mark it as such. We use a new extension types for this. I really like the idea of using an Extension type for this usecase because it has several existing precidents (e.g. Variant and Geometry) and we already pass the Arrow schema into the parquet reader. I didn't quite follow the conversation above about `with_metadata_columns` with @jkylling BTW I will have more time to help with this feature after I complete the following items (which I think will make threading this information down into the reader much easier) - https://github.com/apache/arrow-rs/pull/7997 - https://github.com/apache/arrow-rs/issues/8677 I expect to merge / make progress on this tomorrow -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
