mbutrovich commented on PR #7479: URL: https://github.com/apache/arrow-rs/pull/7479#issuecomment-2858682055
Thanks @alamb. I was just looking at this again because I'd like to see a coercion in DF to keep dictionaries if possible. Currently Comet only knows the primitive datatype and ignores encoding when generating the schema, which results in dictionaries being unpacked in the Parquet reader when we might have preferred to keep them encoded. I'll take another pass through this later to think about what might be missing, but first read was good. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
