andygrove commented on PR #7515: URL: https://github.com/apache/datafusion-comet/pull/7515#issuecomment-6930003824
Yes, it's reachable. `try_cast(m AS map<int, int>)` on a Parquet `map<bigint, int>` column holding a key that doesn't fit in INT runs as a native `CometProject` and fails with "Found unmasked nulls for non-nullable Struct", where Spark returns the null-key map. This is #5995, which is open on `main`. This PR only covers the codegen-dispatch path from #6178, so I'd rather land it as is and backport the #5995 fix together once it exists. Does that work for you? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
