andygrove commented on code in PR #4018: URL: https://github.com/apache/datafusion-comet/pull/4018#discussion_r3117592883
########## docs/source/user-guide/latest/compatibility.md: ########## @@ -125,6 +125,23 @@ achieves the same semantic goals: The only difference is that Comet's partition assignments will differ from Spark's. When results are sorted, they will be identical to Spark. Unsorted results may have different row ordering. +## Spark 4.0 Limitations + +The following limitations apply specifically when running Comet with Spark 4.0. These represent new Spark +4.0 features that Comet does not yet support. Queries that use these features will fall back to Spark. + +### Variant Type + +Comet does not yet support the Variant data type introduced in Spark 4.0. All variant-related operations +will fall back to Spark. Tracking issue: [#2209](https://github.com/apache/datafusion-comet/issues/2209) Review Comment: I need to confirm the actual behavior for variant -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
