peter-toth commented on code in PR #56244:
URL: https://github.com/apache/spark/pull/56244#discussion_r3452216031
##########
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala:
##########
@@ -522,6 +522,30 @@ object SQLConf {
.booleanConf
.createWithDefault(true)
+ val DECOMPOSE_STRUCT_COMPARISON_ENABLED =
+ buildConf("spark.sql.optimizer.decomposeStructComparison.enabled")
+ .doc("When true, the optimizer rewrites struct equality (= and <=>)
appearing in Filter " +
+ "conditions into a conjunction of field-level equalities, enabling
per-field filter " +
+ "pushdown to data sources. The rewrite preserves NULL semantics by
wrapping the " +
+ "conjunction in a null-check that mirrors the original struct-level
comparison.")
+ .version("4.2.0")
Review Comment:
`4.2.0` is already released; this and the `maxFields` config (line 543)
should be `4.3.0` (the next release).
```suggestion
.version("4.3.0")
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
