yadavay-amzn commented on code in PR #56244:
URL: https://github.com/apache/spark/pull/56244#discussion_r3471299366
##########
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala:
##########
@@ -522,6 +522,30 @@ object SQLConf {
.booleanConf
.createWithDefault(true)
+ val DECOMPOSE_STRUCT_COMPARISON_ENABLED =
+ buildConf("spark.sql.optimizer.decomposeStructComparison.enabled")
+ .doc("When true, the optimizer rewrites struct equality (= and <=>)
appearing in Filter " +
+ "conditions into a conjunction of field-level equalities, enabling
per-field filter " +
+ "pushdown to data sources. The rewrite preserves NULL semantics by
wrapping the " +
+ "conjunction in a null-check that mirrors the original struct-level
comparison.")
+ .version("4.2.0")
Review Comment:
Done - both confs now use 4.3.0.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
