cloud-fan commented on a change in pull request #33958:
URL: https://github.com/apache/spark/pull/33958#discussion_r708914859
##########
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
##########
@@ -1861,6 +1861,13 @@ object SQLConf {
.booleanConf
.createWithDefault(true)
+ val COLLAPSE_PROJECT_ALWAYS_INLINE =
buildConf("spark.sql.optimizer.collapseProjectAlwaysInline")
+ .doc("Whether to always collapse two adjacent projections and inline
expressions even if " +
+ "it causes extra duplication.")
+ .version("3.3.0")
+ .booleanConf
+ .createWithDefault(false)
Review comment:
yes, I expect it to be a perf-only feature which should be beneficial in
general, so turning it on makes more sense.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
