cloud-fan commented on a change in pull request #25471: [SPARK-28753][SQL]
Dynamically reuse subqueries in AQE
URL: https://github.com/apache/spark/pull/25471#discussion_r314606607
##########
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/AdaptiveSparkPlanExec.scala
##########
@@ -73,17 +74,19 @@ case class AdaptiveSparkPlanExec(
override protected def batches: Seq[Batch] = Seq()
}
+ @transient private val ensureRequirements = EnsureRequirements(conf)
+
// A list of physical plan rules to be applied before creation of query
stages. The physical
// plan should reach a final status of query stages (i.e., no more addition
or removal of
// Exchange nodes) after running these rules.
- @transient private val queryStagePreparationRules: Seq[Rule[SparkPlan]] =
Seq(
- PlanAdaptiveSubqueries(subqueryMap),
- EnsureRequirements(conf)
+ private def queryStagePreparationRules: Seq[Rule[SparkPlan]] = Seq(
Review comment:
how about
```
@transient private val queryStagePreparationRules: Seq[Rule[SparkPlan]] = {
EnsureRequirements(conf)
}
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
