Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19757#discussion_r151366943
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/SetCommand.scala
---
@@ -95,6 +95,10 @@ case class SetCommand(kv: Option[(String,
Option[String])]) extends RunnableComm
s"prefix spark.hadoop (e.g., spark.hadoop.$key) when starting
a Spark application. " +
"For details, see the link:
https://spark.apache.org/docs/latest/configuration.html#"; +
"dynamically-loading-spark-properties.")
+ } else if (key == SQLConf.CBO_ENABLED.key &&
+ value != sparkSession.conf.get(SQLConf.CBO_ENABLED.key)) {
+ // To change CBO config, first we need to invalidate stats for
all relation caches.
--- End diff --
what about the stats in hive metastore?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
