beliefer commented on a change in pull request #27691: [SPARK-30841][SQL][DOC]
Add version information to the configuration of SQL
URL: https://github.com/apache/spark/pull/27691#discussion_r383743463
##########
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
##########
@@ -336,26 +357,30 @@ object SQLConf {
.doc("Minimal increase rate in number of partitions between attempts when
executing a take " +
"on a query. Higher values lead to more partitions read. Lower values
might lead to " +
"longer execution times as more jobs will be run")
+ .version("2.1.1")
.intConf
.createWithDefault(4)
val ADVANCED_PARTITION_PREDICATE_PUSHDOWN =
buildConf("spark.sql.hive.advancedPartitionPredicatePushdown.enabled")
.internal()
.doc("When true, advanced partition predicate pushdown into Hive
metastore is enabled.")
+ .version("2.3.0")
.booleanConf
.createWithDefault(true)
val SHUFFLE_PARTITIONS = buildConf("spark.sql.shuffle.partitions")
.doc("The default number of partitions to use when shuffling data for
joins or aggregations. " +
"Note: For structured streaming, this configuration cannot be changed
between query " +
"restarts from the same checkpoint location.")
+ .version("1.1.0")
.intConf
.checkValue(_ > 0, "The value of spark.sql.shuffle.partitions must be
positive")
.createWithDefault(200)
val ADAPTIVE_EXECUTION_ENABLED = buildConf("spark.sql.adaptive.enabled")
.doc("When true, enable adaptive query execution.")
+ .version("1.6.0")
Review comment:
SPARK-9858 and SPARK-9859 and SPARK-9861, commit ID:
d728d5c98658c44ed2949b55d36edeaa46f8c980#diff-41ef65b9ef5b518f77e2a03559893f4d
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
