AngersZhuuuu commented on a change in pull request #34453:
URL: https://github.com/apache/spark/pull/34453#discussion_r770384610
##########
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
##########
@@ -1158,6 +1158,14 @@ object SQLConf {
.intConf
.createWithDefault(200)
+ val THRIFTSERVER_SEPARATE_DISPLAY_SYSTEM_FUNCTION =
+ buildConf("spark.sql.thriftserver.separateDisplaySystemFunctions")
+ .doc("When true, Spark Thrift Server will return databases' system
functions metadata " +
Review comment:
Done
##########
File path: docs/sql-migration-guide.md
##########
@@ -54,6 +54,8 @@ license: |
- Since Spark 3.3, nulls are written as empty strings in CSV data source by
default. In Spark 3.2 or earlier, nulls were written as empty strings as quoted
empty strings, `""`. To restore the previous behavior, set `nullValue` to `""`.
+ - Since Spark 3.3, Spark Thrift Server will return databases' system
functions metadata only once, and Spark will change function schema as
`SYSTEM`. In Spark 3.2 or earlier, Spark Thrift Server will return system
functions metadata for all databases. To restore the behavior before Spark 3.3,
yo you can set `spark.sql.thriftserver.separateDisplaySystemFunctions` to
`false`.
Review comment:
Done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
