WangGuangxin commented on a change in pull request #26270: [SPARK-26544][SQL]
Escape struct string in spark thriftserver to keep alignment with hive
URL: https://github.com/apache/spark/pull/26270#discussion_r357968954
##########
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
##########
@@ -770,6 +770,12 @@ object SQLConf {
.intConf
.createWithDefault(200)
+ val THRIFTSERVER_RESULT_ESCAPE_STRUCT_STRING =
+ buildConf("spark.sql.thriftserver.result.escapeStructString.enabled")
+ .doc("When true, escape string when needed to ensure the result returned
is a valid json.")
+ .booleanConf
+ .createWithDefault(false)
Review comment:
I think this should be a bug. I can't think of any other reasons to return
a non-json string here.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
