chakravarthiT opened a new pull request #24189: [SPARK-27253][SQL]SparkSession clone discards SQLConf overrides in favor of SparkConf defaults URL: https://github.com/apache/spark/pull/24189 ## What changes were proposed in this pull request? SparkSession.cloneSession() is normally supposed to create a child session which inherits all the SQLConf values of its parent session. But when a SQL conf is given a global default through the SparkConf, this does not happen; the child session will receive the SparkConf default rather than its parent's SQLConf override. This is particularly impactful in structured streaming, as the microbatches run in a cloned child session. ## How was this patch tested? Added UT.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
