dilipbiswal commented on issue #24279: [SPARK-27253][SQL][FOLLOW-UP] Add a note about parent-session configuration priority in migration guide URL: https://github.com/apache/spark/pull/24279#issuecomment-479699645 @HyukjinKwon A slightly different version for your perusal. ``` In Spark version 2.4, when a spark session is created via `cloneSession()`, the newly created spark session inherits its configuration from its parent `SparkContext` even though the same configuration may exist with a differnt value in its parent spark session. Since Spark 3.0, the configurations of a parent `SparkSession` have a higher precedence over the parent `SparkContext` ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
