leanken opened a new pull request #30042:
URL: https://github.com/apache/spark/pull/30042


   ### What changes were proposed in this pull request?
   
   This PR is a sub-task of 
[SPARK-33138](https://issues.apache.org/jira/browse/SPARK-33138). In order to 
make SQLConf.get reliable and stable, we need to make sure user can't pollute 
the SQLConf and SparkSession Context via calling setActiveSession and 
clearActiveSession.
   
   Change of the PR:
   
   * add legacy config spark.sql.legacy.allowModifyActiveSession to fallback to 
old behavior if user do need to call these two API.
   * by default, if user call these two API, it will throw exception
   * add extra two internal and private API setActiveSessionInternal and 
clearActiveSessionInternal for current internal usage
   * change all internal reference to new internal API except for 
SQLContext.setActive and SQLContext.clearActive
   
   ### Why are the changes needed?
   
   Make SQLConf.get reliable and stable.
   
   ### Does this PR introduce any user-facing change?
   No.
   
   ### How was this patch tested?
   
   * Add UT in SparkSessionBuilderSuite to test the legacy config
   * Existing test
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to