[
https://issues.apache.org/jira/browse/SPARK-19540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu resolved SPARK-19540.
----------------------------------
Resolution: Fixed
Fix Version/s: 2.2.0
> Add ability to clone SparkSession with an identical copy of the SessionState
> ----------------------------------------------------------------------------
>
> Key: SPARK-19540
> URL: https://issues.apache.org/jira/browse/SPARK-19540
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.2.0
> Reporter: Kunal Khamar
> Fix For: 2.2.0
>
>
> Forking a newSession() from SparkSession currently makes a new SparkSession
> that does not retain SessionState (i.e. temporary tables, SQL config,
> registered functions etc.) This change adds a method cloneSession() which
> creates a new SparkSession with a copy of the parent's SessionState.
> Subsequent changes to base session are not propagated to cloned session,
> clone is independent after creation.
> If the base is changed after clone has been created, say user registers new
> UDF, then the new UDF will not be available inside the clone. Same goes for
> configs and temp tables.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
