[
https://issues.apache.org/jira/browse/SPARK-20100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-20100.
---------------------------------
Resolution: Fixed
Fix Version/s: 2.2.0
Issue resolved by pull request 17433
[https://github.com/apache/spark/pull/17433]
> Consolidate SessionState construction
> -------------------------------------
>
> Key: SPARK-20100
> URL: https://issues.apache.org/jira/browse/SPARK-20100
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.2.0
> Reporter: Herman van Hovell
> Assignee: Herman van Hovell
> Fix For: 2.2.0
>
>
> The current SessionState initialization path is quite complex. A part of the
> creation is done in the SessionState companion objects, a part of the
> creation is one inside the SessionState class, and a part is done by passing
> functions.
> The proposal is to consolidate the SessionState initialization into a builder
> class. This SessionState will not do any initialization and just becomes a
> place holder for the various Spark SQL internals. The advantages of this
> approach are the following:
> - SessionState initialization is less dispersed. The builder should be a one
> stop shop.
> - This provides us with a start for removing the HiveSessionState. Removing
> the hive session state would also require us to move resource loading into a
> separate class, and to (re)move metadata hive.
> - It is easier to customize the Spark Session. You just need to create a
> custom version of the builder. I will add hooks to make this easier. Opening
> up these API's will happen at a later point.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
