[
https://issues.apache.org/jira/browse/TOREE-390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040785#comment-16040785
]
ASF GitHub Bot commented on TOREE-390:
--------------------------------------
Github user asfgit closed the pull request at:
https://github.com/apache/incubator-toree/pull/109
> Lazily start Spark sessions
> ---------------------------
>
> Key: TOREE-390
> URL: https://issues.apache.org/jira/browse/TOREE-390
> Project: TOREE
> Issue Type: Improvement
> Reporter: Ryan Blue
>
> In our deployment, more than half of the startup time for a Toree notebook is
> taken by starting a Spark session and waiting for containers. Lazily starting
> Spark sessions helps the notebook environment feel faster, even if the user
> is waiting on Spark to start up because the time waiting for Spark to start
> is clearly Spark, not Toree, and is initiated by the user.
> Also, lazily starting a Spark session allows users to change settings that
> can't be changed in a Spark context. It also enables the same startup code
> that would be used in a spark-submit application:
> {code:lang=java}
> SparkSession.builder
> .config(...)
> .setAppName(...)
> .getOrCreate()
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
