[
https://issues.apache.org/jira/browse/SPARK-20337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15968843#comment-15968843
]
Sean Owen commented on SPARK-20337:
-----------------------------------
I don't think this is a reasonable use case to support. Spark jobs are
conceptually not long-lived, certainly not shells. Just restart. This raises
all kinds of problems with references to instances of existing classes.
> Support upgrade a jar dependency and don't restart SparkContext
> ---------------------------------------------------------------
>
> Key: SPARK-20337
> URL: https://issues.apache.org/jira/browse/SPARK-20337
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 2.1.0
> Reporter: Yuming Wang
> Priority: Minor
>
> Suppose that we need upgrade a jar dependency and don't want to restart
> {{SparkContext}}, Something like this:
> {code}
> sc.addJar("breeze-natives_2.11-0.12.jar")
> // do something
> sc.removeJar("spark://192.168.26.200:23420/jar/breeze-natives_2.11-0.12.jar")
> sc.addJar("breeze-natives_2.11-0.13.jar")
> // do something
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
