[
https://issues.apache.org/jira/browse/SPARK-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14135968#comment-14135968
]
Andy Petrella commented on SPARK-2593:
--------------------------------------
Couldn't we can translate the needs here to an API which would open
communication channels between nodes in the cluster (internally, to the driver,
...?) even from *within* a task.
Probable use case is metrics gathering (including fine-grained progress
monitoring)?
Actually, this feature comes OOTB with the spark akka system, which is already
configured to access actors on the nodes, so that it's appealing to reuse it
for that.
_my .2ยข only_
> Add ability to pass an existing Akka ActorSystem into Spark
> -----------------------------------------------------------
>
> Key: SPARK-2593
> URL: https://issues.apache.org/jira/browse/SPARK-2593
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Reporter: Helena Edelson
>
> As a developer I want to pass an existing ActorSystem into StreamingContext
> in load-time so that I do not have 2 actor systems running on a node in an
> Akka application.
> This would mean having spark's actor system on its own named-dispatchers as
> well as exposing the new private creation of its own actor system.
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
