Re: Why did spark switch from AKKA to net / ...

2017-05-07 Thread geoHeil 
Thanks for the clarification.
Matei Zaharia [via Apache Spark Developers List] <
ml+s1001551n21526...@n3.nabble.com> schrieb am Mo. 8. Mai 2017 um 03:51:

> More specifically, many user applications that link to Spark also linked
> to Akka as a library (e.g. say you want to write a service that receives
> requests from Akka and runs them on Spark). In that case, you'd have two
> conflicting versions of the Akka library in the same JVM.
>
> Matei
>
> On May 7, 2017, at 2:24 PM, Mark Hamstra <[hidden email]
> <http:///user/SendEmail.jtp?type=node=21526=0>> wrote:
>
> The point is that Spark's prior usage of Akka was limited enough that it
> could fairly easily be removed entirely instead of forcing particular
> architectural decisions on Spark's users.
>
>
> On Sun, May 7, 2017 at 1:14 PM, geoHeil <[hidden email]
> <http:///user/SendEmail.jtp?type=node=21526=1>> wrote:
>
>> Thank you!
>> In the issue they outline that hard wired dependencies were the problem.
>> But wouldn't one want to not directly accept the messages from an actor
>> but have Kafka as an failsafe intermediary?
>>
>> zero323 [via Apache Spark Developers List] <[hidden email]
>> <http://user/SendEmail.jtp?type=node=21524=0>> schrieb am So., 7.
>> Mai 2017 um 21:17 Uhr:
>>
>>> https://issues.apache.org/jira/browse/SPARK-5293
>>>
>>>
>>> On 05/07/2017 08:59 PM, geoHeil wrote:
>>>
>>> > Hi,
>>> >
>>> > I am curious why spark (with 2.0 completely) removed any akka
>>> dependencies
>>> > for RPC and switched entirely to (as far as I know natty)
>>> >
>>> > regards,
>>> > Georg
>>> >
>>> >
>>> >
>>> > --
>>> > View this message in context:
>>> http://apache-spark-developers-list.1001551.n3.nabble.com/Why-did-spark-switch-from-AKKA-to-net-tp21522.html
>>> > Sent from the Apache Spark Developers List mailing list archive at
>>> Nabble.com <http://nabble.com>.
>>> >
>>> > -
>>> > To unsubscribe e-mail: [hidden email]
>>> <http://user/SendEmail.jtp?type=node=21523=0>
>>> >
>>>
>>
>> -
>> To unsubscribe e-mail: [hidden email]
>> <http://user/SendEmail.jtp?type=node=21523=1>
>>
>>
>>
>> --
>> If you reply to this email, your message will be added to the discussion
>> below:
>>
>> http://apache-spark-developers-list.1001551.n3.nabble.com/Why-did-spark-switch-from-AKKA-to-net-tp21522p21523.html
>> To unsubscribe from Why did spark switch from AKKA to net / ..., click
>> here.
>> NAML
>> <http://apache-spark-developers-list.1001551.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer=instant_html%21nabble%3Aemail.naml=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>>
>
> --
> View this message in context: Re: Why did spark switch from AKKA to net /
> ...
> <http://apache-spark-developers-list.1001551.n3.nabble.com/Why-did-spark-switch-from-AKKA-to-net-tp21522p21524.html>
>
> Sent from the Apache Spark Developers List mailing list archive
> <http://apache-spark-developers-list.1001551.n3.nabble.com/> at Nabble.com
> <http://nabble.com>.
>
> If you reply to this email, your message will be added to the discussion
> below:
>
> http://apache-spark-developers-list.1001551.n3.nabble.com/Why-did-spark-switch-from-AKKA-to-net-tp21522p21526.html
> To unsubscribe from Why did spark switch from AKKA to net / ..., click
> here
> <http://apache-spark-developers-list.1001551.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code=21522=Z2Vvcmcua2YuaGVpbGVyQGdtYWlsLmNvbXwyMTUyMnwtMTgzMzc4NTU4MQ==>
> .
> NAML
> <http://apache-spark-developers-list.1001551.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer=instant_html%21nabble%3Aemail.naml=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>




--
View this message in context: 
http://apache-spark-developers-list.1001551.n3.nabble.com/Why-did-spark-switch-from-AKKA-to-net-tp21522p21527.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

Re: Why did spark switch from AKKA to net / ...

2017-05-07 Thread Matei Zaharia 
More specifically, many user applications that link to Spark also linked to 
Akka as a library (e.g. say you want to write a service that receives requests 
from Akka and runs them on Spark). In that case, you'd have two conflicting 
versions of the Akka library in the same JVM.

Matei

> On May 7, 2017, at 2:24 PM, Mark Hamstra <m...@clearstorydata.com> wrote:
> 
> The point is that Spark's prior usage of Akka was limited enough that it 
> could fairly easily be removed entirely instead of forcing particular 
> architectural decisions on Spark's users.
> 
> On Sun, May 7, 2017 at 1:14 PM, geoHeil <georg.kf.hei...@gmail.com 
> <mailto:georg.kf.hei...@gmail.com>> wrote:
> Thank you! 
> In the issue they outline that hard wired dependencies were the problem.
> But wouldn't one want to not directly accept the messages from an actor but 
> have Kafka as an failsafe intermediary?
> 
> zero323 [via Apache Spark Developers List] <[hidden email] 
> <http://user/SendEmail.jtp?type=node=21524=0>> schrieb am So., 7. Mai 
> 2017 um 21:17 Uhr:
> https://issues.apache.org/jira/browse/SPARK-5293 
> <https://issues.apache.org/jira/browse/SPARK-5293>
> 
> 
> On 05/07/2017 08:59 PM, geoHeil wrote:
> 
> > Hi, 
> > 
> > I am curious why spark (with 2.0 completely) removed any akka dependencies 
> > for RPC and switched entirely to (as far as I know natty) 
> > 
> > regards, 
> > Georg 
> > 
> > 
> > 
> > -- 
> > View this message in context: 
> > http://apache-spark-developers-list.1001551.n3.nabble.com/Why-did-spark-switch-from-AKKA-to-net-tp21522.html
> >  
> > <http://apache-spark-developers-list.1001551.n3.nabble.com/Why-did-spark-switch-from-AKKA-to-net-tp21522.html>
> > Sent from the Apache Spark Developers List mailing list archive at 
> > Nabble.com. 
> > 
> > -
> > To unsubscribe e-mail: [hidden email] 
> > <http://user/SendEmail.jtp?type=node=21523=0> 
> >
> 
> 
> - 
> To unsubscribe e-mail: [hidden email] 
> <http://user/SendEmail.jtp?type=node=21523=1> 
> 
> 
> 
> If you reply to this email, your message will be added to the discussion 
> below:
> http://apache-spark-developers-list.1001551.n3.nabble.com/Why-did-spark-switch-from-AKKA-to-net-tp21522p21523.html
>  
> <http://apache-spark-developers-list.1001551.n3.nabble.com/Why-did-spark-switch-from-AKKA-to-net-tp21522p21523.html>
> To unsubscribe from Why did spark switch from AKKA to net / ..., click here 
> <>.
> NAML 
> <http://apache-spark-developers-list.1001551.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer=instant_html%21nabble%3Aemail.naml=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
> View this message in context: Re: Why did spark switch from AKKA to net / ... 
> <http://apache-spark-developers-list.1001551.n3.nabble.com/Why-did-spark-switch-from-AKKA-to-net-tp21522p21524.html>
> 
> Sent from the Apache Spark Developers List mailing list archive 
> <http://apache-spark-developers-list.1001551.n3.nabble.com/> at Nabble.com.
>

Re: Why did spark switch from AKKA to net / ...

2017-05-07 Thread Mark Hamstra 
The point is that Spark's prior usage of Akka was limited enough that it
could fairly easily be removed entirely instead of forcing particular
architectural decisions on Spark's users.

On Sun, May 7, 2017 at 1:14 PM, geoHeil <georg.kf.hei...@gmail.com> wrote:

> Thank you!
> In the issue they outline that hard wired dependencies were the problem.
> But wouldn't one want to not directly accept the messages from an actor
> but have Kafka as an failsafe intermediary?
>
> zero323 [via Apache Spark Developers List] <[hidden email]
> <http:///user/SendEmail.jtp?type=node=21524=0>> schrieb am So., 7.
> Mai 2017 um 21:17 Uhr:
>
>> https://issues.apache.org/jira/browse/SPARK-5293
>>
>>
>> On 05/07/2017 08:59 PM, geoHeil wrote:
>>
>> > Hi,
>> >
>> > I am curious why spark (with 2.0 completely) removed any akka
>> dependencies
>> > for RPC and switched entirely to (as far as I know natty)
>> >
>> > regards,
>> > Georg
>> >
>> >
>> >
>> > --
>> > View this message in context: http://apache-spark-
>> developers-list.1001551.n3.nabble.com/Why-did-spark-
>> switch-from-AKKA-to-net-tp21522.html
>> > Sent from the Apache Spark Developers List mailing list archive at
>> Nabble.com.
>> >
>> > -
>> > To unsubscribe e-mail: [hidden email]
>> <http:///user/SendEmail.jtp?type=node=21523=0>
>> >
>>
>>
>> -
>> To unsubscribe e-mail: [hidden email]
>> <http:///user/SendEmail.jtp?type=node=21523=1>
>>
>>
>>
>> --
>> If you reply to this email, your message will be added to the discussion
>> below:
>> http://apache-spark-developers-list.1001551.n3.nabble.com/Why-did-spark-
>> switch-from-AKKA-to-net-tp21522p21523.html
>> To unsubscribe from Why did spark switch from AKKA to net / ..., click
>> here.
>> NAML
>> <http://apache-spark-developers-list.1001551.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer=instant_html%21nabble%3Aemail.naml=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>>
>
> --
> View this message in context: Re: Why did spark switch from AKKA to net /
> ...
> <http://apache-spark-developers-list.1001551.n3.nabble.com/Why-did-spark-switch-from-AKKA-to-net-tp21522p21524.html>
>
> Sent from the Apache Spark Developers List mailing list archive
> <http://apache-spark-developers-list.1001551.n3.nabble.com/> at
> Nabble.com.
>

Re: Why did spark switch from AKKA to net / ...

2017-05-07 Thread geoHeil 
Thank you!
In the issue they outline that hard wired dependencies were the problem.
But wouldn't one want to not directly accept the messages from an actor but
have Kafka as an failsafe intermediary?

zero323 [via Apache Spark Developers List] <
ml+s1001551n21523...@n3.nabble.com> schrieb am So., 7. Mai 2017 um
21:17 Uhr:

> https://issues.apache.org/jira/browse/SPARK-5293
>
>
> On 05/07/2017 08:59 PM, geoHeil wrote:
>
> > Hi,
> >
> > I am curious why spark (with 2.0 completely) removed any akka
> dependencies
> > for RPC and switched entirely to (as far as I know natty)
> >
> > regards,
> > Georg
> >
> >
> >
> > --
> > View this message in context:
> http://apache-spark-developers-list.1001551.n3.nabble.com/Why-did-spark-switch-from-AKKA-to-net-tp21522.html
> > Sent from the Apache Spark Developers List mailing list archive at
> Nabble.com.
> >
> > -
> > To unsubscribe e-mail: [hidden email]
> 
> >
>
>
> -
> To unsubscribe e-mail: [hidden email]
> 
>
>
>
> --
> If you reply to this email, your message will be added to the discussion
> below:
>
> http://apache-spark-developers-list.1001551.n3.nabble.com/Why-did-spark-switch-from-AKKA-to-net-tp21522p21523.html
> To unsubscribe from Why did spark switch from AKKA to net / ..., click
> here
> 
> .
> NAML
> 
>




--
View this message in context: 
http://apache-spark-developers-list.1001551.n3.nabble.com/Why-did-spark-switch-from-AKKA-to-net-tp21522p21524.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.