Subject: Re: issue regarding akka, protobuf and Hadoop version
I don't think we can maintain separate branches with different versions of
Akka, because there are often API changes in Akka. Maybe that would be a
short-term solution, but any release we make should ideally support all
versio
> Sent: Thursday, November 07, 2013 10:13 AM
> To: dev@spark.incubator.apache.org
> Subject: Re: issue regarding akka, protobuf and Hadoop version
>
> Moving to Akka 2.3 won't solve this problem unfortunately, because people
> still want to run Spark with older Hadoop version
: dev@spark.incubator.apache.org
Subject: Re: issue regarding akka, protobuf and Hadoop version
Moving to Akka 2.3 won't solve this problem unfortunately, because people still
want to run Spark with older Hadoop versions too, which will have Protobuf
2.4.1. Have you tested it with those?
Mate
need a few more fine tune works.
>>> Not really for pull, but as a placeholder, and for someone who want to
>>> take a look.
>>>
>>> Best Regards,
>>> Raymond Liu
>>>
>>>
>>> -Original Message-
>>> From: Reynold Xin [mailt
for someone who want to
> > take a look.
> >
> > Best Regards,
> > Raymond Liu
> >
> >
> > -Original Message-
> > From: Reynold Xin [mailto:r...@apache.org]
> > Sent: Tuesday, November 05, 2013 10:07 AM
> > To: dev@spark.incubator.apache.org
der, and for someone who want to
> take a look.
>
> Best Regards,
> Raymond Liu
>
>
> -Original Message-
> From: Reynold Xin [mailto:r...@apache.org]
> Sent: Tuesday, November 05, 2013 10:07 AM
> To: dev@spark.incubator.apache.org
> Subject: Re: issue regarding
: Reynold Xin [mailto:r...@apache.org]
Sent: Tuesday, November 05, 2013 10:07 AM
To: dev@spark.incubator.apache.org
Subject: Re: issue regarding akka, protobuf and Hadoop version
I think we are near the end of Scala 2.9.3 development, and will merge the
Scala 2.10 branch into master and make it the
apache.org]
> Sent: Tuesday, November 05, 2013 8:34 AM
> To: dev@spark.incubator.apache.org
> Subject: Re: issue regarding akka, protobuf and Hadoop version
>
> I chatted with Matt Massie about this, and here are some options:
>
> 1. Use dependency injection in google-guice to make
regarding akka, protobuf and Hadoop version
I chatted with Matt Massie about this, and here are some options:
1. Use dependency injection in google-guice to make Akka use one version of
protobuf, and YARN use the other version.
2. Look into OSGi to accomplish the same goal.
3. Rewrite the messagi
Adding in a few guys so they can chime in.
On Mon, Nov 4, 2013 at 4:33 PM, Reynold Xin wrote:
> I chatted with Matt Massie about this, and here are some options:
>
> 1. Use dependency injection in google-guice to make Akka use one version
> of protobuf, and YARN use the other version.
>
> 2. Lo
I chatted with Matt Massie about this, and here are some options:
1. Use dependency injection in google-guice to make Akka use one version of
protobuf, and YARN use the other version.
2. Look into OSGi to accomplish the same goal.
3. Rewrite the messaging part of Spark to use a simple, custom RP
Hi
I am working on porting spark onto Hadoop 2.2.0, With some renaming and
call into new YARN API works done. I can run up the spark master. While I
encounter the issue that Executor Actor could not connecting to Driver actor.
After some investigation, I found the root cause is
12 matches
Mail list logo
