With the fixes, I could run it fine on top of branch-1.0
On master when running on YARN I am getting another KryoException:
Exception in thread "main" org.apache.spark.SparkException: Job aborted due
to stage failure: Task 247 in stage 52.0 failed 4 times, most recent
failure: Lost task 247.3 in stage 52.0 (TID 10010,
tblpmidn05adv-hdp.tdc.vzwcorp.com):
com.esotericsoftware.kryo.KryoException: java.lang.ArrayStoreException
Serialization trace:
shouldSend (org.apache.spark.mllib.recommendation.OutLinkBlock)
com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.read(FieldSerializer.java:626)
com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:221)
com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:729)
OutLinkBlock does not extend Serializable...Also I did not see this failure
before..
Was the fix tested on YARN ?
Thanks.
Deb
On Thu, Aug 14, 2014 at 11:28 PM, GrahamDennis <[email protected]> wrote:
> Github user GrahamDennis commented on the pull request:
>
> https://github.com/apache/spark/pull/1948#issuecomment-52278145
>
> I've convinced myself that this PR fixes SPARK-2878, and think it
> should be merged. Thanks @rxin!
>
>
> ---
> If your project is set up for it, you can reply to this email and have your
> reply appear on GitHub as well. If your project does not have this feature
> enabled and wishes so, or if the feature is enabled but not working, please
> contact infrastructure at [email protected] or file a JIRA ticket
> with INFRA.
> ---
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [email protected]
> For additional commands, e-mail: [email protected]
>
>
