Great, thanks. So I bet the only remaining problem is getting the right Guava in to Spark client and workers.
Spark shades Guava so it is probably not causing the problems since it’s never supposed to be in scope. When I use the same version number I get errors anyway so it must be in Mahout artifacts and probably the assembly jar created in mahout/spark with transitive dependencies. I was planning to wait on Dmitriy’s refactoring before messing with that but in a separate branch I did a drastically pared down version that might be better to use. On Feb 26, 2015, at 8:58 AM, Andrew Palumbo <[email protected]> wrote: just tested spark-testnb with the -ma option set with no problems. spark naive bayes is pretty bland and doesn't use any classes other than core scala, mahout and spark. On 02/26/2015 11:36 AM, Pat Ferrel wrote: > A difference in how classes are found comes about when running a standalone > cluster. You start Spark with the spark/sbin/start-all.sh with only localhost > in slaves. Then run the driver “mahout nbtest … -ma > spark://Maclaurin.local:7077” or some such. > > re: poms, of course—stupid question. > > On Feb 26, 2015, at 8:19 AM, Andrew Palumbo <[email protected]> wrote: > > The NB Drivers were working (locally) with the 1.2.1 patch before those deps > were added. I haven't tested the drivers since but I did test a script that > runs NB from the spark-shell with no problems. > > I put those in math-scala since all of our scala modules depend on math-scala. > > On 02/26/2015 11:01 AM, Pat Ferrel wrote: >> should these be in all scala poms or just math-scala? >> >> Is the NB stuff working with the 1.2 branch? >> >> On Feb 24, 2015, at 1:25 PM, Andrew Palumbo <[email protected]> wrote: >> >> sorry- I left out the scala-compiler artifact (at the top) it should read: >> >> <dependency> >> <groupId>org.scala-lang</groupId> >> <artifactId>scala-compiler</artifactId> >> <version>${scala.version}</version> >> </dependency> >> <dependency> >> <groupId>org.scala-lang</groupId> >> <artifactId>scala-reflect</artifactId> >> <version>${scala.version}</version> >> </dependency> >> <dependency> >> <groupId>org.scala-lang</groupId> >> <artifactId>scala-library</artifactId> >> <version>${scala.version}</version> >> </dependency> >> <dependency> >> <groupId>org.scala-lang</groupId> >> <artifactId>scala-actors</artifactId> >> <version>${scala.version}</version> >> </dependency> >> <dependency> >> <groupId>org.scala-lang</groupId> >> <artifactId>scalap</artifactId> >> <version>${scala.version}</version> >> </dependency> >> >> >> >> adding these has $mahout spark-shell working for me on spark 1.2.1. >> >> >> >> On 02/24/2015 04:20 PM, Andrew Palumbo wrote: >>> adding in the following dependencies to the math-scala pom.xml seems to fix >>> the problem for me on the old master before the revert/1.2 branch: >>> >>> <dependency> >>> <groupId>org.scala-lang</groupId> >>> <artifactId>scala-reflect</artifactId> >>> <version>${scala.version}</version> >>> </dependency> >>> <dependency> >>> <groupId>org.scala-lang</groupId> >>> <artifactId>scala-library</artifactId> >>> <version>${scala.version}</version> >>> </dependency> >>> <dependency> >>> <groupId>org.scala-lang</groupId> >>> <artifactId>scala-actors</artifactId> >>> <version>${scala.version}</version> >>> </dependency> >>> <dependency> >>> <groupId>org.scala-lang</groupId> >>> <artifactId>scalap</artifactId> >>> <version>${scala.version}</version> >>> </dependency> >>> >>> >>> I dont know if this will help with item-similarity, and doesnt seem to have >>> anything to do with the crash that Andrew M. is experiencing on the >>> reverted spark-1.1.0 master. >>> >>> >>> >>> On 02/24/2015 03:59 PM, Andrew Musselman wrote: >>>> Except after some time it blew up: >>>> >>>> $ bin/mahout spark-shell >>>> SLF4J: Class path contains multiple SLF4J bindings. >>>> SLF4J: Found binding in >>>> [jar:file:/home/akm/mahout/mrlegacy/target/mahout-mrlegacy-1.0-SNAPSHOT-job.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>>> SLF4J: Found binding in >>>> [jar:file:/home/akm/mahout/spark/target/mahout-spark_2.10-1.0-SNAPSHOT-job.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>>> SLF4J: Found binding in >>>> [jar:file:/home/akm/spark/assembly/target/scala-2.10/spark-assembly-1.1.1-hadoop1.1.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an >>>> explanation. >>>> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] >>>> >>>> _ _ >>>> _ __ ___ __ _| |__ ___ _ _| |_ >>>> | '_ ` _ \ / _` | '_ \ / _ \| | | | __| >>>> | | | | | | (_| | | | | (_) | |_| | |_ >>>> |_| |_| |_|\__,_|_| |_|\___/ \__,_|\__| version 1.0 >>>> >>>> >>>> Using Scala version 2.10.0 (Java HotSpot(TM) 64-Bit Server VM, Java >>>> 1.7.0_03) >>>> Type in expressions to have them evaluated. >>>> Type :help for more information. >>>> 15/02/24 12:23:26 WARN Utils: Your hostname, ubuntu resolves to a loopback >>>> address: 127.0.1.1; using 5.5.8.1 instead (on interface as0t1) >>>> 15/02/24 12:23:26 WARN Utils: Set SPARK_LOCAL_IP if you need to bind to >>>> another address >>>> 15/02/24 12:23:39 WARN NativeCodeLoader: Unable to load native-hadoop >>>> library for your platform... using builtin-java classes where applicable >>>> Created spark context.. >>>> Mahout distributed context is available as "implicit val sdc". >>>> mahout> 15/02/24 12:24:17 ERROR Remoting: >>>> org.apache.spark.storage.BlockManagerId; local class incompatible: stream >>>> classdesc serialVersionUID = 1677335532749418220, local class >>>> serialVersionUID = -7366074099953117729 >>>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>>> at >>>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at >>>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>>> at >>>> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>>> at >>>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>>> at >>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>>> at scala.util.Try$.apply(Try.scala:161) >>>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>>> at >>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>> at >>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>>> at >>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>> at >>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>>> 15/02/24 12:24:50 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>>> at >>>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at >>>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>>> at >>>> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>>> at >>>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>>> at >>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>>> at scala.util.Try$.apply(Try.scala:161) >>>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>>> at >>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>> at >>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>>> at >>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>> at >>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>>> 15/02/24 12:25:23 ERROR TaskSchedulerImpl: Lost an executor 0 (already >>>> removed): remote Akka client disassociated >>>> 15/02/24 12:26:00 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>>> at >>>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at >>>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>>> at >>>> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>>> at >>>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>>> at >>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>>> at scala.util.Try$.apply(Try.scala:161) >>>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>>> at >>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>> at >>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>>> at >>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>> at >>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>>> 15/02/24 12:26:33 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>>> at >>>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at >>>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>>> at >>>> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>>> at >>>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>>> at >>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>>> at scala.util.Try$.apply(Try.scala:161) >>>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>>> at >>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>> at >>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>>> at >>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>> at >>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>>> 15/02/24 12:27:06 ERROR TaskSchedulerImpl: Lost an executor 1 (already >>>> removed): remote Akka client disassociated >>>> 15/02/24 12:27:43 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>>> at >>>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at >>>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>>> at >>>> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>>> at >>>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>>> at >>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>>> at scala.util.Try$.apply(Try.scala:161) >>>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>>> at >>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>> at >>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>>> at >>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>> at >>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>>> 15/02/24 12:28:16 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>>> at >>>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at >>>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>>> at >>>> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>>> at >>>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>>> at >>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>>> at scala.util.Try$.apply(Try.scala:161) >>>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>>> at >>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>> at >>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>>> at >>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>> at >>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>>> 15/02/24 12:28:49 ERROR TaskSchedulerImpl: Lost an executor 2 (already >>>> removed): remote Akka client disassociated >>>> 15/02/24 12:29:26 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>>> at >>>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at >>>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>>> at >>>> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>>> at >>>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>>> at >>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>>> at scala.util.Try$.apply(Try.scala:161) >>>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>>> at >>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>> at >>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>>> at >>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>> at >>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>>> 15/02/24 12:29:59 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>>> at >>>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at >>>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>>> at >>>> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>>> at >>>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>>> at >>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>>> at scala.util.Try$.apply(Try.scala:161) >>>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>>> at >>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>> at >>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>>> at >>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>> at >>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>>> 15/02/24 12:30:32 ERROR TaskSchedulerImpl: Lost an executor 3 (already >>>> removed): remote Akka client disassociated >>>> 15/02/24 12:31:09 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>>> at >>>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at >>>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>>> at >>>> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>>> at >>>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>>> at >>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>>> at scala.util.Try$.apply(Try.scala:161) >>>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>>> at >>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>> at >>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>>> at >>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>> at >>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>>> 15/02/24 12:31:42 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>>> at >>>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at >>>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>>> at >>>> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>>> at >>>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>>> at >>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>>> at scala.util.Try$.apply(Try.scala:161) >>>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>>> at >>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>> at >>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>>> at >>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>> at >>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>>> 15/02/24 12:32:15 ERROR TaskSchedulerImpl: Lost an executor 4 (already >>>> removed): remote Akka client disassociated >>>> 15/02/24 12:32:51 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>>> at >>>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at >>>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>>> at >>>> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>>> at >>>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>>> at >>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>>> at scala.util.Try$.apply(Try.scala:161) >>>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>>> at >>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>> at >>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>>> at >>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>> at >>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>>> 15/02/24 12:33:24 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>>> at >>>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at >>>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>>> at >>>> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>>> at >>>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>>> at >>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>>> at scala.util.Try$.apply(Try.scala:161) >>>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>>> at >>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>> at >>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>>> at >>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>> at >>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>>> 15/02/24 12:33:58 ERROR TaskSchedulerImpl: Lost an executor 5 (already >>>> removed): remote Akka client disassociated >>>> 15/02/24 12:34:34 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>>> at >>>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at >>>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>>> at >>>> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>>> at >>>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>>> at >>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>>> at scala.util.Try$.apply(Try.scala:161) >>>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>>> at >>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>> at >>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>>> at >>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>> at >>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>>> 15/02/24 12:35:07 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>>> at >>>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at >>>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>>> at >>>> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>>> at >>>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>>> at >>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>>> at scala.util.Try$.apply(Try.scala:161) >>>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>>> at >>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>> at >>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>>> at >>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>> at >>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>>> 15/02/24 12:35:41 ERROR TaskSchedulerImpl: Lost an executor 6 (already >>>> removed): remote Akka client disassociated >>>> 15/02/24 12:36:17 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>>> at >>>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at >>>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>>> at >>>> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>>> at >>>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>>> at >>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>>> at scala.util.Try$.apply(Try.scala:161) >>>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>>> at >>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>> at >>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>>> at >>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>> at >>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>>> 15/02/24 12:36:50 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>>> at >>>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at >>>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>>> at >>>> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>>> at >>>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>>> at >>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>>> at scala.util.Try$.apply(Try.scala:161) >>>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>>> at >>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>> at >>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>>> at >>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>> at >>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>>> 15/02/24 12:37:23 ERROR TaskSchedulerImpl: Lost an executor 7 (already >>>> removed): remote Akka client disassociated >>>> 15/02/24 12:38:00 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>>> at >>>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at >>>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>>> at >>>> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>>> at >>>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>>> at >>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>>> at scala.util.Try$.apply(Try.scala:161) >>>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>>> at >>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>> at >>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>>> at >>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>> at >>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>>> 15/02/24 12:38:33 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>>> at >>>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at >>>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>>> at >>>> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>>> at >>>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>>> at >>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>>> at scala.util.Try$.apply(Try.scala:161) >>>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>>> at >>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>> at >>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>>> at >>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>> at >>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>>> 15/02/24 12:39:06 ERROR TaskSchedulerImpl: Lost an executor 8 (already >>>> removed): remote Akka client disassociated >>>> 15/02/24 12:39:43 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>>> at >>>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at >>>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>>> at >>>> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>>> at >>>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>>> at >>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>>> at scala.util.Try$.apply(Try.scala:161) >>>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>>> at >>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>> at >>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>>> at >>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>> at >>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>>> 15/02/24 12:40:16 ERROR Remoting: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> java.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; >>>> local class incompatible: stream classdesc serialVersionUID = >>>> 1677335532749418220, local class serialVersionUID = -7366074099953117729 >>>> at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:604) >>>> at >>>> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1601) >>>> at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1514) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1750) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at >>>> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1964) >>>> at >>>> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1888) >>>> at >>>> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) >>>> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347) >>>> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:369) >>>> at >>>> akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136) >>>> at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57) >>>> at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136) >>>> at >>>> akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104) >>>> at scala.util.Try$.apply(Try.scala:161) >>>> at akka.serialization.Serialization.deserialize(Serialization.scala:98) >>>> at >>>> akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23) >>>> at >>>> akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55) >>>> at akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73) >>>> at >>>> akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764) >>>> at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) >>>> at akka.actor.ActorCell.invoke(ActorCell.scala:456) >>>> at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) >>>> at akka.dispatch.Mailbox.run(Mailbox.scala:219) >>>> at >>>> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) >>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) >>>> at >>>> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) >>>> 15/02/24 12:40:49 ERROR TaskSchedulerImpl: Lost an executor 9 (already >>>> removed): remote Akka client disassociated >>>> 15/02/24 12:40:49 ERROR SparkDeploySchedulerBackend: Application has been >>>> killed. Reason: Master removed our application: FAILED >>>> 15/02/24 12:40:49 ERROR TaskSchedulerImpl: Exiting due to error from >>>> cluster scheduler: Master removed our application: FAILED >>>> >>>> >>>> On Tue, Feb 24, 2015 at 12:24 PM, Andrew Musselman < >>>> [email protected]> wrote: >>>> >>>>> Bingo, works off master now; thanks Dmitriy. >>>>> >>>>> On Tue, Feb 24, 2015 at 11:54 AM, Dmitriy Lyubimov <[email protected]> >>>>> wrote: >>>>> >>>>>> ok spark 1.2 is mirrored now. >>>>>> and master should be also ok (back to 1.1) >>>>>> >>>>>> On Tue, Feb 24, 2015 at 11:53 AM, Andrew Musselman < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> I reset hard to the previous commit, created a branch, and pushed it. >>>>>>> >>>>>>> I got email confirmation like so: >>>>>>> Repository: mahout >>>>>>> Updated Branches: >>>>>>> refs/heads/spark-1.2 [created] 901ef03b4 >>>>>>> >>>>>>> On Tue, Feb 24, 2015 at 11:47 AM, Dmitriy Lyubimov <[email protected]> >>>>>>> wrote: >>>>>>> >>>>>>>> yeah ok so you pushed 1.2 branch to asf but it is not yet in github. >>>>>> iti >>>>>>>> should be there eventually, give it a bit of time. >>>>>>>> >>>>>>>> On Tue, Feb 24, 2015 at 11:35 AM, Dmitriy Lyubimov <[email protected] >>>>>>>> wrote: >>>>>>>> >>>>>>>>> what exactly did you try to do? >>>>>>>>> >>>>>>>>> just resetting HEAD will not work on remote branch -- you need >>>>>>> force-sync >>>>>>>>> that (with +) since it is a history-rewriting push, but asf git does >>>>>>> not >>>>>>>>> allow that. >>>>>>>>> >>>>>>>>> ASF will mirror ALL branches afaik. I think i've done it before. so >>>>>> if >>>>>>>> you >>>>>>>>> create a new one it should (eventually) get there. >>>>>>>>> >>>>>>>>> On Tue, Feb 24, 2015 at 11:18 AM, Andrew Musselman < >>>>>>>>> [email protected]> wrote: >>>>>>>>> >>>>>>>>>> Does ASF git get mirrored to GitHub? I tried pushing a branch and >>>>>>> don't >>>>>>>>>> see it there yet. >>>>>>>>>> >>>>>>>>>> On Tue, Feb 24, 2015 at 11:16 AM, Dmitriy Lyubimov < >>>>>> [email protected] >>>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>>> On Tue, Feb 24, 2015 at 10:55 AM, Pat Ferrel < >>>>>> [email protected] >>>>>>>>>>> wrote: >>>>>>>>>>> >>>>>>>>>>>> to be safe I’d “git reset —hard xyz” to the commit previous to >>>>>> the >>>>>>>>>> 1.2.1 >>>>>>>>>>> As i just explained, that resets are not possible with ASF git. >>>>>>>>>> Reverting >>>>>>>>>>> is the only option. >>>>>>>>>>> >>>>>>>>>>> -d >>>>>>>>>>> >
