That directory is not present on version 0.8.0 (the one I am using). However, there are the files for FlatMapFunction in spark 0.8.0:
$ find ./ -name FlatMapFunction* ./assembly/target/scala-2.9.3/cache/assembly/global/assembly/046f8c33ceea082eba335f924f10506f884e593c_dir/org/apache/spark/api/java/function/FlatMapFunction2.class ./assembly/target/scala-2.9.3/cache/assembly/global/assembly/046f8c33ceea082eba335f924f10506f884e593c_dir/org/apache/spark/api/java/function/FlatMapFunction.class ./core/src/main/scala/org/apache/spark/api/java/function/FlatMapFunction2.scala ./core/src/main/scala/org/apache/spark/api/java/function/FlatMapFunction.scala ./core/target/scala-2.9.3/classes/org/apache/spark/api/java/function/FlatMapFunction2.class ./core/target/scala-2.9.3/classes/org/apache/spark/api/java/function/FlatMapFunction.class ./examples/target/scala-2.9.3/cache/examples/global/assembly/046f8c33ceea082eba335f924f10506f884e593c_dir/org/apache/spark/api/java/function/FlatMapFunction2.class ./examples/target/scala-2.9.3/cache/examples/global/assembly/046f8c33ceea082eba335f924f10506f884e593c_dir/org/apache/spark/api/java/function/FlatMapFunction.class All of the FlatMapFunction.class files have a modification time bigger than the .java file, which I suspect means that they have been created from the new version of the java file (all of them!) Cheers, Eduardo. On Thu, Oct 3, 2013 at 3:38 PM, Martin Weindel <[email protected]>wrote: > Hi Eduardo, > > if you are using Spark 0.7.3, I remember that I had to replace the class > file additional at > spark-0.7.3/core/target/scala-2.9.3/classes/spark/api/java/function/ > > Martin > > Am 03.10.2013 22:35, schrieb Eduardo Berrocal: > > Hi Martin, > > Yes, that is what is seems. However, it is unlikely that is the case, > because I have all spark classes on my home, which is mounted on NFS to all > nodes. Unless there is something else I am missing... > > Edu > > > On Thu, Oct 3, 2013 at 3:29 PM, Martin Weindel > <[email protected]>wrote: > >> Hi Eduardo, >> >> it seems to me that your second problem is caused by inconsistent, i.e. >> different classes in master and worker JVMs. >> Are you sure, that you have replaced the changed FlatMapFunction on all >> worker nodes and also on master? >> >> Regards, >> Martin >> >> 13/10/03 13:27:44 INFO cluster.ClusterTaskSetManager: Lost TID 0 (task >> 1.0:0) >> 13/10/03 13:27:44 INFO cluster.ClusterTaskSetManager: Loss was due to >> java.io.InvalidClassException >> java.io.InvalidClassException: >> org.apache.spark.api.java.function.FlatMapFunction; local class >> incompatible: stream classdesc serialVersionUID = -1748278142466443391, >> local class serialVersionUID = 2220150375729402137 >> >> >> > >
