java.io.InvalidClassException using spark1.4.1 for Terasort

2015-10-14 Thread Shreeharsha G Neelakantachar
Hi, I have Terasort being executed on spark1.4.1 with hadoop 2.7 for a datasize of 1TB. When i change my os user from spark1 to hduser, i am observing below exception. Please let me know what is wrong here. I tried to update scala-2.10 to 2.11 and compiled Terasort scala code using sbt.

Re: java.io.InvalidClassException using spark1.4.1 for Terasort

2015-10-14 Thread Sonal Goyal
This is probably a versioning issue, are you sure your code is compiling and running against the same versions? On Oct 14, 2015 2:19 PM, "Shreeharsha G Neelakantachar" < shreeharsh...@in.ibm.com> wrote: > Hi, > I have Terasort being executed on spark1.4.1 with hadoop 2.7 for a > datasize of