My apologies for following my own post, but a friend just pointed out that if I use kryo with reference counting AND copy-and-paste, this runs. However, if I try to "load <file>", this fails as described below. I thought load was supposed to be equivalent? Thanks!-Mike
From: Michael Albert <m_albert...@yahoo.com.INVALID> To: User <user@spark.apache.org> Sent: Friday, April 3, 2015 2:45 PM Subject: variant record by case classes in shell fails? Greetings! For me, the code below fails from the shell.However, I can do essentially the same from compiled code, exporting the jar. If I use default serialization or kryo with reference tracking, the error message tells me it can't find the constructor for "A".If I use kryo with reference tracking, I get a stack overflow. I'm using Spark 1.2.1 on AWS EMR (hadoop 2.4). I've also tried putting this code inside an object. Is this just me? Am I overlooking something obvious? Thanks! -Mike :paste sealed class AorBcase class A(i: Int) extends AorBcase class B(i: Int, j: Int) extends AorB sc.parallelize(0.until(1)).map{ _ => val x = A(1) x}.collect()