Igor Melnichenko created TOREE-430:

             Summary: ClassNotFoundException with lambdas on CDH 5.10.0
                 Key: TOREE-430
                 URL: https://issues.apache.org/jira/browse/TOREE-430
             Project: TOREE
          Issue Type: Bug
          Components: Kernel
    Affects Versions: 0.1.0
         Environment: CDH 5.10.0 (Spark 1.6.0, Scala 2.10.5)
            Reporter: Igor Melnichenko

In the specified environment, Toree classloader fails to load classes defined 
and compiled in REPL. For instance, the following Spark example fails with 
ClassNotFoundException and works fine if the lambda is removed:
val count = sc.parallelize(1 to NUM_SAMPLES).filter { _ =>
  val x = math.random
  val y = math.random
  x*x + y*y < 1
println(s"Pi is roughly ${4.0 * count / NUM_SAMPLES}")

Cause: a location of a directory used by a REPL compiler to store 
runtime-compiled classes is different from a location where classloader tries 
to find these classes.

PR with fix will be opened soon.

This message was sent by Atlassian JIRA

Reply via email to