[jira] [Created] (ZEPPELIN-1096) spark interpreter throws ClassNotFoundExceptions if spark authentication is enabled

[Jonathan Esterhazy (JIRA)]

Jonathan Esterhazy created ZEPPELIN-1096:
--------------------------------------------

             Summary: spark interpreter throws ClassNotFoundExceptions if spark 
authentication is enabled
                 Key: ZEPPELIN-1096
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1096
             Project: Zeppelin
          Issue Type: Bug
          Components: Interpreters
    Affects Versions: 0.5.6
         Environment: aws emr (emr-4.7.1), spark 1.6.1, zeppelin 0.5.6
            Reporter: Jonathan Esterhazy


The spark interpreter can't run code defined in a notebook when spark 
authentication is enabled. Scala code that uses only built-in functions works 
fine, but executors throw classnotfoundexceptions when they try to run 
functions defined in the notebook.

For example, 

For example, this code works:

{code:scala}
val rdd = sc.textFile("hdfs://my-text-file")
rdd.take(1).foreach(println)

rdd.saveAsTextFile("hdfs:///my-other-text-file")
{code}

but code like this...

{code:scala}
rdd.filter(_.contains("my data"))
{code}

fails with 

{noformat}
Caused by: java.lang.ClassNotFoundException: 
$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$anonfun$1
        at 
org.apache.spark.repl.ExecutorClassLoader.findClass(ExecutorClassLoader.scala:84)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        ...

{noformat}





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)