chris created ZEPPELIN-4083:
-------------------------------

             Summary: spark 2.4 uses a more recent commons-lang3
                 Key: ZEPPELIN-4083
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4083
             Project: Zeppelin
          Issue Type: Bug
          Components: Interpreters, pySpark
    Affects Versions: 0.8.2
            Reporter: chris


It appears that there is a incompatibility between Spark 2.4 and Zeppelin 0.8.2 
commons-lang3. Spark is using commons-lang3-3.5 while Zeppelin uses 
commons-lang3-3.4

This results in an error when trying to perform a spark.read.csv() error:

```java.io.InvalidClassException: org.apache.commons.lang3.time.FastDateParser; 
local class incompatible: stream classdesc serialVersionUID = 2, local class 
serialVersionUID = 3```

This issue only occurs when running in a standalone cluster mode, no probs 
working in local mode. Also this issue does not occur outside zeppelin using 
pyspark shell or spark-submit

I'm aware of related issues: 

ZEPPELIN-1977

ZEPPELIN-3939

However it's not clear there any solution except for waiting for subsequent 
versions of 0.8.x or 0.9.x 

 Your advice would be very much welcomed



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to