chris created ZEPPELIN-4083: ------------------------------- Summary: spark 2.4 uses a more recent commons-lang3 Key: ZEPPELIN-4083 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4083 Project: Zeppelin Issue Type: Bug Components: Interpreters, pySpark Affects Versions: 0.8.2 Reporter: chris
It appears that there is a incompatibility between Spark 2.4 and Zeppelin 0.8.2 commons-lang3. Spark is using commons-lang3-3.5 while Zeppelin uses commons-lang3-3.4 This results in an error when trying to perform a spark.read.csv() error: ```java.io.InvalidClassException: org.apache.commons.lang3.time.FastDateParser; local class incompatible: stream classdesc serialVersionUID = 2, local class serialVersionUID = 3``` This issue only occurs when running in a standalone cluster mode, no probs working in local mode. Also this issue does not occur outside zeppelin using pyspark shell or spark-submit I'm aware of related issues: ZEPPELIN-1977 ZEPPELIN-3939 However it's not clear there any solution except for waiting for subsequent versions of 0.8.x or 0.9.x Your advice would be very much welcomed -- This message was sent by Atlassian JIRA (v7.6.3#76005)