[
https://issues.apache.org/jira/browse/LIVY-505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gyorgy Gal updated LIVY-505:
----------------------------
Fix Version/s: 0.10.0
(was: 0.9.0)
This issue has been moved to the 0.10.0 release as part of a bulk update. If
you feel this is moved out inappropriately, feel free to provide justification
and reset the Fix Version to 0.9.0.
> sparkR.session failed with "invalid jobj 1" error in Spark 2.3
> --------------------------------------------------------------
>
> Key: LIVY-505
> URL: https://issues.apache.org/jira/browse/LIVY-505
> Project: Livy
> Issue Type: Bug
> Components: Interpreter
> Affects Versions: 0.5.0, 0.5.1
> Reporter: shanyu zhao
> Priority: Major
> Fix For: 0.10.0
>
> Attachments: LIVY-505.patch
>
>
> In Spark 2.3 cluster, use Zeppelin with livy2 interpreter, and type:
> {code:java}
> %sparkr
> sparkR.session(){code}
> You will see error:
> [1] "Error in writeJobj(con, object): invalid jobj 1"
> In a successful case with older livy and spark versions, we see something
> like this:
> Java ref type org.apache.spark.sql.SparkSession id 1
> This indicates isValidJobj() function in Spark code returned false for
> SparkSession obj. This is isValidJobj() function in Spark 2.3 code FYI:
> {code:java}
> isValidJobj <- function(jobj) {
> if (exists(".scStartTime", envir = .sparkREnv)) {
> jobj$appId == get(".scStartTime", envir = .sparkREnv)
> } else {
> FALSE
> }
> }{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
