dongjoon-hyun commented on pull request #34368:
URL: https://github.com/apache/spark/pull/34368#issuecomment-950548048
Does this code work for all JVMs, @LuciferYang ? When I tried this on Java
17, it seems to fail.
```
$ java -version
openjdk version "17" 2021-09-14 LTS
OpenJDK Runtime Environment Zulu17.28+13-CA (build 17+35-LTS)
OpenJDK 64-Bit Server VM Zulu17.28+13-CA (build 17+35-LTS, mixed mode,
sharing)
$ mvn clean install -pl repl
...
[INFO] --- scalatest-maven-plugin:2.0.2:test (test) @ spark-repl_2.12 ---
Discovery starting.
Discovery completed in 157 milliseconds.
Run starting. Expected test count is: 44
ReplSuite:
Spark context available as 'sc' (master = local, app id =
local-1635140304149).
Spark session available as 'spark'.
- SPARK-15236: use Hive catalog
Spark context available as 'sc' (master = local, app id =
local-1635140306451).
Spark session available as 'spark'.
- SPARK-15236: use in-memory catalog
Spark context available as 'sc' (master = local, app id =
local-1635140307427).
Spark session available as 'spark'.
- broadcast vars *** FAILED ***
isContain was true Interpreter output contained 'Exception':
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 3.3.0-SNAPSHOT
/_/
Using Scala version 2.12.15 (OpenJDK 64-Bit Server VM, Java 17)
Type in expressions to have them evaluated.
Type :help for more information.
scala>
scala> array: Array[Int] = Array(0, 0, 0, 0, 0)
scala> broadcastArray: org.apache.spark.broadcast.Broadcast[Array[Int]] =
Broadcast(0)
scala> java.lang.IllegalAccessException: Can not set final $iw field
$Lambda$2881/0x0000000801887858.arg$1 to $iw
at
java.base/jdk.internal.reflect.UnsafeFieldAccessorImpl.throwFinalFieldIllegalAccessException(UnsafeFieldAccessorImpl.java:76)
at
java.base/jdk.internal.reflect.UnsafeFieldAccessorImpl.throwFinalFieldIllegalAccessException(UnsafeFieldAccessorImpl.java:80)
at
java.base/jdk.internal.reflect.UnsafeQualifiedObjectFieldAccessorImpl.set(UnsafeQualifiedObjectFieldAccessorImpl.java:79)
at java.base/java.lang.reflect.Field.set(Field.java:799)
at org.apache.spark.util.ClosureCleaner$.clean(ClosureCleaner.scala:398)
at org.apache.spark.util.ClosureCleaner$.clean(ClosureCleaner.scala:162)
at org.apache.spark.SparkContext.clean(SparkContext.scala:2490)
at org.apache.spark.rdd.RDD.$anonfun$map$1(RDD.scala:414)
at
org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at
org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)
at org.apache.spark.rdd.RDD.withScope(RDD.scala:406)
at org.apache.spark.rdd.RDD.map(RDD.scala:413)
... 95 elided
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
