pan3793 commented on PR #6603:
URL: https://github.com/apache/kyuubi/pull/6603#issuecomment-2304122237
I checked the failure message from `FinalStageResourceManagerSuite`
```
16:21:05.237 ERROR org.apache.spark.network.server.TransportRequestHandler:
Error while invoking RpcHandler#receive() on RPC id 9220236832923458123
java.io.InvalidClassException: scala.concurrent.duration.FiniteDuration;
local class incompatible: stream classdesc serialVersionUID =
-4594686286536372853, local class serialVersionUID = -6513803676778706429
at
java.base/java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:597)
...
at
org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:87)
at
org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:123)
at
org.apache.spark.rpc.netty.NettyRpcEnv.$anonfun$deserialize$2(NettyRpcEnv.scala:299)
at scala.util.DynamicVariable.withValue(DynamicVariable.scala:59)
at
org.apache.spark.rpc.netty.NettyRpcEnv.deserialize(NettyRpcEnv.scala:352)
```
the root cause is that it launches a local cluster using SPARK_HOME, thus
using a different Scala library with SPARK_HOME may cause serialization issues
as JavaSerializer is not used here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
