I also had a java.lang.ArrayIndexOutOfBoundsException: 28499, very similar,
after migrating to Spark 3.0.1 from 2.4.3, when performing a count,
countApprox or rdd operation on Spark datasets.
For me, this solution worked:
https://programmersought.com/article/35311239379/
Basically I added this
I've found the problem.
I've removed guava14.0 from the extraClassPath in my spark job, and there is
no exception.
--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
-
To unsubscribe e-mail:
Hi,
I’ve got the following exception when running a connected component example in
Spark 3.0.0.
This code runs without exception in Spark 2.4.
It throws the exception when calling RDDOperationScope.toJson method.
I’m not sure why it throws the execution in Spark 3.0. There is no exception in
