RaoZhiRou-Z opened a new issue, #5508:
URL: https://github.com/apache/incubator-gluten/issues/5508
### Backend
VL (Velox)
### Bug description
backend:velox
errors:
24/04/23 21:27:46 ERROR Executor: Exception in task 242.0 in stage 1.0
(TID 338)
java.lang.UnsupportedOperationException
at
io.glutenproject.vectorized.ColumnarBatchSerializerInstance.serializeStream(ColumnarBatchSerializer.scala:241)
at
org.apache.spark.shuffle.ShufflePartitionPairsWriter.open(ShufflePartitionPairsWriter.scala:76)
at
org.apache.spark.shuffle.ShufflePartitionPairsWriter.write(ShufflePartitionPairsWriter.scala:59)
at
org.apache.spark.util.collection.WritablePartitionedIterator.writeNext(WritablePartitionedPairCollection.scala:83)
at
org.apache.spark.util.collection.ExternalSorter.$anonfun$writePartitionedMapOutput$1(ExternalSorter.scala:767)
at
scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1535)
at
org.apache.spark.util.collection.ExternalSorter.writePartitionedMapOutput(ExternalSorter.scala:770)
at
org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:70)
at
org.apache.spark.shuffle.ShuffleWriteProcessor.write(ShuffleWriteProcessor.scala:59)
at
org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99)
at
org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:52)
at org.apache.spark.scheduler.Task.run(Task.scala:136)
at
org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:552)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1535)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:555)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
### Spark version
Spark-3.3.x
### Spark configurations
spark.driver.userClassPathFirst true
spark.executor.userClassPathFirst true
spark.executor.extraClassPath
./gluten-velox-bundle-spark3.3_2.12-1.1.1.jar
spark.driver.extraClassPath
/home/work/gluten-velox-bundle-spark3.3_2.12-1.1.1.jar
spark.master yarn
spark.submit.deployMode client
### System information
_No response_
### Relevant logs
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
