Neuw84 commented on issue #10670: URL: https://github.com/apache/incubator-gluten/issues/10670#issuecomment-3280365075
@zhouyuan, on write it seems to solve that specific issue. Now I am getting (Java 17). ``` 25[/09/11](http://98.81.182.194:8888/09/11) 12:24:43 ERROR TaskResources: Task 11 failed by error: java.lang.UnsatisfiedLinkError: 'long org.apache.gluten.memory.NativeMemoryManagerJniWrapper.create(java.lang.String, org.apache.gluten.memory.listener.ReservationListener, byte[])' at org.apache.gluten.memory.NativeMemoryManagerJniWrapper.create(Native Method) at org.apache.gluten.memory.NativeMemoryManager$Impl.<init>(NativeMemoryManager.scala:56) at org.apache.gluten.memory.NativeMemoryManager$.apply(NativeMemoryManager.scala:121) at org.apache.gluten.runtime.Runtime$RuntimeImpl.<init>(Runtime.scala:44) at org.apache.gluten.runtime.Runtime$.apply(Runtime.scala:38) at org.apache.gluten.runtime.Runtimes$.create(Runtimes.scala:34) at org.apache.gluten.runtime.Runtimes$.$anonfun$contextInstance$1(Runtimes.scala:30) at org.apache.spark.task.TaskResourceRegistry.$anonfun$addResourceIfNotRegistered$1(TaskResources.scala:343) at org.apache.spark.task.TaskResourceRegistry.lock(TaskResources.scala:263) at org.apache.spark.task.TaskResourceRegistry.addResourceIfNotRegistered(TaskResources.scala:339) at org.apache.spark.task.TaskResources$.addResourceIfNotRegistered(TaskResources.scala:175) at org.apache.gluten.runtime.Runtimes$.contextInstance(Runtimes.scala:30) at org.apache.gluten.runtime.Runtimes.contextInstance(Runtimes.scala) at org.apache.gluten.vectorized.NativePlanEvaluator.create(NativePlanEvaluator.java:46) at org.apache.gluten.backendsapi.velox.VeloxIteratorApi.genFinalStageIterator(VeloxIteratorApi.scala:290) at org.apache.gluten.execution.WholeStageZippedPartitionsRDD.$anonfun$compute$1(WholeStageZippedPartitionsRDD.scala:59) at org.apache.gluten.utils.Arm$.withResource(Arm.scala:25) at org.apache.gluten.metrics.GlutenTimeMetric$.millis(GlutenTimeMetric.scala:37) at org.apache.gluten.execution.WholeStageZippedPartitionsRDD.compute(WholeStageZippedPartitionsRDD.scala:46) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:367) at org.apache.spark.rdd.RDD.iterator(RDD.scala:331) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:367) at org.apache.spark.rdd.RDD.iterator(RDD.scala:331) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:367) at org.apache.spark.rdd.RDD.iterator(RDD.scala:331) at org.apache.spark.shuffle.ShuffleWriteProcessor.write(ShuffleWriteProcessor.scala:59) at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:104) at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:54) at org.apache.spark.TaskContext.runTaskWithListeners(TaskContext.scala:166) at org.apache.spark.scheduler.Task.run(Task.scala:141) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$4(Executor.scala:620) at org.apache.spark.util.SparkErrorUtils.tryWithSafeFinally(SparkErrorUtils.scala:64) at org.apache.spark.util.SparkErrorUtils.tryWithSafeFinally$(SparkErrorUtils.scala:61) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:94) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:623) at java.base[/java.util.concurrent.ThreadPoolExecutor.runWorker](http://98.81.182.194:8888/java.util.concurrent.ThreadPoolExecutor.runWorker)(ThreadPoolExecutor.java:1136) at java.base[/java.util.concurrent.ThreadPoolExecutor](http://98.81.182.194:8888/java.util.concurrent.ThreadPoolExecutor)$Worker.run(ThreadPoolExecutor.java:635) at java.base[/java.lang.Thread.run](http://98.81.182.194:8888/java.lang.Thread.run)(Thread.java:840) 25[/09/11](http://98.81.182.194:8888/09/11) 12:24:43 ERROR TaskResources: Task 6 failed by error: ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
