Neuw84 commented on issue #10670: URL: https://github.com/apache/incubator-gluten/issues/10670#issuecomment-3278258283
Seems that is java problem... Java 17 thread dump. ``` # # A fatal error has been detected by the Java Runtime Environment: # # SIGSEGV (0xb) at pc=0x00007faabe2f856f, pid=138, tid=474 # # JRE version: OpenJDK Runtime Environment (17.0.16+8) (build 17.0.16+8-Ubuntu-0ubuntu122.04.1) # Java VM: OpenJDK 64-Bit Server VM (17.0.16+8-Ubuntu-0ubuntu122.04.1, mixed mode, sharing, tiered, compressed oops, compressed class ptrs, g1 gc, linux-amd64) # Problematic frame: # C [libvelox.so+0x5a1956f] # # Core dump will be written. Default location: Core dumps may be processed with "/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h" (or dumping to /home/jovyan/core.138) # # If you would like to submit a bug report, please visit: # https://bugs.launchpad.net/ubuntu/+source/openjdk-17 # The crash happened outside the Java Virtual Machine in native code. # See problematic frame for where to report the bug. # --------------- S U M M A R Y ------------ Command Line: -Dspark.eventLog.enabled=true -Dspark.eventLog.dir=/home/jovyan/work/spark-events/ -Xmx1g --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/jdk.internal.misc=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-exports=java.base/jdk.internal.misc=ALL-UNNAMED -Dio.netty.tryReflectionSetAccessible=true -XX:+IgnoreUnrecognizedVMOptions --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.lang.invoke=ALL-UNNAMED --add-opens=java.base/java.lang.reflect=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.net=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.base/java.util.concurrent.atomic=ALL-UNNAMED --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.base/sun.nio.cs=ALL-UNNAMED --add-opens=java.base/sun.security.action=AL L-UNNAMED --add-opens=java.base/sun.util.calendar=ALL-UNNAMED --add-opens=java.security.jgss/sun.security.krb5=ALL-UNNAMED -Djdk.reflect.useDirectMethodHandle=false org.apache.spark.deploy.SparkSubmit --conf spark.memory.offHeap.enabled=true --conf spark.master=local[*] --conf spark.hadoop.fs.s3a.use.instance.credentials=true --conf spark.memory.offHeap.size=8g --conf spark.executor.extraClassPath=/opt/spark/jars/gluten-velox-bundle-spark3.5_2.12-linux_amd64-1.4.0.jar --conf spark.plugins=org.apache.gluten.GlutenPlugin --conf spark.driver.extraClassPath=/opt/spark/jars/gluten-velox-bundle-spark3.5_2.12-linux_amd64-1.4.0.jar --conf spark.app.name=s3a-committers-stable --conf spark.shuffle.manager=org.apache.spark.shuffle.sort.ColumnarShuffleManager --conf spark.gluten.velox.awsSdkLogLevel=debug --conf spark.dynamicAllocation.enabled=false --conf spark.log.level=debug pyspark-shell Host: Intel(R) Xeon(R) Platinum 8223CL CPU @ 3.00GHz, 16 cores, 30G, Ubuntu 22.04.2 LTS Time: Thu Sep 11 05:48:22 2025 UTC elapsed time: 856.829845 seconds (0d 0h 14m 16s) --------------- T H R E A D --------------- Current thread (0x00007faa94005260): JavaThread "Executor task launch worker for task 2.0 in stage 1.0 (TID 3)" daemon [_thread_in_native, id=474, stack(0x00007fabfc5fe000,0x00007fabfc6fe000)] Stack: [0x00007fabfc5fe000,0x00007fabfc6fe000], sp=0x00007fabfc6f8570, free space=1001k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) C [libvelox.so+0x5a1956f] Java frames: (J=compiled Java code, j=interpreted, Vv=VM code) j org.apache.gluten.vectorized.ColumnarBatchOutIterator.nativeHasNext(J)Z+0 j org.apache.gluten.vectorized.ColumnarBatchOutIterator.hasNext0()Z+5 j org.apache.gluten.iterator.ClosableIterator.hasNext()Z+21 J 4427 c2 scala.collection.convert.Wrappers$JIteratorWrapper.hasNext()Z (10 bytes) @ 0x00007fac693616e4 [0x00007fac693616a0+0x0000000000000044] j org.apache.gluten.iterator.IteratorsV1$InvocationFlowProtection.hasNext()Z+59 j org.apache.gluten.iterator.IteratorsV1$IteratorCompleter.hasNext()Z+4 j org.apache.gluten.iterator.IteratorsV1$PayloadCloser.hasNext()Z+8 j org.apache.gluten.iterator.IteratorsV1$LifeTimeAccumulator.hasNext()Z+4 j org.apache.spark.InterruptibleIterator.hasNext()Z+11 j org.apache.gluten.iterator.IteratorsV1$ReadTimeAccumulator.hasNext()Z+8 J 4782 c1 scala.collection.Iterator$$anon$10.hasNext()Z (10 bytes) @ 0x00007fac61de8fc4 [0x00007fac61de8ec0+0x0000000000000104] j scala.collection.convert.Wrappers$IteratorWrapper.hasNext()Z+4 j org.apache.gluten.vectorized.ColumnarBatchInIterator.hasNext()Z+4 v ~StubRoutines::call_stub j org.apache.gluten.vectorized.ColumnarBatchOutIterator.nativeHasNext(J)Z+0 j org.apache.gluten.vectorized.ColumnarBatchOutIterator.hasNext0()Z+5 j org.apache.gluten.iterator.ClosableIterator.hasNext()Z+21 J 4427 c2 scala.collection.convert.Wrappers$JIteratorWrapper.hasNext()Z (10 bytes) @ 0x00007fac693616e4 [0x00007fac693616a0+0x0000000000000044] j org.apache.gluten.iterator.IteratorsV1$ReadTimeAccumulator.hasNext()Z+8 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
