wangyum commented on PR #5384: URL: https://github.com/apache/incubator-gluten/pull/5384#issuecomment-2053604962
Thank you @JkSelf . It throw exception when reading data: <img width="888" alt="image" src="https://github.com/apache/incubator-gluten/assets/5399861/9602fb7e-cd98-4ec4-96d4-c31354c84a62";> ``` # # A fatal error has been detected by the Java Runtime Environment: # # SIGSEGV (0xb) at pc=0x00007f177f03c3c4, pid=445510, tid=446238 # # JRE version: OpenJDK Runtime Environment Zulu17.40+20-SA (17.0.6+10) (build 17.0.6+10-LTS) # Java VM: OpenJDK 64-Bit Server VM Zulu17.40+20-SA (17.0.6+10-LTS, mixed mode, sharing, tiered, compressed class ptrs, g1 gc, linux-amd64) # Problematic frame: # C [libvelox.so+0x450c3c4] facebook::velox::HdfsReadFile::size() const+0x4 # # Core dump will be written. Default location: /hadoop/7/yarn/local/usercache/user_spark/appcache/application_1708496355206_29565/container_e2313_1708496355206_29565_01_000108/core.445510 # # An error report file with more information is saved as: # /hadoop/7/yarn/local/usercache/user_spark/appcache/application_1708496355206_29565/container_e2313_1708496355206_29565_01_000108/hs_err_pid445510.log # # If you would like to submit a bug report, please visit: # http://www.azul.com/support/ # The crash happened outside the Java Virtual Machine in native code. # See problematic frame for where to report the bug. ``` ``` $ cat /hadoop/5/yarn/local/usercache/user_spark/appcache/application_1708496355206_29565/container_e2313_1708496355206_29565_01_000005/hs_err_pid87813.log08496355206_29565_01_000005/hs # # A fatal error has been detected by the Java Runtime Environment: # # SIGSEGV (0xb) at pc=0x00007f3c1677c3c4, pid=87813, tid=95868 # # JRE version: OpenJDK Runtime Environment Zulu17.40+20-SA (17.0.6+10) (build 17.0.6+10-LTS) # Java VM: OpenJDK 64-Bit Server VM Zulu17.40+20-SA (17.0.6+10-LTS, mixed mode, sharing, tiered, compressed class ptrs, g1 gc, linux-amd64) # Problematic frame: # C [libvelox.so+0x450c3c4] facebook::velox::HdfsReadFile::size() const+0x4 # # Core dump will be written. Default location: /hadoop/5/yarn/local/usercache/user_spark/appcache/application_1708496355206_29565/container_e2313_1708496355206_29565_01_000005/core.87813 # # If you would like to submit a bug report, please visit: # http://www.azul.com/support/ # The crash happened outside the Java Virtual Machine in native code. # See problematic frame for where to report the bug. # --------------- S U M M A R Y ------------ Command Line: ... Host: Intel(R) Xeon(R) Gold 6230 CPU @ 2.10GHz, 80 cores, 470G, Ubuntu 22.04.1 LTS Time: Sat Apr 13 03:13:49 2024 -07 elapsed time: 158.672676 seconds (0d 0h 2m 38s) --------------- T H R E A D --------------- Current thread (0x000055b3f1c11780): JavaThread "Executor task launch worker for task 0.2 in stage 3.0 (TID 5484)" daemon [_thread_in_native, id=95868, stack(0x00007f3c29800000,0x00007f3c2a000000)] Stack: [0x00007f3c29800000,0x00007f3c2a000000], sp=0x00007f3c29ffc948, free space=8178k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) C [libvelox.so+0x450c3c4] facebook::velox::HdfsReadFile::size() const+0x4 C [libvelox.so+0x1d8488c] facebook::velox::connector::hive::SplitReader::createReader()+0xac Java frames: (J=compiled Java code, j=interpreted, Vv=VM code) j org.apache.gluten.vectorized.ColumnarBatchOutIterator.nativeHasNext(J)Z+0 j org.apache.gluten.vectorized.ColumnarBatchOutIterator.hasNextInternal()Z+5 j org.apache.gluten.vectorized.GeneralOutIterator.hasNext()Z+1 J 4196 c2 scala.collection.convert.Wrappers$JIteratorWrapper.hasNext()Z (10 bytes) @ 0x00007f47f7ea89c0 [0x00007f47f7ea8980+0x0000000000000040] j org.apache.gluten.utils.InvocationFlowProtection.hasNext()Z+59 j org.apache.gluten.utils.IteratorCompleter.hasNext()Z+4 j org.apache.gluten.utils.PayloadCloser.hasNext()Z+8 j org.apache.gluten.utils.PipelineTimeAccumulator.hasNext()Z+4 J 8418 c1 org.apache.spark.InterruptibleIterator.hasNext()Z (17 bytes) @ 0x00007f47e84f12e4 [0x00007f47e84f0f20+0x00000000000003c4] j scala.collection.Iterator$$anon$12.hasNext()Z+11 J 7847 c1 scala.collection.Iterator$$anon$10.hasNext()Z (10 bytes) @ 0x00007f47e843c144 [0x00007f47e843c040+0x0000000000000104] J 10039 c2 scala.collection.AbstractIterator.foreach(Lscala/Function1;)V (6 bytes) @ 0x00007f47f81dcfe4 [0x00007f47f81dcfa0+0x0000000000000044] J 8993 c2 scala.collection.generic.Growable.$plus$plus$eq(Lscala/collection/TraversableOnce;)Lscala/collection/generic/Growable; (34 bytes) @ 0x00007f47f818f3a8 [0x00007f47f818f260+0x0000000000000148] J 9168 c1 scala.collection.mutable.ArrayBuffer.$plus$plus$eq(Lscala/collection/TraversableOnce;)Lscala/collection/mutable/ArrayBuffer; (65 bytes) @ 0x00007f47e86ba9f4 [0x00007f47e86ba3c0+0x0000000000000634] J 9167 c1 scala.collection.mutable.ArrayBuffer.$plus$plus$eq(Lscala/collection/TraversableOnce;)Lscala/collection/generic/Growable; (6 bytes) @ 0x00007f47e86b8c44 [0x00007f47e86b8bc0+0x0000000000000084] ... ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
