stym06 opened a new issue #4638: URL: https://github.com/apache/hudi/issues/4638
**Describe the problem you faced** Driver is exiting with below stacktrace while doing a BULK_INSERT from Kafka to Blob **Environment Description** * Hudi version : 0.9.0 * Spark version : 2.4.4 * Hive version : 3.1.2 * Hadoop version : 2.7.3 * Storage (HDFS/S3/GCS..) : Azure * Running on Docker? (yes/no) : K8s **Additional context** Add any other context about the problem here. **Stacktrace** ``` 22/01/19 16:56:31 INFO RocksDBDAO: From Rocks DB : [db/db_impl_write.cc:1423] [hudi_view_wasb:__<container>@<account>.blob.core.windows.net_data_pipelines_hudi_kafka_telemetrics_v2_dp.hmi.quectel.event.lpe.packet.v2] New memtable created with log file: #19. Immutable memtables: 0. JniUtil::getJinEnv - Fatal: could not attach current thread to JVM! # # A fatal error has been detected by the Java Runtime Environment: # # SIGSEGV (0xb) at pc=0x00007f858a697446, pid=13, tid=0x00007f85b1164b10 # # JRE version: OpenJDK Runtime Environment (8.0_212-b04) (build 1.8.0_212-b04) # Java VM: OpenJDK 64-Bit Server VM (25.212-b04 mixed mode linux-amd64 compressed oops) # Derivative: IcedTea 3.12.0 # Distribution: Custom build (Mon Aug 12 12:55:38 UTC 2019) # Problematic frame: # C [librocksdbjni3568498499091871873.so+0x2c3446] rocksdb::LoggerJniCallback::Logv(rocksdb::InfoLogLevel, char const*, __va_list_tag*)+0x76 # # Core dump written. Default location: /opt/spark/work-dir/core or core.13 # # An error report file with more information is saved as: # /opt/spark/work-dir/hs_err_pid13.log 22/01/19 16:56:31 INFO RocksDbBasedFileSystemView: Finished adding new partition (v3/dt=2022-01-04) to ROCKSDB based file-system view at /tmp/hoodie_timeline_rocksdb, Total file-groups=3817 22/01/19 16:56:31 INFO AbstractTableFileSystemView: addFilesToView: NumFiles=3818, NumFileGroups=3817, FileGroupsCreationTime=218, StoreTimeTaken=787 22/01/19 16:56:31 INFO RocksDBDAO: Prefix Search for (query=type=slice,part=v3/dt=2022-01-04,id=) on hudi_view_wasb:[email protected]_data_pipelines_hudi_kafka_telemetrics_v2_dp.hmi.quectel.event.lpe.packet.v2. Total Time Taken (msec)=16. Serialization Time taken(micro)=9889, num entries=3817 # # If you would like to submit a bug report, please include # instructions on how to reproduce the bug and visit: # https://icedtea.classpath.org/bugzilla # ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
