Hi all,
I downloaded 1.14.2 for scala 2.12 and executed a simple
example, ./bin/flink run examples/streaming/WordCount.jar
But in my environment, Mac OS Monterey with OpenJDK 8_312, the
TaskManager JVM crashes with SEGV. Clearly, Unsafe class call in
MemorySegment makes it happen.
How can I resolve this? Please help.
Here's some parts of hs_err.log below;
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x000000010a1df399, pid=68596,
tid=0x000000000000c903
#
# JRE version: OpenJDK Runtime Environment (8.0_312) (build
1.8.0_312-bre_2022_01_01_23_04-b00)
# Java VM: OpenJDK 64-Bit Server VM (25.312-b00 mixed mode bsd-amd64
compressed oops)
# Problematic frame:
# V [libjvm.dylib+0x546399]
#
# Failed to write core dump. Core dumps have been disabled. To enable
core dumping, try "ulimit -c unlimited" before starting
Java again
#
# If you would like to submit a bug report, please visit:
# https://github.com/Homebrew/homebrew-core/issues
#
--------------- T H R E A D ---------------
Current thread (0x00007fd498d8c000): JavaThread "Keyed Aggregation ->
Sink: Print to Std. Out (1/1)#0" [_thread_in_vm, id=51
459, stack(0x0000700006a1a000,0x0000700006b1a000)]
siginfo: si_signo: 11 (SIGSEGV), si_code: 1 (SEGV_MAPERR), si_addr:
0x0000000000000000
...
Stack: [0x0000700006a1a000,0x0000700006b1a000],
sp=0x0000700006b19290, free space=1020k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code,
C=native code)
V [libjvm.dylib+0x546399]
J 2219 sun.misc.Unsafe.getInt(Ljava/lang/Object;J)I (0 bytes) @
0x000000011103b1ce [0x000000011103b100+0xce]
j org.apache.flink.core.memory.MemorySegment.getInt(I)I+33
j org.apache.flink.core.memory.MemorySegment.getIntBigEndian(I)I+8
j
org.apache.flink.runtime.io.network.api.serialization.NonSpanningWrapper.readInt()I+8
j
org.apache.flink.runtime.io.network.api.serialization.SpillingAdaptiveSpanningRecordDeserializer.readNonSpanningRecord(Lor
g/apache/flink/core/io/IOReadableWritable;)Lorg/apache/flink/runtime/io/network/api/serialization/RecordDeserializer$Deserial
izationResult;+4
j
org.apache.flink.runtime.io.network.api.serialization.SpillingAdaptiveSpanningRecordDeserializer.readNextRecord(Lorg/apach
e/flink/core/io/IOReadableWritable;)Lorg/apache/flink/runtime/io/network/api/serialization/RecordDeserializer$Deserialization
Result;+12
j
org.apache.flink.runtime.io.network.api.serialization.SpillingAdaptiveSpanningRecordDeserializer.getNextRecord(Lorg/apache
/flink/core/io/IOReadableWritable;)Lorg/apache/flink/runtime/io/network/api/serialization/RecordDeserializer$DeserializationR
esult;+2
j
org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.emitNext(Lorg/apache/flink/streaming/runtime/io/Pushi
ngAsyncDataInput$DataOutput;)Lorg/apache/flink/streaming/runtime/io/DataInputStatus;+15
j
org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput()Lorg/apache/flink/streaming/runtime/io/DataInp
utStatus;+8
j
org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(Lorg/apache/flink/streaming/runtime/tasks/mailbox/Mailbox
DefaultAction$Controller;)V+4
j
org.apache.flink.streaming.runtime.tasks.StreamTask$$Lambda$615.runDefaultAction(Lorg/apache/flink/streaming/runtime/tasks
/mailbox/MailboxDefaultAction$Controller;)V+5
j
org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop()V+95
j org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop()V+4
j org.apache.flink.streaming.runtime.tasks.StreamTask.invoke()V+30
j org.apache.flink.runtime.taskmanager.Task$$Lambda$697.run()V+4
j
org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Lorg/apache/flink/util/function/RunnableWithExceptio
n;)V+4
j
org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Lorg/apache/flink/runtime/jobgraph/tasks/TaskInvokable;)V+71
j org.apache.flink.runtime.taskmanager.Task.doRun()V+728
j org.apache.flink.runtime.taskmanager.Task.run()V+1
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub
V [libjvm.dylib+0x2c3702]
V [libjvm.dylib+0x2c25af]
V [libjvm.dylib+0x2c279b]
V [libjvm.dylib+0x331dd2]
V [libjvm.dylib+0x52e033]
V [libjvm.dylib+0x52def1]
V [libjvm.dylib+0x465c76]
C [libsystem_pthread.dylib+0x64f4] _pthread_start+0x7d
C [libsystem_pthread.dylib+0x200f] thread_start+0xf
C 0x0000000000000000
...
--------------- S Y S T E M ---------------
OS:Bsduname:Darwin 21.2.0 Darwin Kernel Version 21.2.0: Sun Nov 28
20:28:54 PST 2021; root:xnu-8019.61.5~1/RELEASE_X86_64 x86
_64
rlimit: STACK 8192k, CORE 0k, NPROC 2784, NOFILE 10240, AS infinity
load average:1.78 1.99 2.20
CPU:total 12 (initial active 12) (6 cores per cpu, 2 threads per core)
family 6 model 158 stepping 10, cmov, cx8, fxsr, mmx,
sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul,
erms, 3dnowpref, lzcnt, ht, tsc, tscinvbit, bmi1, bmi2
, adx
Memory: 4k page, physical 16777216k(266056k free)
/proc/meminfo:
vm_info: OpenJDK 64-Bit Server VM (25.312-b00) for bsd-amd64 JRE
(1.8.0_312-bre_2022_01_01_23_04-b00), built on Jan 1 2022 2
3:10:39 by "brew" with gcc Apple LLVM 13.0.0 (clang-1300.0.29.3)
time: Wed Jan 12 10:54:30 2022
timezone: KST
elapsed time: 4.602396 seconds (0d 0h 0m 4s)
Best regards,
Eugene Chung (Korean : 정의근)