Jenny MA created SPARK-7063:
-------------------------------
Summary: when lz4 compression is used, it causes core dump
Key: SPARK-7063
URL: https://issues.apache.org/jira/browse/SPARK-7063
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 1.3.1
Reporter: Jenny MA
Priority: Minor
this issue is initially noticed by using IBM JDK, below please find the stack
track of this issue, caused by violating the rule in critical section.
#0 0x000000314340f3cb in raise () from
/service/pmrs/45638/20/lib64/libpthread.so.0
#1 0x00007f795b0323be in j9dump_create () from
/service/pmrs/45638/20/opt/ibm/biginsights/jdk/jre/lib/amd64/compressedrefs/libj9prt27.so
#2 0x00007f795a88ba2a in doSystemDump () from
/service/pmrs/45638/20/opt/ibm/biginsights/jdk/jre/lib/amd64/compressedrefs/libj9dmp27.so
#3 0x00007f795b0405d5 in j9sig_protect () from
/service/pmrs/45638/20/opt/ibm/biginsights/jdk/jre/lib/amd64/compressedrefs/libj9prt27.so
#4 0x00007f795a88a1fd in runDumpFunction () from
/service/pmrs/45638/20/opt/ibm/biginsights/jdk/jre/lib/amd64/compressedrefs/libj9dmp27.so
#5 0x00007f795a88dbab in runDumpAgent () from
/service/pmrs/45638/20/opt/ibm/biginsights/jdk/jre/lib/amd64/compressedrefs/libj9dmp27.so
#6 0x00007f795a8a1c49 in triggerDumpAgents () from
/service/pmrs/45638/20/opt/ibm/biginsights/jdk/jre/lib/amd64/compressedrefs/libj9dmp27.so
#7 0x00007f795a4518fe in doTracePoint () from
/service/pmrs/45638/20/opt/ibm/biginsights/jdk/jre/lib/amd64/compressedrefs/libj9trc27.so
#8 0x00007f795a45210e in j9Trace () from
/service/pmrs/45638/20/opt/ibm/biginsights/jdk/jre/lib/amd64/compressedrefs/libj9trc27.so
#9 0x00007f79590e46e1 in
MM_StandardAccessBarrier::jniReleasePrimitiveArrayCritical(J9VMThread*,
_jarray*, void*, int) ()
from
/service/pmrs/45638/20/opt/ibm/biginsights/jdk/jre/lib/amd64/compressedrefs/libj9gc27.so
#10 0x00007f7938bc397c in
Java_net_jpountz_lz4_LZ4JNI_LZ4_1compress_1limitedOutput () from
/service/pmrs/45638/20/tmp/liblz4-java7155003924599399415.so
#11 0x00007f795b707149 in VMprJavaSendNative () from
/service/pmrs/45638/20/opt/ibm/biginsights/jdk/jre/lib/amd64/compressedrefs/libj9vm27.so
#12 0x0000000000000000 in ?? ()
this is an issue introduced by a bug in net.jpountz.lz4.lz4-1.2.0.jar, and
fixed in 1.3.0 version. Sun JDK /Open JDK doesn't complain this issue, but
this issue will trigger assertion failure when IBM JDK is used. here is the
link to the fix
https://github.com/jpountz/lz4-java/commit/07229aa2f788229ab4f50379308297f428e3d2d2
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
