[
https://issues.apache.org/jira/browse/MESOS-1069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13923011#comment-13923011
]
Bernardo Gomez Palacio commented on MESOS-1069:
-----------------------------------------------
I will close this ticket concluding that if you are a user of Spark 0.9.0
deployed on Hadoop 2.x and using Mesos 0.16.0 you will most likely get the
error described bellow. To fix this problem you should migrate to Mesos 0.17.0
or above.
```
Stack: [0x00007fede5963000,0x00007fede5a64000], sp=0x00007fede5a62310, free
space=1020k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [libjvm.so+0x632ce9] jni_GetByteArrayElements+0x89
C [libmesos-0.16.0.so+0x6c8c29] mesos::FrameworkInfo
construct<mesos::FrameworkInfo>(JNIEnv_*, _jobject*)+0x79
C 0x00007fedf8d8eb10
j
org.apache.spark.scheduler.cluster.mesos.MesosSchedulerBackend$$anon$1.run()V+44
v ~StubRoutines::call_stub
V [libjvm.so+0x5f8465] JavaCalls::call_helper(JavaValue*, methodHandle*,
JavaCallArguments*, Thread*)+0x365
V [libjvm.so+0x5f6ec8] JavaCalls::call(JavaValue*, methodHandle,
JavaCallArguments*, Thread*)+0x28
V [libjvm.so+0x5f7197] JavaCalls::call_virtual(JavaValue*, KlassHandle,
Symbol*, Symbol*, JavaCallArguments*, Thread*)+0x197
V [libjvm.so+0x5f72b7] JavaCalls::call_virtual(JavaValue*, Handle,
KlassHandle, Symbol*, Symbol*, Thread*)+0x47
V [libjvm.so+0x6731c5] thread_entry(JavaThread*, Thread*)+0xe5
V [libjvm.so+0x94d5ff] JavaThread::thread_main_inner()+0xdf
V [libjvm.so+0x94d705] JavaThread::run()+0xf5
V [libjvm.so+0x815538] java_start(Thread*)+0x108
Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j org.apache.mesos.MesosSchedulerDriver.initialize()V+0
j
org.apache.mesos.MesosSchedulerDriver.<init>(Lorg/apache/mesos/Scheduler;Lorg/apache/mesos/Protos$FrameworkInfo;Ljava/lang/String;)V+67
j
org.apache.spark.scheduler.cluster.mesos.MesosSchedulerBackend$$anon$1.run()V+44
v ~StubRoutines::call_stub
```
> Branch for 0.16.0 with Protobufs 2.5.0
> --------------------------------------
>
> Key: MESOS-1069
> URL: https://issues.apache.org/jira/browse/MESOS-1069
> Project: Mesos
> Issue Type: Improvement
> Affects Versions: 0.16.0
> Reporter: Bernardo Gomez Palacio
> Assignee: Bernardo Gomez Palacio
> Fix For: 0.17.0
>
>
> If you deploy Mesos 0.16.0 on a Hadoop 2.x cluster with Spark 0.9.0+ you will
> start getting stack-dumps similar to
> [dump.log|https://gist.github.com/berngp/c16c56516cb40d9a78fe]
> Without going into much detail the hadoop-client.jar for 2.x now requires
> Protobuf 2.5.0 and therefore Spark will require the same protobuf
> version. Due this you will need to run Spark on Mesos with support of
> Protobuf 2.5.0.
> If you want to use Mesos 0.16.0, which is the latest stable release, you will
> need support of Protobufs 2.5.0 on Mesos 0.16.0.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
