Re: mesos-containerizer: error while loading shared libraries: libmesos-0.24.0.so

[Joris Van Remoortere]

Can you run the slave and executor with GLOG_v=1 set on the environment and
try to provide some more context for this error:

> mesos-containerizer: error while loading shared libraries:
> libmesos-0.24.0.so: cannot open shared object file: No such file or
> directory

Are there any logs on the slave to provide more context?

On Fri, Sep 18, 2015 at 12:02 AM, F21 <f21.gro...@gmail.com> wrote:

> Hey haosdent, I was the one that opened the issue :)
>
>
> On 18/09/2015 1:52 PM, haosdent wrote:
>
> Hi, @F21 You problems is similar to
> <https://issues.apache.org/jira/browse/MESOS-3462>
> https://issues.apache.org/jira/browse/MESOS-3462? I would test it tonight
> and give you feedback later.
>
> On Fri, Sep 18, 2015 at 5:59 AM, F21 <f21.gro...@gmail.com> wrote:
>
>> I have that set using the environment variable:
>> MESOS_EXECUTOR_ENVIRONMENT_VARIABLES={"LD_LIBRARY_PATH":
>> "/path/to/mesos/lib"}
>>
>> However, it doesn't seem to have any effect.
>>
>> On 18/09/2015 12:27 AM, haosdent wrote:
>>
>>>
>>> MESOS_EXECUTOR_ENVIRONMENT_VARIABLES={"LD_LIBRARY_PATH":
>>> "/path/to/mesos/lib"}
>>>
>>
>>
>
>
> --
> Best Regards,
> Haosdent Huang
>
>
>

mesos-containerizer: error while loading shared libraries: libmesos-0.24.0.so

[F21]

I am building mesos 0.24.0 with the goal to compress the binaries into 
an archive and distribute them onto other machines to run.


Mesos is configured with the following options and then compiled:

./configure CC=gcc-4.8 CXX=g++-4.8 
LD_LIBRARY_PATH=/tmp/mesos-build/sasl2/lib 
SASL_PATH=/tmp/mesos-build/sasl2/lib/sasl2 
--prefix=/tmp/mesos-build/mesos --with-svn=/tmp/mesos-build/svn 
--with-apr=/tmp/mesos-build/apr --with-sasl=/tmp/mesos-build/sasl2/ 
--with-curl=/tmp/mesos-build/curl


I then compressed the whole archive and deployed them on to my machines.

Mesos master is launched with the following config:

MESOS_LOG_DIR=/var/log/mesos
MESOS_WORK_DIR=/var/lib/mesos/master
MESOS_CLUSTER=mesos
MESOS_ROLES=mesos_master
MESOS_WEBUI_DIR=/opt/airglow/packages/mesos/share/mesos/webui
MESOS_ZK=zk://192.168.33.10/mesos
MESOS_QUORUM=1
MESOS_HOSTNAME=192.168.33.10
MESOS_IP=192.168.33.10

The slave is started with the following config:
MESOS_LOG_DIR=/var/log/mesos
MESOS_CONTAINERIZERS=docker,mesos
MESOS_EXECUTOR_REGISTRATION_TIMEOUT=60mins
MESOS _HOSTNAME=192.168.33.11
MESOS_IP=192.168.33.11
MESOS_MASTER=zk://192.168.33.10/mesos
MESOS_EXECUTOR_ENVIRONMENT_VARIABLES={"LD_LIBRARY_PATH": 
"/path/to/mesos/lib"}


On all machines I have the following environment variables:
LD_LIBRARY_PATH=/path/to/mesos/lib
JAVA_HOME is also set up correctly


I then attempted to run mesos-hdfs from the master. The scheduler 
launches properly.


However, when the scheduler tries to launch a task (such as a journal 
node), it fails and I can see this in the stderr of the sandbox:


mesos-containerizer: error while loading shared libraries: 
libmesos-0.24.0.so: cannot open shared object file: No such file or 
directory


What causes this problem and how can I resolve it?

Re: mesos-containerizer: error while loading shared libraries: libmesos-0.24.0.so

[haosdent]

Does libmesos-0.24.0.so exists in LD_LIBRARY_PATH=/path/to/mesos/lib?

On Thu, Sep 17, 2015 at 5:01 PM, F21 <f21.gro...@gmail.com> wrote:

> I am building mesos 0.24.0 with the goal to compress the binaries into an
> archive and distribute them onto other machines to run.
>
> Mesos is configured with the following options and then compiled:
>
> ./configure CC=gcc-4.8 CXX=g++-4.8
> LD_LIBRARY_PATH=/tmp/mesos-build/sasl2/lib
> SASL_PATH=/tmp/mesos-build/sasl2/lib/sasl2 --prefix=/tmp/mesos-build/mesos
> --with-svn=/tmp/mesos-build/svn --with-apr=/tmp/mesos-build/apr
> --with-sasl=/tmp/mesos-build/sasl2/ --with-curl=/tmp/mesos-build/curl
>
> I then compressed the whole archive and deployed them on to my machines.
>
> Mesos master is launched with the following config:
>
> MESOS_LOG_DIR=/var/log/mesos
> MESOS_WORK_DIR=/var/lib/mesos/master
> MESOS_CLUSTER=mesos
> MESOS_ROLES=mesos_master
> MESOS_WEBUI_DIR=/opt/airglow/packages/mesos/share/mesos/webui
> MESOS_ZK=zk://192.168.33.10/mesos
> MESOS_QUORUM=1
> MESOS_HOSTNAME=192.168.33.10
> MESOS_IP=192.168.33.10
>
> The slave is started with the following config:
> MESOS_LOG_DIR=/var/log/mesos
> MESOS_CONTAINERIZERS=docker,mesos
> MESOS_EXECUTOR_REGISTRATION_TIMEOUT=60mins
> MESOS _HOSTNAME=192.168.33.11
> MESOS_IP=192.168.33.11
> MESOS_MASTER=zk://192.168.33.10/mesos
> MESOS_EXECUTOR_ENVIRONMENT_VARIABLES={"LD_LIBRARY_PATH":
> "/path/to/mesos/lib"}
>
> On all machines I have the following environment variables:
> LD_LIBRARY_PATH=/path/to/mesos/lib
> JAVA_HOME is also set up correctly
>
>
> I then attempted to run mesos-hdfs from the master. The scheduler launches
> properly.
>
> However, when the scheduler tries to launch a task (such as a journal
> node), it fails and I can see this in the stderr of the sandbox:
>
> mesos-containerizer: error while loading shared libraries:
> libmesos-0.24.0.so: cannot open shared object file: No such file or
> directory
>
> What causes this problem and how can I resolve it?
>
>


-- 
Best Regards,
Haosdent Huang

Re: mesos-containerizer: error while loading shared libraries: libmesos-0.24.0.so

[F21]

Yes, it exists. I can also see a libmesos.so that is symlinked to 
libmesos-0.24.0.so


On 17/09/2015 7:08 PM, haosdent wrote:
Does libmesos-0.24.0.so <http://libmesos-0.24.0.so> exists in 
LD_LIBRARY_PATH=/path/to/mesos/lib?


On Thu, Sep 17, 2015 at 5:01 PM, F21 <f21.gro...@gmail.com 
<mailto:f21.gro...@gmail.com>> wrote:


I am building mesos 0.24.0 with the goal to compress the binaries
into an archive and distribute them onto other machines to run.

Mesos is configured with the following options and then compiled:

./configure CC=gcc-4.8 CXX=g++-4.8
LD_LIBRARY_PATH=/tmp/mesos-build/sasl2/lib
SASL_PATH=/tmp/mesos-build/sasl2/lib/sasl2
--prefix=/tmp/mesos-build/mesos --with-svn=/tmp/mesos-build/svn
--with-apr=/tmp/mesos-build/apr
--with-sasl=/tmp/mesos-build/sasl2/ --with-curl=/tmp/mesos-build/curl

I then compressed the whole archive and deployed them on to my
machines.

Mesos master is launched with the following config:

MESOS_LOG_DIR=/var/log/mesos
MESOS_WORK_DIR=/var/lib/mesos/master
MESOS_CLUSTER=mesos
MESOS_ROLES=mesos_master
MESOS_WEBUI_DIR=/opt/airglow/packages/mesos/share/mesos/webui
MESOS_ZK=zk://192.168.33.10/mesos <http://192.168.33.10/mesos>
MESOS_QUORUM=1
MESOS_HOSTNAME=192.168.33.10
MESOS_IP=192.168.33.10

The slave is started with the following config:
MESOS_LOG_DIR=/var/log/mesos
MESOS_CONTAINERIZERS=docker,mesos
MESOS_EXECUTOR_REGISTRATION_TIMEOUT=60mins
MESOS _HOSTNAME=192.168.33.11
MESOS_IP=192.168.33.11
MESOS_MASTER=zk://192.168.33.10/mesos <http://192.168.33.10/mesos>
MESOS_EXECUTOR_ENVIRONMENT_VARIABLES={"LD_LIBRARY_PATH":
"/path/to/mesos/lib"}

On all machines I have the following environment variables:
LD_LIBRARY_PATH=/path/to/mesos/lib
JAVA_HOME is also set up correctly


I then attempted to run mesos-hdfs from the master. The scheduler
launches properly.

However, when the scheduler tries to launch a task (such as a
journal node), it fails and I can see this in the stderr of the
    sandbox:

    mesos-containerizer: error while loading shared libraries:
libmesos-0.24.0.so <http://libmesos-0.24.0.so>: cannot open shared
object file: No such file or directory

What causes this problem and how can I resolve it?




--
Best Regards,
Haosdent Huang

Re: mesos-containerizer: error while loading shared libraries: libmesos-0.24.0.so

[haosdent]

How about pass --executor_environment_variables when start slave? I think
maybe because LD_LIBRARY_PATH not work.

On Thu, Sep 17, 2015 at 5:11 PM, F21 <f21.gro...@gmail.com> wrote:

> Yes, it exists. I can also see a libmesos.so that is symlinked to
> libmesos-0.24.0.so
>
>
> On 17/09/2015 7:08 PM, haosdent wrote:
>
> Does libmesos-0.24.0.so exists in LD_LIBRARY_PATH=/path/to/mesos/lib?
>
> On Thu, Sep 17, 2015 at 5:01 PM, F21 <f21.gro...@gmail.com> wrote:
>
>> I am building mesos 0.24.0 with the goal to compress the binaries into an
>> archive and distribute them onto other machines to run.
>>
>> Mesos is configured with the following options and then compiled:
>>
>> ./configure CC=gcc-4.8 CXX=g++-4.8
>> LD_LIBRARY_PATH=/tmp/mesos-build/sasl2/lib
>> SASL_PATH=/tmp/mesos-build/sasl2/lib/sasl2 --prefix=/tmp/mesos-build/mesos
>> --with-svn=/tmp/mesos-build/svn --with-apr=/tmp/mesos-build/apr
>> --with-sasl=/tmp/mesos-build/sasl2/ --with-curl=/tmp/mesos-build/curl
>>
>> I then compressed the whole archive and deployed them on to my machines.
>>
>> Mesos master is launched with the following config:
>>
>> MESOS_LOG_DIR=/var/log/mesos
>> MESOS_WORK_DIR=/var/lib/mesos/master
>> MESOS_CLUSTER=mesos
>> MESOS_ROLES=mesos_master
>> MESOS_WEBUI_DIR=/opt/airglow/packages/mesos/share/mesos/webui
>> MESOS_ZK=zk://192.168.33.10/mesos
>> MESOS_QUORUM=1
>> MESOS_HOSTNAME=192.168.33.10
>> MESOS_IP=192.168.33.10
>>
>> The slave is started with the following config:
>> MESOS_LOG_DIR=/var/log/mesos
>> MESOS_CONTAINERIZERS=docker,mesos
>> MESOS_EXECUTOR_REGISTRATION_TIMEOUT=60mins
>> MESOS _HOSTNAME=192.168.33.11
>> MESOS_IP=192.168.33.11
>> MESOS_MASTER=zk://192.168.33.10/mesos
>> MESOS_EXECUTOR_ENVIRONMENT_VARIABLES={"LD_LIBRARY_PATH":
>> "/path/to/mesos/lib"}
>>
>> On all machines I have the following environment variables:
>> LD_LIBRARY_PATH=/path/to/mesos/lib
>> JAVA_HOME is also set up correctly
>>
>>
>> I then attempted to run mesos-hdfs from the master. The scheduler
>> launches properly.
>>
>> However, when the scheduler tries to launch a task (such as a journal
>> node), it fails and I can see this in the stderr of the sandbox:
>>
>> mesos-containerizer: error while loading shared libraries:
>> libmesos-0.24.0.so: cannot open shared object file: No such file or
>> directory
>>
>> What causes this problem and how can I resolve it?
>>
>>
>
>
> --
> Best Regards,
> Haosdent Huang
>
>
>


-- 
Best Regards,
Haosdent Huang

Re: mesos-containerizer: error while loading shared libraries: libmesos-0.24.0.so

[F21]

I have that set using the environment variable:
MESOS_EXECUTOR_ENVIRONMENT_VARIABLES={"LD_LIBRARY_PATH": 
"/path/to/mesos/lib"}


However, it doesn't seem to have any effect.

On 18/09/2015 12:27 AM, haosdent wrote:


MESOS_EXECUTOR_ENVIRONMENT_VARIABLES={"LD_LIBRARY_PATH": 
"/path/to/mesos/lib"}

Re: mesos-containerizer: error while loading shared libraries: libmesos-0.24.0.so

[F21]

Hey haosdent, I was the one that opened the issue :)

On 18/09/2015 1:52 PM, haosdent wrote:
Hi, @F21 You problems is similar to 
https://issues.apache.org/jira/browse/MESOS-3462? I would test it 
tonight and give you feedback later.


On Fri, Sep 18, 2015 at 5:59 AM, F21 > wrote:


I have that set using the environment variable:
MESOS_EXECUTOR_ENVIRONMENT_VARIABLES={"LD_LIBRARY_PATH":
"/path/to/mesos/lib"}

However, it doesn't seem to have any effect.

On 18/09/2015 12:27 AM, haosdent wrote:


MESOS_EXECUTOR_ENVIRONMENT_VARIABLES={"LD_LIBRARY_PATH":
"/path/to/mesos/lib"}





--
Best Regards,
Haosdent Huang