Can you enable GLOG_v=1 env variable when launching the slave and post the slave log?
Tim > On Jun 13, 2015, at 12:44 AM, Tyson Norris <[email protected]> wrote: > > Hi - > We are running mesos slave (0.22.0-1.0.ubuntu1404) in a docker container with > docker containerizer without problems on ubuntu 14.04 docker host (with > lxc-docker pkg etc added). > > Running the same slave container on RHEL 7.0 docker host, the container exits > almost immediately after starting with: > I0613 07:18:15.161931 5303 slave.cpp:3808] Finished recovery > I0613 07:18:15.162677 5303 slave.cpp:647] New master detected at > [email protected]:5050 > I0613 07:18:15.162753 5301 status_update_manager.cpp:171] Pausing sending > status updates > I0613 07:18:15.163051 5303 slave.cpp:672] No credentials provided. > Attempting to register without authentication > I0613 07:18:15.163734 5303 slave.cpp:683] Detecting new master > W0613 07:18:15.163734 5293 logging.cpp:81] RAW: Received signal SIGTERM from > process 1166 of user 0; exiting > > > If I do not enable the docker containerized, the slave container runs fine. > > Other containers that bind mount /var/run/docker.sock also run fine. > > Debug docker logs are below. > > One difference between the ubuntu docker host and RHEL docker host is that > the unbuntu host uses the aufs driver, while rhel uses devicemapper, and > selinux is enabled in RHEL but not ubuntu. > > Thanks for any advice! > Tyson > > > > > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info > msg="POST > /v1.18/containers/9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd/start" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info > msg="+job > start(9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd)" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=debug > msg="activateDeviceIfNeeded(9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd)" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=debug > msg="libdevmapper(6): ioctl/libdm-iface.c:1750 (4) dm info > docker-253:3-16818501-9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd > OF [16384] (*1)" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=debug > msg="libdevmapper(6): ioctl/libdm-iface.c:1750 (4) dm create > docker-253:3-16818501-9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd > OF [16384] (*1)" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=debug > msg="libdevmapper(6): libdm-common.c:1348 (4) > docker-253:3-16818501-9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd: > Stacking NODE_ADD (253,9) 0:0 0600 [verify_udev]" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=debug > msg="libdevmapper(6): ioctl/libdm-iface.c:1750 (4) dm reload > docker-253:3-16818501-9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd > OF [16384] (*1)" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=debug > msg="libdevmapper(6): ioctl/libdm-iface.c:1750 (4) dm resume > docker-253:3-16818501-9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd > OF [16384] (*1)" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=debug > msg="libdevmapper(6): libdm-common.c:1348 (4) > docker-253:3-16818501-9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd: > Processing NODE_ADD (253,9) 0:0 0600 [verify_udev]" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=debug > msg="libdevmapper(6): libdm-common.c:983 (4) Created > /dev/mapper/docker-253:3-16818501-9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd" > Jun 13 07:28:26 phx-8 kernel: EXT4-fs (dm-9): mounted filesystem with ordered > data mode. Opts: discard > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info > msg="+job log(start, > 9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd, > docker.corp.adobe.com/tnorris/mesosslave:0.22.1-1.0.ubuntu1404)" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info > msg="-job log(start, > 9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd, > docker.corp.adobe.com/tnorris/mesosslave:0.22.1-1.0.ubuntu1404) = OK (0)" > Jun 13 07:28:26 phx-8 systemd-udevd: conflicting device node > '/dev/mapper/docker-253:3-16818501-9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd' > found, link to '/dev/dm-9' will not be created > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=debug > msg="Calling GET /containers/{name:.*}/json" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info msg="GET > /containers/9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd/json" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info > msg="+job > container_inspect(9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd)" > Jun 13 07:28:26 phx-8 systemd: Starting docker container > 9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd. > Jun 13 07:28:26 phx-8 systemd: Started docker container > 9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd. > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info > msg="-job > start(9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd) = OK > (0)" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info > msg="-job > container_inspect(9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd) > = OK (0)" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=debug > msg="Calling POST /containers/{name:.*}/resize" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info > msg="POST > /v1.18/containers/9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd/resize?h=58&w=204" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info > msg="+job > resize(9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd, 58, > 204)" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info > msg="-job > resize(9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd, 58, > 204) = OK (0)" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=debug > msg="Calling GET /version" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info msg="GET > /v1.18/version" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info > msg="+job version()" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info > msg="-job version() = OK (0)" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=debug > msg="Calling GET /containers/json" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info msg="GET > /v1.18/containers/json?all=1" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info > msg="+job containers()" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info > msg="-job containers() = OK (0)" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=debug > msg="Calling GET /containers/{name:.*}/json" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info msg="GET > /v1.18/containers/mesos-slave/json" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info > msg="+job container_inspect(mesos-slave)" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info > msg="-job container_inspect(mesos-slave) = OK (0)" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=debug > msg="Calling GET /containers/{name:.*}/json" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info msg="GET > /v1.18/containers/mesos-slave2/json" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info > msg="+job container_inspect(mesos-slave2)" > Jun 13 07:28:26 phx-8 docker: time="2015-06-13T07:28:26Z" level=info > msg="-job container_inspect(mesos-slave2) = OK (0)" > Jun 13 07:28:27 phx-8 docker: time="2015-06-13T07:28:27Z" level=debug > msg="Calling POST /containers/{name:.*}/stop" > Jun 13 07:28:27 phx-8 docker: time="2015-06-13T07:28:27Z" level=info > msg="POST > /v1.18/containers/9e897d0fd156dab5ec59f8ded2a6cdf7dc5379664c872cd7da4875b6aab9dfcd/stop?t=0" > >
