I am almost sure (more like hoping) I'm missing something fundamental here
and/or there is some basic configuration missing on my box.
Running tests as root, causes a significant number of failures.
Has anyone else *ever* run tests as root in the last few weeks?
Here's the headline, the full log of the failed tests attached.
$ lsb_release -a
LSB Version:
core-2.0-amd64:core-2.0-noarch:core-3.0-amd64:core-3.0-noarch:core-3.1-amd64:core-3.1-noarch:core-3.2-amd64:core-3.2-noarch:core-4.0-amd64:core-4.0-noarch:core-4.1-amd64:core-4.1-noarch:cxx-3.0-amd64:cxx-3.0-noarch:cxx-3.1-amd64:cxx-3.1-noarch:cxx-3.2-amd64:cxx-3.2-noarch:cxx-4.0-amd64:cxx-4.0-noarch:cxx-4.1-amd64:cxx-4.1-noarch:desktop-3.1-amd64:desktop-3.1-noarch:desktop-3.2-amd64:desktop-3.2-noarch:desktop-4.0-amd64:desktop-4.0-noarch:desktop-4.1-amd64:desktop-4.1-noarch:graphics-2.0-amd64:graphics-2.0-noarch:graphics-3.0-amd64:graphics-3.0-noarch:graphics-3.1-amd64:graphics-3.1-noarch:graphics-3.2-amd64:graphics-3.2-noarch:graphics-4.0-amd64:graphics-4.0-noarch:graphics-4.1-amd64:graphics-4.1-noarch:languages-3.2-amd64:languages-3.2-noarch:languages-4.0-amd64:languages-4.0-noarch:languages-4.1-amd64:languages-4.1-noarch:multimedia-3.2-amd64:multimedia-3.2-noarch:multimedia-4.0-amd64:multimedia-4.0-noarch:multimedia-4.1-amd64:multimedia-4.1-noarch:printing-3.2-amd64:printing-3.2-noarch:printing-4.0-amd64:printing-4.0-noarch:printing-4.1-amd64:printing-4.1-noarch:qt4-3.1-amd64:qt4-3.1-noarch:security-4.0-amd64:security-4.0-noarch:security-4.1-amd64:security-4.1-noarch
Distributor ID: Ubuntu
Description: *Ubuntu 14.04.2 LTS*
Release: 14.04
Codename: *trusty*
$ sudo make -j12 V=0 check
[==========] 712 tests from 116 test cases ran. (318672 ms total)
[ PASSED ] 676 tests.
[ FAILED ] 36 tests, listed below:
[ FAILED ] PerfEventIsolatorTest.ROOT_CGROUPS_Sample
[ FAILED ] UserCgroupIsolatorTest/2.ROOT_CGROUPS_UserCgroup, where
TypeParam = mesos::internal::slave::CgroupsPerfEventIsolatorProcess
[ FAILED ] SlaveRecoveryTest/0.RecoverSlaveState, where TypeParam =
mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.RecoverStatusUpdateManager, where
TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.ReconnectExecutor, where TypeParam =
mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.RecoverUnregisteredExecutor, where
TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.RecoverTerminatedExecutor, where TypeParam
= mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.RecoverCompletedExecutor, where TypeParam
= mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.CleanupExecutor, where TypeParam =
mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.RemoveNonCheckpointingFramework, where
TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.NonCheckpointingFramework, where TypeParam
= mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.KillTask, where TypeParam =
mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.Reboot, where TypeParam =
mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.GCExecutor, where TypeParam =
mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.ShutdownSlave, where TypeParam =
mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.ShutdownSlaveSIGUSR1, where TypeParam =
mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.RegisterDisconnectedSlave, where TypeParam
= mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.ReconcileKillTask, where TypeParam =
mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.ReconcileShutdownFramework, where
TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.ReconcileTasksMissingFromSlave, where
TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.SchedulerFailover, where TypeParam =
mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.PartitionedSlave, where TypeParam =
mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.MasterFailover, where TypeParam =
mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.MultipleFrameworks, where TypeParam =
mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.MultipleSlaves, where TypeParam =
mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.RestartBeforeContainerizerLaunch, where
TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] MesosContainerizerSlaveRecoveryTest.ResourceStatistics
[ FAILED ]
MesosContainerizerSlaveRecoveryTest.CGROUPS_ROOT_PerfRollForward
[ FAILED ]
MesosContainerizerSlaveRecoveryTest.CGROUPS_ROOT_PidNamespaceForward
[ FAILED ]
MesosContainerizerSlaveRecoveryTest.CGROUPS_ROOT_PidNamespaceBackward
[ FAILED ] CgroupsAnyHierarchyWithPerfEventTest.ROOT_CGROUPS_Perf
[ FAILED ] MemoryPressureMesosTest.CGROUPS_ROOT_Statistics
[ FAILED ] MemoryPressureMesosTest.CGROUPS_ROOT_SlaveRecovery
[ FAILED ] NsTest.ROOT_setns
[ FAILED ] PerfTest.ROOT_Events
[ FAILED ] PerfTest.ROOT_SamplePid
36 FAILED TESTS
YOU HAVE 12 DISABLED TESTS
*Marco Massenzio*
*Distributed Systems Engineer*
On Fri, Jul 17, 2015 at 7:26 PM, Marco Massenzio <ma...@mesosphere.io>
wrote:
> Ubuntu 14.04
>
> Not sure if I'm doing something wrong, `sudo make distcheck` fails -
> re-running after a `make clean`
>
> If it continues failing, I'll provide more detailed log output.
> In the meantime, if anyone has any suggestions as to what I may be doing
> wrong, please let me know.
>
> $ ../configure && make -j8 V=0 && make -j12 V=0 check
>
> [==========] 649 tests from 94 test cases ran. (254152 ms total)
> [ PASSED ] 649 tests.
>
> $ sudo make -j12 V=0 distcheck
>
> [==========] 712 tests from 116 test cases ran. (325751 ms total)
> [ PASSED ] 702 tests.
> [ FAILED ] 10 tests, listed below:
> [ FAILED ] LimitedCpuIsolatorTest.ROOT_CGROUPS_Pids_and_Tids
> [ FAILED ] PerfEventIsolatorTest.ROOT_CGROUPS_Sample
> [ FAILED ] UserCgroupIsolatorTest/2.ROOT_CGROUPS_UserCgroup, where
> TypeParam = mesos::internal::slave::CgroupsPerfEventIsolatorProcess
> [ FAILED ]
> MesosContainerizerSlaveRecoveryTest.CGROUPS_ROOT_PerfRollForward
> [ FAILED ] CgroupsAnyHierarchyWithPerfEventTest.ROOT_CGROUPS_Perf
> [ FAILED ] MemoryPressureMesosTest.CGROUPS_ROOT_Statistics
> [ FAILED ] MemoryPressureMesosTest.CGROUPS_ROOT_SlaveRecovery
> [ FAILED ] NsTest.ROOT_setns
> [ FAILED ] PerfTest.ROOT_Events
> [ FAILED ] PerfTest.ROOT_SamplePid
>
> 10 FAILED TESTS
> YOU HAVE 12 DISABLED TESTS
>
>
> *Marco Massenzio*
> *Distributed Systems Engineer*
>
> On Fri, Jul 17, 2015 at 6:49 PM, Vinod Kone <vinodk...@gmail.com> wrote:
>
>> +1 (binding)
>>
>> Successfully built RPMs for CentOS5 and CentOS6 with network isolator.
>>
>>
>> On Fri, Jul 17, 2015 at 4:56 PM, Khanduja, Vaibhav <
>> vaibhav.khand...@emc.com
>> > wrote:
>>
>> > +1
>> >
>> > Sent from my iPhone. Please excuse the typos and brevity of this
>> message.
>> >
>> > > On Jul 17, 2015, at 4:43 PM, Adam Bordelon <a...@mesosphere.io>
>> wrote:
>> > >
>> > > Hello Mesos community,
>> > >
>> > > Please vote on releasing the following candidate as Apache Mesos
>> 0.23.0.
>> > >
>> > > 0.23.0 includes the following:
>> > >
>> >
>> --------------------------------------------------------------------------------
>> > > - Per-container network isolation
>> > > - Dockerized slaves will properly recover Docker containers upon
>> > failover.
>> > > - Upgraded minimum required compilers to GCC 4.8+ or clang 3.5+.
>> > >
>> > > as well as experimental support for:
>> > > - Fetcher Caching
>> > > - Revocable Resources
>> > > - SSL encryption
>> > > - Persistent Volumes
>> > > - Dynamic Reservations
>> > >
>> > > The CHANGELOG for the release is available at:
>> > >
>> >
>> https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=blob_plain;f=CHANGELOG;hb=0.23.0-rc4
>> > >
>> >
>> --------------------------------------------------------------------------------
>> > >
>> > > The candidate for Mesos 0.23.0 release is available at:
>> > >
>> >
>> https://dist.apache.org/repos/dist/dev/mesos/0.23.0-rc4/mesos-0.23.0.tar.gz
>> > >
>> > > The tag to be voted on is 0.23.0-rc4:
>> > >
>> >
>> https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=commit;h=0.23.0-rc4
>> > >
>> > > The MD5 checksum of the tarball can be found at:
>> > >
>> >
>> https://dist.apache.org/repos/dist/dev/mesos/0.23.0-rc4/mesos-0.23.0.tar.gz.md5
>> > >
>> > > The signature of the tarball can be found at:
>> > >
>> >
>> https://dist.apache.org/repos/dist/dev/mesos/0.23.0-rc4/mesos-0.23.0.tar.gz.asc
>> > >
>> > > The PGP key used to sign the release is here:
>> > > https://dist.apache.org/repos/dist/release/mesos/KEYS
>> > >
>> > > The JAR is up in Maven in a staging repository here:
>> > >
>> https://repository.apache.org/content/repositories/orgapachemesos-1062
>> > >
>> > > Please vote on releasing this package as Apache Mesos 0.23.0!
>> > >
>> > > The vote is open until Wed July 22nd, 17:00 PDT 2015 and passes if a
>> > > majority of at least 3 +1 PMC votes are cast.
>> > >
>> > > [ ] +1 Release this package as Apache Mesos 0.23.0 (I've tested it!)
>> > > [ ] -1 Do not release this package because ...
>> > >
>> > > Thanks,
>> > > -Adam-
>> >
>>
>
>
$ sudo make -j12 V=0 check
[==========] 712 tests from 116 test cases ran. (318672 ms total)
[ PASSED ] 676 tests.
[ FAILED ] 36 tests, listed below:
[ FAILED ] PerfEventIsolatorTest.ROOT_CGROUPS_Sample
[ FAILED ] UserCgroupIsolatorTest/2.ROOT_CGROUPS_UserCgroup, where TypeParam = mesos::internal::slave::CgroupsPerfEventIsolatorProcess
[ FAILED ] SlaveRecoveryTest/0.RecoverSlaveState, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.RecoverStatusUpdateManager, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.ReconnectExecutor, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.RecoverUnregisteredExecutor, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.RecoverTerminatedExecutor, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.RecoverCompletedExecutor, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.CleanupExecutor, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.RemoveNonCheckpointingFramework, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.NonCheckpointingFramework, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.KillTask, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.Reboot, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.GCExecutor, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.ShutdownSlave, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.ShutdownSlaveSIGUSR1, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.RegisterDisconnectedSlave, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.ReconcileKillTask, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.ReconcileShutdownFramework, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.ReconcileTasksMissingFromSlave, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.SchedulerFailover, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.PartitionedSlave, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.MasterFailover, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.MultipleFrameworks, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.MultipleSlaves, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] SlaveRecoveryTest/0.RestartBeforeContainerizerLaunch, where TypeParam = mesos::internal::slave::MesosContainerizer
[ FAILED ] MesosContainerizerSlaveRecoveryTest.ResourceStatistics
[ FAILED ] MesosContainerizerSlaveRecoveryTest.CGROUPS_ROOT_PerfRollForward
[ FAILED ] MesosContainerizerSlaveRecoveryTest.CGROUPS_ROOT_PidNamespaceForward
[ FAILED ] MesosContainerizerSlaveRecoveryTest.CGROUPS_ROOT_PidNamespaceBackward
[ FAILED ] CgroupsAnyHierarchyWithPerfEventTest.ROOT_CGROUPS_Perf
[ FAILED ] MemoryPressureMesosTest.CGROUPS_ROOT_Statistics
[ FAILED ] MemoryPressureMesosTest.CGROUPS_ROOT_SlaveRecovery
[ FAILED ] NsTest.ROOT_setns
[ FAILED ] PerfTest.ROOT_Events
[ FAILED ] PerfTest.ROOT_SamplePid
36 FAILED TESTS
YOU HAVE 12 DISABLED TESTS
[ RUN ] UserCgroupIsolatorTest/2.ROOT_CGROUPS_UserCgroup
../../src/tests/isolator_tests.cpp:1210: Failure
isolator: Failed to create PerfEvent isolator, invalid events: { cpu-cycles }
[ FAILED ] UserCgroupIsolatorTest/2.ROOT_CGROUPS_UserCgroup, where TypeParam = mesos::internal::slave::CgroupsPerfEventIsolatorProcess (3 ms)
userdel: mesos.test.unprivileged.user mail spool (/var/mail/mesos.test.unprivileged.user) not found
userdel: mesos.test.unprivileged.user home directory (/home/mesos.test.unprivileged.user) not found
[----------] 1 test from UserCgroupIsolatorTest/2 (3 ms total)
[----------] 24 tests from SlaveRecoveryTest/0, where TypeParam = mesos::internal::slave::MesosContainerizer
[ RUN ] SlaveRecoveryTest/0.RecoverSlaveState
2015-07-17 20:08:14,697:8318(0x2ab579b2f700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:58356] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
I0717 20:08:14.833111 13827 exec.cpp:132] Version: 0.23.0
I0717 20:08:14.839572 13842 exec.cpp:206] Executor registered on slave 20150717-200814-855746752-41031-8318-S0
Registered executor on gondor
Starting task bfb318c0-fa7e-430b-bc27-2c1e2d593ba9
Forked command at 13854
sh -c 'sleep 1000'
I0717 20:08:14.880101 13845 exec.cpp:379] Executor asked to shutdown
Shutting down
Sending SIGTERM to process tree at pid 13854
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.RecoverSlaveState, where TypeParam = mesos::internal::slave::MesosContainerizer (399 ms)
[ RUN ] SlaveRecoveryTest/0.RecoverStatusUpdateManager
I0717 20:08:15.233203 13876 exec.cpp:132] Version: 0.23.0
I0717 20:08:15.241922 13901 exec.cpp:206] Executor registered on slave 20150717-200814-855746752-41031-8318-S0
Registered executor on gondor
Starting task 17e4b799-642b-49a0-8048-deff5f7f4dfb
Forked command at 13903
sh -c 'sleep 1000'
I0717 20:08:15.336854 13894 exec.cpp:252] Received reconnect request from slave 20150717-200814-855746752-41031-8318-S0
I0717 20:08:15.338824 13891 exec.cpp:229] Executor re-registered on slave 20150717-200814-855746752-41031-8318-S0
Re-registered executor on gondor
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.RecoverStatusUpdateManager, where TypeParam = mesos::internal::slave::MesosContainerizer (2519 ms)
[ RUN ] SlaveRecoveryTest/0.ReconnectExecutor
I0717 20:08:17.746152 13923 exec.cpp:132] Version: 0.23.0
I0717 20:08:17.754545 13939 exec.cpp:206] Executor registered on slave 20150717-200817-855746752-41031-8318-S0
Registered executor on gondor
Starting task 27f7f2c8-735a-41e4-850f-cde84b440635
Forked command at 13950
sh -c 'sleep 1000'
I0717 20:08:17.841579 13939 exec.cpp:252] Received reconnect request from slave 20150717-200817-855746752-41031-8318-S0
I0717 20:08:17.843380 13941 exec.cpp:229] Executor re-registered on slave 20150717-200817-855746752-41031-8318-S0
Re-registered executor on gondor
2015-07-17 20:08:18,032:8318(0x2ab579b2f700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:58356] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.ReconnectExecutor, where TypeParam = mesos::internal::slave::MesosContainerizer (2545 ms)
[ RUN ] SlaveRecoveryTest/0.RecoverUnregisteredExecutor
I0717 20:08:20.310029 13968 exec.cpp:132] Version: 0.23.0
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.RecoverUnregisteredExecutor, where TypeParam = mesos::internal::slave::MesosContainerizer (556 ms)
[ RUN ] SlaveRecoveryTest/0.RecoverTerminatedExecutor
I0717 20:08:20.845865 14013 exec.cpp:132] Version: 0.23.0
I0717 20:08:20.851996 14030 exec.cpp:206] Executor registered on slave 20150717-200820-855746752-41031-8318-S0
Registered executor on gondor
Starting task d4094f2b-16b1-455b-93ec-ad1edaa14b59
Forked command at 14040
sh -c 'sleep 1000'
I0717 20:08:20.885025 14031 exec.cpp:379] Executor asked to shutdown
Shutting down
Sending SIGTERM to process tree at pid 14040
Killing the following process trees:
[
-+- 14040 sh -c sleep 1000
\--- 14041 sleep 1000
]
Command terminated with signal Terminated (pid: 14040)
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.RecoverTerminatedExecutor, where TypeParam = mesos::internal::slave::MesosContainerizer (585 ms)
[ RUN ] SlaveRecoveryTest/0.RecoverCompletedExecutor
2015-07-17 20:08:21,368:8318(0x2ab579b2f700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:58356] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
I0717 20:08:21.482972 14058 exec.cpp:132] Version: 0.23.0
I0717 20:08:21.493788 14083 exec.cpp:206] Executor registered on slave 20150717-200821-855746752-41031-8318-S0
Registered executor on gondor
Starting task a6720acb-05af-4f13-9fca-2d57a90bc116
Forked command at 14085
sh -c 'exit 0'
Command exited with status 0 (pid: 14085)
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.RecoverCompletedExecutor, where TypeParam = mesos::internal::slave::MesosContainerizer (1673 ms)
[ RUN ] SlaveRecoveryTest/0.CleanupExecutor
I0717 20:08:23.144736 14103 exec.cpp:132] Version: 0.23.0
I0717 20:08:23.151906 14118 exec.cpp:206] Executor registered on slave 20150717-200822-855746752-41031-8318-S0
Registered executor on gondor
Starting task 6e44c1e2-fd33-4079-8f13-37199c0d4a18
Forked command at 14130
sh -c 'sleep 1000'
I0717 20:08:23.269175 14118 exec.cpp:379] Executor asked to shutdown
Shutting down
Sending SIGTERM to process tree at pid 14130
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.CleanupExecutor, where TypeParam = mesos::internal::slave::MesosContainerizer (1496 ms)
[ RUN ] SlaveRecoveryTest/0.RemoveNonCheckpointingFramework
I0717 20:08:24.607374 14164 exec.cpp:132] Version: 0.23.0
I0717 20:08:24.607735 14171 exec.cpp:132] Version: 0.23.0
I0717 20:08:24.613709 14211 exec.cpp:206] Executor registered on slave 20150717-200824-855746752-41031-8318-S0
I0717 20:08:24.614094 14198 exec.cpp:206] Executor registered on slave 20150717-200824-855746752-41031-8318-S0
Registered executor on gondor
Registered executor on gondor
Starting task 18369f85-840b-4d67-83b9-a175fa254afe
sh -c 'sleep 1000'
Forked command at 14218
Starting task 9abe6bfc-0cc4-4853-9748-08b1c4be2df2
Forked command at 14219
sh -c 'sleep 1000'
I0717 20:08:24.623004 14203 exec.cpp:379] Executor asked to shutdown
Shutting down
Sending SIGTERM to process tree at pid 14219
I0717 20:08:24.623356 14208 exec.cpp:379] Executor asked to shutdown
Shutting down
Sending SIGTERM to process tree at pid 14218
Killing the following process trees:
[
-+- 14218 sh -c sleep 1000
\--- 14220 sleep 1000
]
2015-07-17 20:08:24,702:8318(0x2ab579b2f700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:58356] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
Command terminated with signal Terminated (pid: 14218)
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.RemoveNonCheckpointingFramework, where TypeParam = mesos::internal::slave::MesosContainerizer (521 ms)
[ RUN ] SlaveRecoveryTest/0.NonCheckpointingFramework
I0717 20:08:25.172309 14238 exec.cpp:132] Version: 0.23.0
I0717 20:08:25.179725 14259 exec.cpp:206] Executor registered on slave 20150717-200824-855746752-41031-8318-S0
Registered executor on gondor
Starting task f80cb550-0a2a-490a-a517-f2bc96749cb8
Forked command at 14265
sh -c 'sleep 1000'
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.NonCheckpointingFramework, where TypeParam = mesos::internal::slave::MesosContainerizer (546 ms)
[ RUN ] SlaveRecoveryTest/0.KillTask
I0717 20:08:25.702378 14283 exec.cpp:132] Version: 0.23.0
I0717 20:08:25.710728 14299 exec.cpp:206] Executor registered on slave 20150717-200825-855746752-41031-8318-S0
Registered executor on gondor
Starting task cd6b73cc-0e9a-4330-9586-27e2e3dd8029
Forked command at 14310
sh -c 'sleep 1000'
I0717 20:08:25.822661 14303 exec.cpp:252] Received reconnect request from slave 20150717-200825-855746752-41031-8318-S0
I0717 20:08:25.823992 14297 exec.cpp:229] Executor re-registered on slave 20150717-200825-855746752-41031-8318-S0
Re-registered executor on gondor
Shutting down
Sending SIGTERM to process tree at pid 14310
Killing the following process trees:
[
-+- 14310 sh -c sleep 1000
\--- 14311 sleep 1000
]
Command terminated with signal Terminated (pid: 14310)
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.KillTask, where TypeParam = mesos::internal::slave::MesosContainerizer (683 ms)
[ RUN ] SlaveRecoveryTest/0.Reboot
I0717 20:08:26.386806 14329 exec.cpp:132] Version: 0.23.0
I0717 20:08:26.394809 14353 exec.cpp:206] Executor registered on slave 20150717-200826-855746752-41031-8318-S0
Registered executor on gondor
Starting task 03b3f53c-c648-4628-a157-eb6fcc660ea7
Forked command at 14356
sh -c 'sleep 1000'
I0717 20:08:26.426331 14344 exec.cpp:379] Executor asked to shutdown
Shutting down
Sending SIGTERM to process tree at pid 14356
Killing the following process trees:
[
-+- 14356 sh -c sleep 1000
\--- 14357 sleep 1000
]
Command terminated with signal Terminated (pid: 14356)
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.Reboot, where TypeParam = mesos::internal::slave::MesosContainerizer (1647 ms)
[ RUN ] SlaveRecoveryTest/0.GCExecutor
2015-07-17 20:08:28,038:8318(0x2ab579b2f700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:58356] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
I0717 20:08:28.039284 14374 exec.cpp:132] Version: 0.23.0
I0717 20:08:28.046208 14390 exec.cpp:206] Executor registered on slave 20150717-200827-855746752-41031-8318-S0
Registered executor on gondor
Starting task 84c82d9d-791f-4d4a-94ba-34f87adadb4b
Forked command at 14410
sh -c 'sleep 1000'
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.GCExecutor, where TypeParam = mesos::internal::slave::MesosContainerizer (648 ms)
[ RUN ] SlaveRecoveryTest/0.ShutdownSlave
I0717 20:08:28.712652 14429 exec.cpp:132] Version: 0.23.0
I0717 20:08:28.719861 14446 exec.cpp:206] Executor registered on slave 20150717-200828-855746752-41031-8318-S0
Registered executor on gondor
Starting task 09cc8af6-c7e7-49b1-9308-82f19ca401d0
Forked command at 14456
sh -c 'sleep 1000'
I0717 20:08:28.735227 14446 exec.cpp:379] Executor asked to shutdown
Shutting down
Sending SIGTERM to process tree at pid 14456
Killing the following process trees:
[
-+- 14456 sh -c sleep 1000
\--- 14457 sleep 1000
]
Command terminated with signal Terminated (pid: 14456)
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.ShutdownSlave, where TypeParam = mesos::internal::slave::MesosContainerizer (1639 ms)
[ RUN ] SlaveRecoveryTest/0.ShutdownSlaveSIGUSR1
I0717 20:08:30.323788 14474 exec.cpp:132] Version: 0.23.0
I0717 20:08:30.332345 14491 exec.cpp:206] Executor registered on slave 20150717-200830-855746752-41031-8318-S0
Registered executor on gondor
Starting task 28c29582-4274-4380-aae0-db9aa41501ec
Forked command at 14501
sh -c 'sleep 1000'
I0717 20:08:30.349701 14494 exec.cpp:379] Executor asked to shutdown
Shutting down
Sending SIGTERM to process tree at pid 14501
Killing the following process trees:
[
-+- 14501 sh -c sleep 1000
\--- 14502 sleep 1000
]
Command terminated with signal Terminated (pid: 14501)
2015-07-17 20:08:31,374:8318(0x2ab579b2f700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:58356] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.ShutdownSlaveSIGUSR1, where TypeParam = mesos::internal::slave::MesosContainerizer (1573 ms)
[ RUN ] SlaveRecoveryTest/0.RegisterDisconnectedSlave
I0717 20:08:31.907698 14519 exec.cpp:132] Version: 0.23.0
I0717 20:08:31.915663 14545 exec.cpp:206] Executor registered on slave 20150717-200831-855746752-41031-8318-S0
Registered executor on gondor
Starting task cdd1411a-709f-41ae-8612-0cefb4fef4f1
Forked command at 14547
sh -c 'sleep 1000'
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.RegisterDisconnectedSlave, where TypeParam = mesos::internal::slave::MesosContainerizer (465 ms)
[ RUN ] SlaveRecoveryTest/0.ReconcileKillTask
I0717 20:08:32.372339 14565 exec.cpp:132] Version: 0.23.0
I0717 20:08:32.382403 14585 exec.cpp:206] Executor registered on slave 20150717-200832-855746752-41031-8318-S0
Registered executor on gondor
Starting task abb51417-303d-4c34-87ef-fc12cb989b10
Forked command at 14592
sh -c 'sleep 1000'
I0717 20:08:32.490896 14587 exec.cpp:252] Received reconnect request from slave 20150717-200832-855746752-41031-8318-S0
I0717 20:08:32.493825 14581 exec.cpp:229] Executor re-registered on slave 20150717-200832-855746752-41031-8318-S0
Re-registered executor on gondor
Shutting down
Sending SIGTERM to process tree at pid 14592
Killing the following process trees:
[
-+- 14592 sh -c sleep 1000
\--- 14593 sleep 1000
]
Command terminated with signal Terminated (pid: 14592)
2015-07-17 20:08:34,708:8318(0x2ab579b2f700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:58356] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.ReconcileKillTask, where TypeParam = mesos::internal::slave::MesosContainerizer (3129 ms)
[ RUN ] SlaveRecoveryTest/0.ReconcileShutdownFramework
I0717 20:08:35.481480 14610 exec.cpp:132] Version: 0.23.0
I0717 20:08:35.489176 14632 exec.cpp:206] Executor registered on slave 20150717-200835-855746752-41031-8318-S0
Registered executor on gondor
Starting task bf6b6522-1ada-4757-bf80-0d36be48131e
Forked command at 14637
sh -c 'sleep 1000'
I0717 20:08:35.621249 14630 exec.cpp:252] Received reconnect request from slave 20150717-200835-855746752-41031-8318-S0
I0717 20:08:35.622442 14626 exec.cpp:229] Executor re-registered on slave 20150717-200835-855746752-41031-8318-S0
Re-registered executor on gondor
I0717 20:08:37.630388 14628 exec.cpp:379] Executor asked to shutdown
Shutting down
Sending SIGTERM to process tree at pid 14637
Killing the following process trees:
[
-+- 14637 sh -c sleep 1000
\--- 14638 sleep 1000
]
Command terminated with signal Terminated (pid: 14637)
2015-07-17 20:08:38,042:8318(0x2ab579b2f700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:58356] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.ReconcileShutdownFramework, where TypeParam = mesos::internal::slave::MesosContainerizer (3621 ms)
[ RUN ] SlaveRecoveryTest/0.ReconcileTasksMissingFromSlave
I0717 20:08:39.110148 14655 exec.cpp:132] Version: 0.23.0
I0717 20:08:39.117296 14673 exec.cpp:206] Executor registered on slave 20150717-200838-855746752-41031-8318-S0
Registered executor on gondor
Starting task 049f5774-e326-4265-be06-a86e3c96b949
Forked command at 14683
sh -c 'sleep 10'
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.ReconcileTasksMissingFromSlave, where TypeParam = mesos::internal::slave::MesosContainerizer (614 ms)
[ RUN ] SlaveRecoveryTest/0.SchedulerFailover
I0717 20:08:39.727418 14701 exec.cpp:132] Version: 0.23.0
I0717 20:08:39.735034 14781 exec.cpp:206] Executor registered on slave 20150717-200839-855746752-41031-8318-S0
Registered executor on gondor
Starting task d8efae39-e0c8-4e01-afb4-b74cb333e3b3
Forked command at 14793
sh -c 'sleep 1000'
I0717 20:08:39.852035 14785 exec.cpp:252] Received reconnect request from slave 20150717-200839-855746752-41031-8318-S0
I0717 20:08:39.853133 14786 exec.cpp:229] Executor re-registered on slave 20150717-200839-855746752-41031-8318-S0
Re-registered executor on gondor
Shutting down
Sending SIGTERM to process tree at pid 14793
Killing the following process trees:
[
-+- 14793 sh -c sleep 1000
\--- 14794 sleep 1000
]
Command terminated with signal Terminated (pid: 14793)
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.SchedulerFailover, where TypeParam = mesos::internal::slave::MesosContainerizer (685 ms)
[ RUN ] SlaveRecoveryTest/0.PartitionedSlave
I0717 20:08:40.399133 14811 exec.cpp:132] Version: 0.23.0
I0717 20:08:40.405736 14834 exec.cpp:206] Executor registered on slave 20150717-200840-855746752-41031-8318-S0
Registered executor on gondor
Starting task ec9a2f01-ca91-452e-918b-965c38f37ee3
Forked command at 14838
sh -c 'sleep 1000'
I0717 20:08:40.534641 14829 exec.cpp:379] Executor asked to shutdown
Shutting down
Sending SIGTERM to process tree at pid 14838
Killing the following process trees:
[
-+- 14838 sh -c sleep 1000
\--- 14839 sleep 1000
]
Command terminated with signal Terminated (pid: 14838)
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.PartitionedSlave, where TypeParam = mesos::internal::slave::MesosContainerizer (745 ms)
[ RUN ] SlaveRecoveryTest/0.MasterFailover
I0717 20:08:41.141676 14856 exec.cpp:132] Version: 0.23.0
I0717 20:08:41.151331 14878 exec.cpp:206] Executor registered on slave 20150717-200840-855746752-41031-8318-S0
Registered executor on gondor
Starting task 4cafa57d-009e-48f3-8070-a26d9bc68fd0
Forked command at 14883
sh -c 'sleep 1000'
I0717 20:08:41.334339 14870 exec.cpp:252] Received reconnect request from slave 20150717-200840-855746752-41031-8318-S0
I0717 20:08:41.335934 14878 exec.cpp:229] Executor re-registered on slave 20150717-200840-855746752-41031-8318-S0
Re-registered executor on gondor
2015-07-17 20:08:41,378:8318(0x2ab579b2f700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:58356] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
Shutting down
Sending SIGTERM to process tree at pid 14883
Killing the following process trees:
[
-+- 14883 sh -c sleep 1000
\--- 14884 sleep 1000
]
Command terminated with signal Terminated (pid: 14883)
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.MasterFailover, where TypeParam = mesos::internal::slave::MesosContainerizer (1711 ms)
[ RUN ] SlaveRecoveryTest/0.MultipleFrameworks
I0717 20:08:42.885495 14901 exec.cpp:132] Version: 0.23.0
I0717 20:08:42.892783 14924 exec.cpp:206] Executor registered on slave 20150717-200842-855746752-41031-8318-S0
Registered executor on gondor
Starting task 4105747f-8b94-4371-a13f-243084182d1e
Forked command at 14928
sh -c 'sleep 1000'
I0717 20:08:43.078428 14953 exec.cpp:132] Version: 0.23.0
I0717 20:08:43.084857 14968 exec.cpp:206] Executor registered on slave 20150717-200842-855746752-41031-8318-S0
Registered executor on gondor
Starting task 23b2f6f3-c10f-43f8-b0f4-fce19fb4ae4f
Forked command at 14981
sh -c 'sleep 1000'
I0717 20:08:43.212788 14923 exec.cpp:252] Received reconnect request from slave 20150717-200842-855746752-41031-8318-S0
I0717 20:08:43.212971 14975 exec.cpp:252] Received reconnect request from slave 20150717-200842-855746752-41031-8318-S0
I0717 20:08:43.214150 14922 exec.cpp:229] Executor re-registered on slave 20150717-200842-855746752-41031-8318-S0
I0717 20:08:43.214524 14973 exec.cpp:229] Executor re-registered on slave 20150717-200842-855746752-41031-8318-S0
Re-registered executor on gondor
Re-registered executor on gondor
Shutting down
Sending SIGTERM to process tree at pid 14928
Killing the following process trees:
[
-+- 14928 sh -c sleep 1000
\--- 14929 sleep 1000
]
Command terminated with signal Terminated (pid: 14928)
Shutting down
Sending SIGTERM to process tree at pid 14981
Killing the following process trees:
[
-+- 14981 sh -c sleep 1000
\--- 14982 sleep 1000
]
Command terminated with signal Terminated (pid: 14981)
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.MultipleFrameworks, where TypeParam = mesos::internal::slave::MesosContainerizer (1982 ms)
[ RUN ] SlaveRecoveryTest/0.MultipleSlaves
2015-07-17 20:08:44,716:8318(0x2ab579b2f700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:58356] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
I0717 20:08:44.816126 15004 exec.cpp:132] Version: 0.23.0
I0717 20:08:44.824059 15025 exec.cpp:206] Executor registered on slave 20150717-200844-855746752-41031-8318-S0
Registered executor on gondor
Starting task 6a8cf24e-737f-449d-8c55-eda697d70efb
Forked command at 15031
sh -c 'sleep 1000'
I0717 20:08:45.043156 15049 exec.cpp:132] Version: 0.23.0
I0717 20:08:45.049672 15068 exec.cpp:206] Executor registered on slave 20150717-200844-855746752-41031-8318-S1
Registered executor on gondor
Starting task f7dc198b-e21e-405c-ac2c-5569b5ec47d9
Forked command at 15076
sh -c 'sleep 1000'
I0717 20:08:45.137295 15022 exec.cpp:252] Received reconnect request from slave 20150717-200844-855746752-41031-8318-S0
I0717 20:08:45.139082 15019 exec.cpp:229] Executor re-registered on slave 20150717-200844-855746752-41031-8318-S0
Re-registered executor on gondor
I0717 20:08:45.164255 15069 exec.cpp:252] Received reconnect request from slave 20150717-200844-855746752-41031-8318-S1
I0717 20:08:45.166718 15065 exec.cpp:229] Executor re-registered on slave 20150717-200844-855746752-41031-8318-S1
Re-registered executor on gondor
Shutting down
Sending SIGTERM to process tree at pid 15031
Shutting down
Sending SIGTERM to process tree at pid 15076
Killing the following process trees:
[
-+- 15076 sh -c sleep 1000
\--- 15077 sleep 1000
]
Killing the following process trees:
[
-+- 15031 sh -c sleep 1000
\--- 15032 sleep 1000
]
Command terminated with signal Terminated (pid: 15031)
Command terminated with signal Terminated (pid: 15076)
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.MultipleSlaves, where TypeParam = mesos::internal::slave::MesosContainerizer (1969 ms)
[ RUN ] SlaveRecoveryTest/0.RestartBeforeContainerizerLaunch
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] SlaveRecoveryTest/0.RestartBeforeContainerizerLaunch, where TypeParam = mesos::internal::slave::MesosContainerizer (259 ms)
[----------] 24 tests from SlaveRecoveryTest/0 (32212 ms total)
[----------] 4 tests from MesosContainerizerSlaveRecoveryTest
[ RUN ] MesosContainerizerSlaveRecoveryTest.ResourceStatistics
I0717 20:08:47.062319 15097 exec.cpp:132] Version: 0.23.0
I0717 20:08:47.070647 15120 exec.cpp:206] Executor registered on slave 20150717-200846-855746752-41031-8318-S0
Registered executor on gondor
I0717 20:08:47.115875 15119 exec.cpp:252] Received reconnect request from slave 20150717-200846-855746752-41031-8318-S0
I0717 20:08:47.117795 15113 exec.cpp:229] Executor re-registered on slave 20150717-200846-855746752-41031-8318-S0
Re-registered executor on gondor
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] MesosContainerizerSlaveRecoveryTest.ResourceStatistics (529 ms)
[ RUN ] MesosContainerizerSlaveRecoveryTest.CGROUPS_ROOT_PerfRollForward
I0717 20:08:47.554780 15140 exec.cpp:132] Version: 0.23.0
I0717 20:08:47.562708 15154 exec.cpp:206] Executor registered on slave 20150717-200847-855746752-41031-8318-S0
Registered executor on gondor
Starting task 9773c1ea-ad75-4bad-a981-5f6974ee2ad3
Forked command at 15167
sh -c 'sleep 1000'
../../src/tests/slave_recovery_tests.cpp:3446: Failure
containerizer2: Could not create isolator cgroups/perf_event: Failed to create PerfEvent isolator, invalid events: { cycles, task-clock }
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
../../3rdparty/libprocess/include/process/gmock.hpp:353: Failure
Actual function call count doesn't match EXPECT_CALL(filter->mock, filter(testing::A<const DispatchEvent&>()))...
Expected args: dispatch matcher (1-byte object <2C>, 16-byte object <29-00 00-00 00-00 00-00 00-00 00-00 00-00 00-00>)
Expected: to be called once
Actual: never called - unsatisfied and active
[ FAILED ] MesosContainerizerSlaveRecoveryTest.CGROUPS_ROOT_PerfRollForward (326 ms)
[ RUN ] MesosContainerizerSlaveRecoveryTest.CGROUPS_ROOT_PidNamespaceForward
I0717 20:08:47.916124 15186 exec.cpp:132] Version: 0.23.0
I0717 20:08:47.927609 15208 exec.cpp:206] Executor registered on slave 20150717-200847-855746752-41031-8318-S0
Registered executor on gondor
I0717 20:08:47.984086 15211 exec.cpp:252] Received reconnect request from slave 20150717-200847-855746752-41031-8318-S0
I0717 20:08:47.985383 15207 exec.cpp:229] Executor re-registered on slave 20150717-200847-855746752-41031-8318-S0
Re-registered executor on gondor
2015-07-17 20:08:48,052:8318(0x2ab579b2f700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:58356] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] MesosContainerizerSlaveRecoveryTest.CGROUPS_ROOT_PidNamespaceForward (3186 ms)
[ RUN ] MesosContainerizerSlaveRecoveryTest.CGROUPS_ROOT_PidNamespaceBackward
I0717 20:08:51.078325 19 exec.cpp:132] Version: 0.23.0
I0717 20:08:51.088460 39 exec.cpp:206] Executor registered on slave 20150717-200850-855746752-41031-8318-S0
Registered executor on gondor
I0717 20:08:51.147610 35 exec.cpp:252] Received reconnect request from slave 20150717-200850-855746752-41031-8318-S0
I0717 20:08:51.148735 39 exec.cpp:229] Executor re-registered on slave 20150717-200850-855746752-41031-8318-S0
Re-registered executor on gondor
2015-07-17 20:08:51,389:8318(0x2ab579b2f700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:58356] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] MesosContainerizerSlaveRecoveryTest.CGROUPS_ROOT_PidNamespaceBackward (3242 ms)
[----------] 4 tests from MesosContainerizerSlaveRecoveryTest (7284 ms total)
[----------] 1 test from CgroupsAnyHierarchyWithPerfEventTest
[ RUN ] CgroupsAnyHierarchyWithPerfEventTest.ROOT_CGROUPS_Perf
../../src/tests/cgroups_tests.cpp:169: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
../../src/tests/cgroups_tests.cpp:187: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] CgroupsAnyHierarchyWithPerfEventTest.ROOT_CGROUPS_Perf (6 ms)
[----------] 1 test from CgroupsAnyHierarchyWithPerfEventTest (6 ms total)
[ RUN ] MemoryPressureMesosTest.CGROUPS_ROOT_Statistics
I0717 20:09:15.776612 15783 exec.cpp:132] Version: 0.23.0
I0717 20:09:15.783463 15799 exec.cpp:206] Executor registered on slave 20150717-200915-855746752-41031-8318-S0
Registered executor on gondor
Starting task 37612538-f192-4786-a65b-bf16f971b030
Forked command at 15810
sh -c 'while true; do dd count=512 bs=1M if=/dev/zero of=./temp; done'
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] MemoryPressureMesosTest.CGROUPS_ROOT_Statistics (621 ms)
[ RUN ] MemoryPressureMesosTest.CGROUPS_ROOT_SlaveRecovery
I0717 20:09:16.829890 15830 exec.cpp:132] Version: 0.23.0
I0717 20:09:16.838702 15855 exec.cpp:206] Executor registered on slave 20150717-200916-855746752-41031-8318-S0
Registered executor on gondor
Starting task 73793ef9-04e2-494c-baa7-f6266d6a86d1
Forked command at 15857
sh -c 'while true; do dd count=512 bs=1M if=/dev/zero of=./temp; done'
I0717 20:09:16.882215 15845 exec.cpp:252] Received reconnect request from slave 20150717-200916-855746752-41031-8318-S0
I0717 20:09:16.883414 15853 exec.cpp:229] Executor re-registered on slave 20150717-200916-855746752-41031-8318-S0
Re-registered executor on gondor
../../src/tests/mesos.cpp:757: Failure
(cgroups::destroy(hierarchy, cgroup)).failure(): Failed to remove cgroup '/sys/fs/cgroup/perf_event/mesos_test': Device or resource busy
[ FAILED ] MemoryPressureMesosTest.CGROUPS_ROOT_SlaveRecovery (1087 ms)
[----------] 2 tests from MemoryPressureMesosTest (1708 ms total)
[----------] 4 tests from NsTest
[ RUN ] NsTest.ROOT_setns
2015-07-17 20:09:18,076:8318(0x2ab579b2f700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:58356] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
../../src/tests/ns_tests.cpp:125: Failure
Value of: status.get().get()
Actual: 256
Expected: 0
[ FAILED ] NsTest.ROOT_setns (1087 ms)
[ RUN ] NsTest.ROOT_setnsMultipleThreads
[ OK ] NsTest.ROOT_setnsMultipleThreads (0 ms)
[ RUN ] NsTest.ROOT_getns
[ OK ] NsTest.ROOT_getns (40 ms)
[ RUN ] NsTest.ROOT_destroy
[ OK ] NsTest.ROOT_destroy (79 ms)
[----------] 4 tests from NsTest (1206 ms total)
[----------] 3 tests from PerfTest
[ RUN ] PerfTest.ROOT_Events
../../src/tests/perf_tests.cpp:52: Failure
Value of: perf::valid(events)
Actual: false
Expected: true
[ FAILED ] PerfTest.ROOT_Events (8 ms)
[ RUN ] PerfTest.Parse
[ OK ] PerfTest.Parse (1 ms)
[ RUN ] PerfTest.ROOT_SamplePid
../../src/tests/perf_tests.cpp:155: Failure
(statistics).failure(): Failed to execute perf, exit status: 0
[ FAILED ] PerfTest.ROOT_SamplePid (476 ms)
[----------] 3 tests from PerfTest (485 ms total)
