[
https://issues.apache.org/jira/browse/MESOS-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934166#comment-14934166
]
Niklas Quarfot Nielsen edited comment on MESOS-3123 at 9/28/15 10:08 PM:
-------------------------------------------------------------------------
Just ran into this during testing of Mesos 0.25.0 rc1 on Ubuntu 14.04
{code}
[ RUN ] DockerContainerizerTest.ROOT_DOCKER_Launch_Executor
2015-09-28
22:00:14,166:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:17,504:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:20,841:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:24,178:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
../../mesos/src/tests/containerizer/docker_containerizer_tests.cpp:254: Failure
Value of: statusRunning.get().state()
Actual: TASK_FAILED
Expected: TASK_RUNNING
2015-09-28
22:00:27,515:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:30,851:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:34,188:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:37,526:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:40,863:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:44,208:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:47,546:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:50,884:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:54,222:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:57,560:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:01:00,899:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:01:04,238:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:01:07,575:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:01:10,912:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:01:14,249:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:01:17,587:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:01:20,925:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:01:24,264:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
../../mesos/src/tests/containerizer/docker_containerizer_tests.cpp:255: Failure
Failed to wait 1mins for statusFinished
../../mesos/src/tests/containerizer/docker_containerizer_tests.cpp:246: Failure
Actual function call count doesn't match EXPECT_CALL(sched,
statusUpdate(&driver, _))...
Expected: to be called twice
Actual: called once - unsatisfied and active
*** Aborted at 1443477684 (unix time) try "date -d @1443477684" if you are
using GNU date ***
PC: @ 0x962798 mesos::internal::tests::Cluster::Slaves::shutdown()
*** SIGSEGV (@0x5bc8a6768) received by PID 7267 (TID 0x2ba9b84ec940) from PID
18446744072577771368; stack trace: ***
@ 0x2ba9e54cf427 os::Linux::chained_handler()
@ 0x2ba9e54d2ac7 JVM_handle_linux_signal
@ 0x2ba9bd49e340 (unknown)
@ 0x962798 mesos::internal::tests::Cluster::Slaves::shutdown()
@ 0x962558 mesos::internal::tests::Cluster::Slaves::~Slaves()
@ 0x963fd2 mesos::internal::tests::Cluster::~Cluster()
@ 0x964043 mesos::internal::tests::MesosTest::~MesosTest()
@ 0x1311329
mesos::internal::tests::DockerContainerizerTest::~DockerContainerizerTest()
@ 0x1321093
mesos::internal::tests::DockerContainerizerTest_ROOT_DOCKER_Launch_Executor_Test::~DockerContainerizerTest_ROOT_DOCKER_Launch_Executor_Test()
@ 0x13210c2
mesos::internal::tests::DockerContainerizerTest_ROOT_DOCKER_Launch_Executor_Test::~DockerContainerizerTest_ROOT_DOCKER_Launch_Executor_Test()
@ 0x147711c testing::Test::DeleteSelf_()
@ 0x14812ea
testing::internal::HandleSehExceptionsInMethodIfSupported<>()
@ 0x147c160
testing::internal::HandleExceptionsInMethodIfSupported<>()
@ 0x145e039 testing::TestInfo::Run()
@ 0x145e632 testing::TestCase::Run()
@ 0x1464d7a testing::internal::UnitTestImpl::RunAllTests()
@ 0x1481f0f
testing::internal::HandleSehExceptionsInMethodIfSupported<>()
@ 0x147ccd6
testing::internal::HandleExceptionsInMethodIfSupported<>()
@ 0x1463b16 testing::UnitTest::Run()
@ 0xd836b7 RUN_ALL_TESTS()
@ 0xd8335f main
@ 0x2ba9be2f9ec5 (unknown)
@ 0x958529 (unknown)
make[3]: *** [check-local] Segmentation fault (core dumped)
make[3]: Leaving directory `/home/vagrant/mesos-build/src'
make[2]: *** [check-am] Error 2
make[2]: Leaving directory `/home/vagrant/mesos-build/src'
make[1]: *** [check] Error 2
make[1]: Leaving directory `/home/vagrant/mesos-build/src'
make: *** [check-recursive] Error 1
{code}
was (Author: nnielsen):
{code}
[ RUN ] DockerContainerizerTest.ROOT_DOCKER_Launch_Executor
2015-09-28
22:00:14,166:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:17,504:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:20,841:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:24,178:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
../../mesos/src/tests/containerizer/docker_containerizer_tests.cpp:254: Failure
Value of: statusRunning.get().state()
Actual: TASK_FAILED
Expected: TASK_RUNNING
2015-09-28
22:00:27,515:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:30,851:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:34,188:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:37,526:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:40,863:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:44,208:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:47,546:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:50,884:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:54,222:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:00:57,560:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:01:00,899:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:01:04,238:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:01:07,575:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:01:10,912:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:01:14,249:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:01:17,587:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:01:20,925:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
2015-09-28
22:01:24,264:7267(0x2ba9fb511700):ZOO_ERROR@handle_socket_error_msg@1697:
Socket [127.0.0.1:53630] zk retcode=-4, errno=111(Connection refused): server
refused to accept the client
../../mesos/src/tests/containerizer/docker_containerizer_tests.cpp:255: Failure
Failed to wait 1mins for statusFinished
../../mesos/src/tests/containerizer/docker_containerizer_tests.cpp:246: Failure
Actual function call count doesn't match EXPECT_CALL(sched,
statusUpdate(&driver, _))...
Expected: to be called twice
Actual: called once - unsatisfied and active
*** Aborted at 1443477684 (unix time) try "date -d @1443477684" if you are
using GNU date ***
PC: @ 0x962798 mesos::internal::tests::Cluster::Slaves::shutdown()
*** SIGSEGV (@0x5bc8a6768) received by PID 7267 (TID 0x2ba9b84ec940) from PID
18446744072577771368; stack trace: ***
@ 0x2ba9e54cf427 os::Linux::chained_handler()
@ 0x2ba9e54d2ac7 JVM_handle_linux_signal
@ 0x2ba9bd49e340 (unknown)
@ 0x962798 mesos::internal::tests::Cluster::Slaves::shutdown()
@ 0x962558 mesos::internal::tests::Cluster::Slaves::~Slaves()
@ 0x963fd2 mesos::internal::tests::Cluster::~Cluster()
@ 0x964043 mesos::internal::tests::MesosTest::~MesosTest()
@ 0x1311329
mesos::internal::tests::DockerContainerizerTest::~DockerContainerizerTest()
@ 0x1321093
mesos::internal::tests::DockerContainerizerTest_ROOT_DOCKER_Launch_Executor_Test::~DockerContainerizerTest_ROOT_DOCKER_Launch_Executor_Test()
@ 0x13210c2
mesos::internal::tests::DockerContainerizerTest_ROOT_DOCKER_Launch_Executor_Test::~DockerContainerizerTest_ROOT_DOCKER_Launch_Executor_Test()
@ 0x147711c testing::Test::DeleteSelf_()
@ 0x14812ea
testing::internal::HandleSehExceptionsInMethodIfSupported<>()
@ 0x147c160
testing::internal::HandleExceptionsInMethodIfSupported<>()
@ 0x145e039 testing::TestInfo::Run()
@ 0x145e632 testing::TestCase::Run()
@ 0x1464d7a testing::internal::UnitTestImpl::RunAllTests()
@ 0x1481f0f
testing::internal::HandleSehExceptionsInMethodIfSupported<>()
@ 0x147ccd6
testing::internal::HandleExceptionsInMethodIfSupported<>()
@ 0x1463b16 testing::UnitTest::Run()
@ 0xd836b7 RUN_ALL_TESTS()
@ 0xd8335f main
@ 0x2ba9be2f9ec5 (unknown)
@ 0x958529 (unknown)
make[3]: *** [check-local] Segmentation fault (core dumped)
make[3]: Leaving directory `/home/vagrant/mesos-build/src'
make[2]: *** [check-am] Error 2
make[2]: Leaving directory `/home/vagrant/mesos-build/src'
make[1]: *** [check] Error 2
make[1]: Leaving directory `/home/vagrant/mesos-build/src'
make: *** [check-recursive] Error 1
{code}
> DockerContainerizerTest.ROOT_DOCKER_Launch_Executor_Bridged fails & crashes
> ---------------------------------------------------------------------------
>
> Key: MESOS-3123
> URL: https://issues.apache.org/jira/browse/MESOS-3123
> Project: Mesos
> Issue Type: Bug
> Components: docker, test
> Affects Versions: 0.23.0
> Environment: CentOS 7.1, or Ubuntu 14.04
> Mesos 0.23.0-rc4 or today's master
> Reporter: Adam B
> Assignee: Timothy Chen
> Labels: mesosphere
>
> Fails the test and then crashes while trying to shutdown the slaves.
> {code}
> [ RUN ] DockerContainerizerTest.ROOT_DOCKER_Launch_Executor_Bridged
> ../../src/tests/docker_containerizer_tests.cpp:618: Failure
> Value of: statusRunning.get().state()
> Actual: TASK_LOST
> Expected: TASK_RUNNING
> ../../src/tests/docker_containerizer_tests.cpp:619: Failure
> Failed to wait 1mins for statusFinished
> ../../src/tests/docker_containerizer_tests.cpp:610: Failure
> Actual function call count doesn't match EXPECT_CALL(sched,
> statusUpdate(&driver, _))...
> Expected: to be called twice
> Actual: called once - unsatisfied and active
> F0721 21:59:54.950773 30622 logging.cpp:57] RAW: Pure virtual method called
> @ 0x7f3915347a02 google::LogMessage::Fail()
> @ 0x7f391534cee4 google::RawLog__()
> @ 0x7f3914890312 __cxa_pure_virtual
> @ 0x88c3ae mesos::internal::tests::Cluster::Slaves::shutdown()
> @ 0x88c176 mesos::internal::tests::Cluster::Slaves::~Slaves()
> @ 0x88dc16 mesos::internal::tests::Cluster::~Cluster()
> @ 0x88dc87 mesos::internal::tests::MesosTest::~MesosTest()
> @ 0xa529ab
> mesos::internal::tests::DockerContainerizerTest::~DockerContainerizerTest()
> @ 0xa8125f
> mesos::internal::tests::DockerContainerizerTest_ROOT_DOCKER_Launch_Executor_Bridged_Test::~DockerContainerizerTest_ROOT_DOCKER_Launch_Executor_Bridged_Test()
> @ 0xa8128e
> mesos::internal::tests::DockerContainerizerTest_ROOT_DOCKER_Launch_Executor_Bridged_Test::~DockerContainerizerTest_ROOT_DOCKER_Launch_Executor_Bridged_Test()
> @ 0x1218b4e testing::Test::DeleteSelf_()
> @ 0x1221909
> testing::internal::HandleSehExceptionsInMethodIfSupported<>()
> @ 0x121cb38
> testing::internal::HandleExceptionsInMethodIfSupported<>()
> @ 0x1205713 testing::TestInfo::Run()
> @ 0x1205c4e testing::TestCase::Run()
> @ 0x120a9ca testing::internal::UnitTestImpl::RunAllTests()
> @ 0x122277b
> testing::internal::HandleSehExceptionsInMethodIfSupported<>()
> @ 0x121d81b
> testing::internal::HandleExceptionsInMethodIfSupported<>()
> @ 0x120987a testing::UnitTest::Run()
> @ 0xcfbf0c main
> @ 0x7f391097caf5 __libc_start_main
> @ 0x882089 (unknown)
> make[3]: *** [check-local] Aborted (core dumped)
> make[3]: Leaving directory `/home/me/mesos/build/src'
> make[2]: *** [check-am] Error 2
> make[2]: Leaving directory `/home/me/mesos/build/src'
> make[1]: *** [check] Error 2
> make[1]: Leaving directory `/home/me/mesos/build/src'
> make: *** [check-recursive] Error 1
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
