[ https://issues.apache.org/jira/browse/MESOS-830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14654519#comment-14654519 ]
Greg Mann commented on MESOS-830: --------------------------------- It seems this issue is due to a race condition as the logs are flushing at the conclusion of this test framework. If I fork off a process during MesosSchedulerDriver::start() and use it to attach a debugger to the driver process, I see the following at the SIGABRT: {noformat} (lldb) th li Process 25383 stopped thread #1: tid = 0x2e8f96, 0x00007fff86ac84de libsystem_kernel.dylib`mach_msg_trap + 10, queue = 'com.apple.main-thread' thread #2: tid = 0x2e8fb9, 0x00007fff86acd48a libsystem_kernel.dylib`__semwait_signal + 10 thread #3: tid = 0x2e8fba, 0x00007fff86ace232 libsystem_kernel.dylib`kevent64 + 10, queue = 'com.apple.libdispatch-manager' thread #4: tid = 0x2e8fbb, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10 thread #5: tid = 0x2e8fbc, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10 thread #6: tid = 0x2e8fbd, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10 thread #7: tid = 0x2e8fbe, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10 thread #8: tid = 0x2e8fbf, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10 thread #9: tid = 0x2e8fc0, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10 thread #10: tid = 0x2e8fc1, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10 thread #11: tid = 0x2e8fc2, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10 thread #12: tid = 0x2e8fc3, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10 thread #13: tid = 0x2e8fc4, 0x00007fff8d8c4d62 libsystem_malloc.dylib`tiny_free_list_add_ptr + 108 thread #14: tid = 0x2e8fc5, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10, name = 'Java: Reference Handler' thread #15: tid = 0x2e8fc6, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10, name = 'Java: Finalizer' thread #18: tid = 0x2e8fcb, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10, name = 'Java: Signal Dispatcher' thread #19: tid = 0x2e8fcc, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10, name = 'Java: C2 CompilerThread0' thread #20: tid = 0x2e8fcd, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10, name = 'Java: C2 CompilerThread1' thread #21: tid = 0x2e8fce, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10, name = 'Java: C2 CompilerThread2' thread #22: tid = 0x2e8fcf, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10, name = 'Java: C1 CompilerThread3' thread #23: tid = 0x2e8fd0, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10, name = 'Java: Service Thread' thread #25: tid = 0x2e8fd2, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10 thread #26: tid = 0x2e8fd3, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10 thread #27: tid = 0x2e8fd4, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10 thread #28: tid = 0x2e8fd5, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10 thread #29: tid = 0x2e8fd6, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10 thread #30: tid = 0x2e8fd7, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10 * thread #31: tid = 0x2e8fd8, 0x00007fff86acd286 libsystem_kernel.dylib`__pthread_kill + 10, stop reason = signal SIGABRT thread #32: tid = 0x2e8fd9, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10 thread #33: tid = 0x2e8fda, 0x00000001274f9fb0 libmesos-0.24.0.dylib`std::__1::atomic_flag* synchronized_get_pointer<std::__1::atomic_flag>(t=0x00007ff100000000) at synchronized.hpp:88 thread #34: tid = 0x2e8fdb, 0x00007fff86acd136 libsystem_kernel.dylib`__psynch_cvwait + 10 (lldb) th b * thread #31: tid = 0x2e8fd8, 0x00007fff86acd286 libsystem_kernel.dylib`__pthread_kill + 10, stop reason = signal SIGABRT frame #0: 0x00007fff86acd286 libsystem_kernel.dylib`__pthread_kill + 10 frame #1: 0x00007fff87e8842f libsystem_pthread.dylib`pthread_kill + 90 * frame #2: 0x00007fff8c237b53 libsystem_c.dylib`abort + 129 frame #3: 0x0000000129216010 libmesos-0.24.0.dylib`glog_internal_namespace_::Mutex::Lock(this=0x00000001298b4c38) + 64 at mutex.h:248 frame #4: 0x0000000129215fc3 libmesos-0.24.0.dylib`glog_internal_namespace_::MutexLock::MutexLock(this=0x000000012d945cc8, mu=0x00000001298b4c38) + 35 at mutex.h:288 frame #5: 0x000000012921285d libmesos-0.24.0.dylib`glog_internal_namespace_::MutexLock::MutexLock(this=0x000000012d945cc8, mu=0x00000001298b4c38) + 29 at mutex.h:288 frame #6: 0x0000000129202f17 libmesos-0.24.0.dylib`google::LogMessage::Flush(this=0x000000012d945e40) + 279 at logging.cc:1280 frame #7: 0x0000000129202db8 libmesos-0.24.0.dylib`google::LogMessage::~LogMessage(this=0x000000012d945e40) + 24 at logging.cc:1240 frame #8: 0x0000000129203065 libmesos-0.24.0.dylib`google::LogMessage::~LogMessage(this=0x000000012d945e40) + 21 at logging.cc:1239 frame #9: 0x00000001279b77f9 libmesos-0.24.0.dylib`mesos::internal::master::Master::removeExecutor(this=0x00007ff1e4007600, slave=0x00007ff1e2308d90, frameworkId=0x000000012d946410, executorId=0x00007ff1e2110d70) + 697 at master.cpp:5421 frame #10: 0x00000001279c6da6 libmesos-0.24.0.dylib`mesos::internal::master::Master::removeFramework(this=0x00007ff1e4007600, framework=0x00007ff1e205ce10) + 6678 at master.cpp:4928 frame #11: 0x00000001279a7bf4 libmesos-0.24.0.dylib`mesos::internal::master::Master::receive(this=0x00007ff1e4007600, from=0x00007ff1e0563348, call=0x000000012d946d28) + 1124 at master.cpp:1643 frame #12: 0x0000000127bb4b3f libmesos-0.24.0.dylib`void ProtobufProcess<mesos::internal::master::Master>::handlerM<mesos::scheduler::Call>(t=0x00007ff1e4007600, method=0x00000001279a7790, sender=0x00007ff1e0563348, data=0x00007ff1e0563398)(process::UPID const&, mesos::scheduler::Call const&), process::UPID const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) + 287 at protobuf.hpp:438 etc... (lldb) fr sel 7 frame #7: 0x0000000129202db8 libmesos-0.24.0.dylib`google::LogMessage::~LogMessage(this=0x000000012d945e40) + 24 at logging.cc:1240 1237 } 1238 1239 LogMessage::~LogMessage() { -> 1240 Flush(); 1241 delete allocated_; 1242 } 1243 (lldb) fr sel 6 frame #6: 0x0000000129202f17 libmesos-0.24.0.dylib`google::LogMessage::Flush(this=0x000000012d945e40) + 279 at logging.cc:1280 1277 // Prevent any subtle race conditions by wrapping a mutex lock around 1278 // the actual logging action per se. 1279 { -> 1280 MutexLock l(&log_mutex); 1281 (this->*(data_->send_method_))(); 1282 ++num_messages_[static_cast<int>(data_->severity_)]; 1283 } (lldb) fr sel 5 frame #5: 0x000000012921285d libmesos-0.24.0.dylib`glog_internal_namespace_::MutexLock::MutexLock(this=0x000000012d945cc8, mu=0x00000001298b4c38) + 29 at mutex.h:288 285 // MutexLock(mu) acquires mu when constructed and releases it when destroyed. 286 class MutexLock { 287 public: -> 288 explicit MutexLock(Mutex *mu) : mu_(mu) { mu_->Lock(); } 289 ~MutexLock() { mu_->Unlock(); } 290 private: 291 Mutex * const mu_; (lldb) fr sel 4 frame #4: 0x0000000129215fc3 libmesos-0.24.0.dylib`glog_internal_namespace_::MutexLock::MutexLock(this=0x000000012d945cc8, mu=0x00000001298b4c38) + 35 at mutex.h:288 285 // MutexLock(mu) acquires mu when constructed and releases it when destroyed. 286 class MutexLock { 287 public: -> 288 explicit MutexLock(Mutex *mu) : mu_(mu) { mu_->Lock(); } 289 ~MutexLock() { mu_->Unlock(); } 290 private: 291 Mutex * const mu_; (lldb) fr sel 3 frame #3: 0x0000000129216010 libmesos-0.24.0.dylib`glog_internal_namespace_::Mutex::Lock(this=0x00000001298b4c38) + 64 at mutex.h:248 245 if (is_safe_ && pthread_rwlock_init(&mutex_, NULL) != 0) abort(); 246 } 247 Mutex::~Mutex() { SAFE_PTHREAD(pthread_rwlock_destroy); } -> 248 void Mutex::Lock() { SAFE_PTHREAD(pthread_rwlock_wrlock); } 249 void Mutex::Unlock() { SAFE_PTHREAD(pthread_rwlock_unlock); } 250 #ifdef GMUTEX_TRYLOCK 251 bool Mutex::TryLock() { return is_safe_ ? {noformat} [~tillt], I found what seems to be a related issue that you ran into last year in the archives: http://mail-archives.apache.org/mod_mbox/mesos-dev/201406.mbox/%3ceacf6d6d-7dd3-4dad-8037-a12f31fd9...@me.com%3E Do you recall if you were finally able to resolve that issue? In that mesos-dev email, you claim that your error occurred because the mutex in question had been destroyed prior to the locking attempt; do you recall how you gathered that information? > ExamplesTest.JavaFramework is flaky > ----------------------------------- > > Key: MESOS-830 > URL: https://issues.apache.org/jira/browse/MESOS-830 > Project: Mesos > Issue Type: Bug > Components: test > Reporter: Vinod Kone > Assignee: Greg Mann > Labels: flaky, mesosphere > > Identify the cause of the following test failure: > [ RUN ] ExamplesTest.JavaFramework > Using temporary directory '/tmp/ExamplesTest_JavaFramework_wSc7u8' > Enabling authentication for the framework > I1120 15:13:39.820032 1681264640 master.cpp:285] Master started on > 172.25.133.171:52576 > I1120 15:13:39.820180 1681264640 master.cpp:299] Master ID: > 201311201513-2877626796-52576-3234 > I1120 15:13:39.820194 1681264640 master.cpp:302] Master only allowing > authenticated frameworks to register! > I1120 15:13:39.821197 1679654912 slave.cpp:112] Slave started on > 1)@172.25.133.171:52576 > I1120 15:13:39.821795 1679654912 slave.cpp:212] Slave resources: cpus(*):4; > mem(*):7168; disk(*):481998; ports(*):[31000-32000] > I1120 15:13:39.822855 1682337792 slave.cpp:112] Slave started on > 2)@172.25.133.171:52576 > I1120 15:13:39.823652 1682337792 slave.cpp:212] Slave resources: cpus(*):4; > mem(*):7168; disk(*):481998; ports(*):[31000-32000] > I1120 15:13:39.825330 1679118336 master.cpp:744] The newly elected leader is > master@172.25.133.171:52576 > I1120 15:13:39.825445 1679118336 master.cpp:748] Elected as the leading > master! > I1120 15:13:39.825907 1681264640 state.cpp:33] Recovering state from > '/tmp/ExamplesTest_JavaFramework_wSc7u8/0/meta' > I1120 15:13:39.826127 1681264640 status_update_manager.cpp:180] Recovering > status update manager > I1120 15:13:39.826331 1681801216 process_isolator.cpp:317] Recovering isolator > I1120 15:13:39.826738 1682874368 slave.cpp:2743] Finished recovery > I1120 15:13:39.827747 1682337792 state.cpp:33] Recovering state from > '/tmp/ExamplesTest_JavaFramework_wSc7u8/1/meta' > I1120 15:13:39.827945 1680191488 slave.cpp:112] Slave started on > 3)@172.25.133.171:52576 > I1120 15:13:39.828415 1682337792 status_update_manager.cpp:180] Recovering > status update manager > I1120 15:13:39.828608 1680728064 sched.cpp:260] Authenticating with master > master@172.25.133.171:52576 > I1120 15:13:39.828606 1680191488 slave.cpp:212] Slave resources: cpus(*):4; > mem(*):7168; disk(*):481998; ports(*):[31000-32000] > I1120 15:13:39.828680 1682874368 slave.cpp:497] New master detected at > master@172.25.133.171:52576 > I1120 15:13:39.828765 1682337792 process_isolator.cpp:317] Recovering isolator > I1120 15:13:39.829828 1680728064 sched.cpp:229] Detecting new master > I1120 15:13:39.830288 1679654912 authenticatee.hpp:100] Initializing client > SASL > I1120 15:13:39.831635 1680191488 state.cpp:33] Recovering state from > '/tmp/ExamplesTest_JavaFramework_wSc7u8/2/meta' > I1120 15:13:39.831991 1679118336 status_update_manager.cpp:158] New master > detected at master@172.25.133.171:52576 > I1120 15:13:39.832042 1682874368 slave.cpp:524] Detecting new master > I1120 15:13:39.832314 1682337792 slave.cpp:2743] Finished recovery > I1120 15:13:39.832309 1681264640 master.cpp:1266] Attempting to register > slave on vkone.local at slave(1)@172.25.133.171:52576 > I1120 15:13:39.832929 1680728064 status_update_manager.cpp:180] Recovering > status update manager > I1120 15:13:39.833371 1681801216 slave.cpp:497] New master detected at > master@172.25.133.171:52576 > I1120 15:13:39.833273 1681264640 master.cpp:2513] Adding slave > 201311201513-2877626796-52576-3234-0 at vkone.local with cpus(*):4; > mem(*):7168; disk(*):481998; ports(*):[31000-32000] > I1120 15:13:39.833595 1680728064 process_isolator.cpp:317] Recovering isolator > I1120 15:13:39.833859 1681801216 slave.cpp:524] Detecting new master > I1120 15:13:39.833861 1682874368 status_update_manager.cpp:158] New master > detected at master@172.25.133.171:52576 > I1120 15:13:39.834092 1680191488 slave.cpp:542] Registered with master > master@172.25.133.171:52576; given slave ID > 201311201513-2877626796-52576-3234-0 > I1120 15:13:39.834486 1681264640 master.cpp:1266] Attempting to register > slave on vkone.local at slave(2)@172.25.133.171:52576 > I1120 15:13:39.834549 1681264640 master.cpp:2513] Adding slave > 201311201513-2877626796-52576-3234-1 at vkone.local with cpus(*):4; > mem(*):7168; disk(*):481998; ports(*):[31000-32000] > I1120 15:13:39.834750 1680191488 slave.cpp:555] Checkpointing SlaveInfo to > '/tmp/ExamplesTest_JavaFramework_wSc7u8/0/meta/slaves/201311201513-2877626796-52576-3234-0/slave.info' > I1120 15:13:39.834875 1682874368 hierarchical_allocator_process.hpp:445] > Added slave 201311201513-2877626796-52576-3234-0 (vkone.local) with > cpus(*):4; mem(*):7168; disk(*):481998; ports(*):[31000-32000] (and > cpus(*):4; mem(*):7168; disk(*):481998; ports(*):[31000-32000] available) > I1120 15:13:39.835155 1680728064 slave.cpp:542] Registered with master > master@172.25.133.171:52576; given slave ID > 201311201513-2877626796-52576-3234-1 > I1120 15:13:39.835458 1679118336 slave.cpp:2743] Finished recovery > I1120 15:13:39.835739 1680728064 slave.cpp:555] Checkpointing SlaveInfo to > '/tmp/ExamplesTest_JavaFramework_wSc7u8/1/meta/slaves/201311201513-2877626796-52576-3234-1/slave.info' > I1120 15:13:39.835922 1682874368 hierarchical_allocator_process.hpp:445] > Added slave 201311201513-2877626796-52576-3234-1 (vkone.local) with > cpus(*):4; mem(*):7168; disk(*):481998; ports(*):[31000-32000] (and > cpus(*):4; mem(*):7168; disk(*):481998; ports(*):[31000-32000] available) > I1120 15:13:39.836120 1681264640 slave.cpp:497] New master detected at > master@172.25.133.171:52576 > I1120 15:13:39.836340 1679118336 status_update_manager.cpp:158] New master > detected at master@172.25.133.171:52576 > I1120 15:13:39.836436 1681264640 slave.cpp:524] Detecting new master > I1120 15:13:39.836629 1682874368 master.cpp:1266] Attempting to register > slave on vkone.local at slave(3)@172.25.133.171:52576 > I1120 15:13:39.836653 1682874368 master.cpp:2513] Adding slave > 201311201513-2877626796-52576-3234-2 at vkone.local with cpus(*):4; > mem(*):7168; disk(*):481998; ports(*):[31000-32000] > I1120 15:13:39.836804 1680728064 slave.cpp:542] Registered with master > master@172.25.133.171:52576; given slave ID > 201311201513-2877626796-52576-3234-2 > I1120 15:13:39.837190 1680728064 slave.cpp:555] Checkpointing SlaveInfo to > '/tmp/ExamplesTest_JavaFramework_wSc7u8/2/meta/slaves/201311201513-2877626796-52576-3234-2/slave.info' > I1120 15:13:39.837569 1682874368 hierarchical_allocator_process.hpp:445] > Added slave 201311201513-2877626796-52576-3234-2 (vkone.local) with > cpus(*):4; mem(*):7168; disk(*):481998; ports(*):[31000-32000] (and > cpus(*):4; mem(*):7168; disk(*):481998; ports(*):[31000-32000] available) > I1120 15:13:39.852011 1679654912 authenticatee.hpp:124] Creating new client > SASL connection > I1120 15:13:39.852219 1680191488 master.cpp:1734] Authenticating framework at > scheduler(1)@172.25.133.171:52576 > I1120 15:13:39.852577 1682337792 authenticator.hpp:83] Initializing server > SASL > I1120 15:13:39.856160 1682337792 authenticator.hpp:140] Creating new server > SASL connection > I1120 15:13:39.856334 1681264640 authenticatee.hpp:212] Received SASL > authentication mechanisms: CRAM-MD5 > I1120 15:13:39.856360 1681264640 authenticatee.hpp:238] Attempting to > authenticate with mechanism 'CRAM-MD5' > I1120 15:13:39.856421 1681264640 authenticator.hpp:243] Received SASL > authentication start > I1120 15:13:39.856487 1681264640 authenticator.hpp:325] Authentication > requires more steps > I1120 15:13:39.856531 1681264640 authenticatee.hpp:258] Received SASL > authentication step > I1120 15:13:39.856576 1681264640 authenticator.hpp:271] Received SASL > authentication step > I1120 15:13:39.856643 1681264640 authenticator.hpp:317] Authentication success > I1120 15:13:39.856724 1681264640 authenticatee.hpp:298] Authentication success > I1120 15:13:39.856768 1681264640 master.cpp:1774] Successfully authenticated > framework at scheduler(1)@172.25.133.171:52576 > I1120 15:13:39.857028 1681264640 sched.cpp:334] Successfully authenticated > with master master@172.25.133.171:52576 > I1120 15:13:39.857139 1681264640 master.cpp:798] Received registration > request from scheduler(1)@172.25.133.171:52576 > I1120 15:13:39.857306 1681264640 master.cpp:816] Registering framework > 201311201513-2877626796-52576-3234-0000 at scheduler(1)@172.25.133.171:52576 > I1120 15:13:39.862296 1680191488 hierarchical_allocator_process.hpp:332] > Added framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:39.863867 1680191488 master.cpp:1700] Sending 3 offers to > framework 201311201513-2877626796-52576-3234-0000 > Registered! ID = 201311201513-2877626796-52576-3234-0000 > Launching task 0 > Launching task 1 > Launching task 2 > I1120 15:13:39.905390 1680191488 master.cpp:2026] Processing reply for offer > 201311201513-2877626796-52576-3234-0 on slave > 201311201513-2877626796-52576-3234-1 (vkone.local) for framework > 201311201513-2877626796-52576-3234-0000 > I1120 15:13:39.905825 1680191488 master.hpp:400] Adding task 0 with resources > cpus(*):1; mem(*):128 on slave 201311201513-2877626796-52576-3234-1 > (vkone.local) > I1120 15:13:39.905886 1680191488 master.cpp:2150] Launching task 0 of > framework 201311201513-2877626796-52576-3234-0000 with resources cpus(*):1; > mem(*):128 on slave 201311201513-2877626796-52576-3234-1 (vkone.local) > I1120 15:13:39.906422 1680191488 master.cpp:2026] Processing reply for offer > 201311201513-2877626796-52576-3234-1 on slave > 201311201513-2877626796-52576-3234-2 (vkone.local) for framework > 201311201513-2877626796-52576-3234-0000 > I1120 15:13:39.906664 1680191488 master.hpp:400] Adding task 1 with resources > cpus(*):1; mem(*):128 on slave 201311201513-2877626796-52576-3234-2 > (vkone.local) > I1120 15:13:39.906721 1680191488 master.cpp:2150] Launching task 1 of > framework 201311201513-2877626796-52576-3234-0000 with resources cpus(*):1; > mem(*):128 on slave 201311201513-2877626796-52576-3234-2 (vkone.local) > I1120 15:13:39.907171 1680191488 master.cpp:2026] Processing reply for offer > 201311201513-2877626796-52576-3234-2 on slave > 201311201513-2877626796-52576-3234-0 (vkone.local) for framework > 201311201513-2877626796-52576-3234-0000 > I1120 15:13:39.907419 1680191488 master.hpp:400] Adding task 2 with resources > cpus(*):1; mem(*):128 on slave 201311201513-2877626796-52576-3234-0 > (vkone.local) > I1120 15:13:39.907480 1680191488 master.cpp:2150] Launching task 2 of > framework 201311201513-2877626796-52576-3234-0000 with resources cpus(*):1; > mem(*):128 on slave 201311201513-2877626796-52576-3234-0 (vkone.local) > I1120 15:13:39.907938 1680191488 slave.cpp:722] Got assigned task 0 for > framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:39.908473 1680191488 slave.cpp:833] Launching task 0 for > framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:39.914427 1682874368 slave.cpp:722] Got assigned task 1 for > framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:39.914594 1680728064 slave.cpp:722] Got assigned task 2 for > framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:39.914844 1681801216 hierarchical_allocator_process.hpp:590] > Framework 201311201513-2877626796-52576-3234-0000 filtered slave > 201311201513-2877626796-52576-3234-1 for 1secs > I1120 15:13:39.915292 1682874368 slave.cpp:833] Launching task 1 for > framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:39.915424 1681801216 hierarchical_allocator_process.hpp:590] > Framework 201311201513-2877626796-52576-3234-0000 filtered slave > 201311201513-2877626796-52576-3234-2 for 1secs > I1120 15:13:39.915685 1681801216 hierarchical_allocator_process.hpp:590] > Framework 201311201513-2877626796-52576-3234-0000 filtered slave > 201311201513-2877626796-52576-3234-0 for 1secs > I1120 15:13:39.915828 1680728064 slave.cpp:833] Launching task 2 for > framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:39.917840 1680191488 slave.cpp:943] Queuing task '0' for executor > default of framework '201311201513-2877626796-52576-3234-0000 > I1120 15:13:39.917935 1679118336 process_isolator.cpp:100] Launching default > (/Users/vinod/workspace/apache/mesos/build/src/examples/java/test-executor) > in > /tmp/ExamplesTest_JavaFramework_wSc7u8/1/slaves/201311201513-2877626796-52576-3234-1/frameworks/201311201513-2877626796-52576-3234-0000/executors/default/runs/375b31a9-7093-4db1-964d-e6b425b1e4b4 > with resources ' for framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:39.922019 1679118336 process_isolator.cpp:163] Forked executor at > 3268 > I1120 15:13:39.922703 1679118336 slave.cpp:2073] Monitoring executor default > of framework 201311201513-2877626796-52576-3234-0000 forked at pid 3268 > I1120 15:13:39.929134 1682874368 slave.cpp:943] Queuing task '1' for executor > default of framework '201311201513-2877626796-52576-3234-0000 > I1120 15:13:39.929323 1682874368 process_isolator.cpp:100] Launching default > (/Users/vinod/workspace/apache/mesos/build/src/examples/java/test-executor) > in > /tmp/ExamplesTest_JavaFramework_wSc7u8/2/slaves/201311201513-2877626796-52576-3234-2/frameworks/201311201513-2877626796-52576-3234-0000/executors/default/runs/2bd0e75d-a2b9-4ae6-be08-9782612309a5 > with resources ' for framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:39.931243 1682874368 process_isolator.cpp:163] Forked executor at > 3269 > I1120 15:13:39.931612 1681801216 slave.cpp:2073] Monitoring executor default > of framework 201311201513-2877626796-52576-3234-0000 forked at pid 3269 > E1120 15:13:39.931836 1681801216 slave.cpp:2099] Failed to watch executor > default of framework 201311201513-2877626796-52576-3234-0000: Already watched > I1120 15:13:39.936460 1680728064 slave.cpp:943] Queuing task '2' for executor > default of framework '201311201513-2877626796-52576-3234-0000 > I1120 15:13:39.936619 1681801216 process_isolator.cpp:100] Launching default > (/Users/vinod/workspace/apache/mesos/build/src/examples/java/test-executor) > in > /tmp/ExamplesTest_JavaFramework_wSc7u8/0/slaves/201311201513-2877626796-52576-3234-0/frameworks/201311201513-2877626796-52576-3234-0000/executors/default/runs/16d600da-da86-4614-91cb-58a7b27ab534 > with resources ' for framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:39.941299 1681801216 process_isolator.cpp:163] Forked executor at > 3270 > I1120 15:13:39.942179 1681801216 slave.cpp:2073] Monitoring executor default > of framework 201311201513-2877626796-52576-3234-0000 forked at pid 3270 > E1120 15:13:39.942395 1681801216 slave.cpp:2099] Failed to watch executor > default of framework 201311201513-2877626796-52576-3234-0000: Already watched > Fetching resources into > '/tmp/ExamplesTest_JavaFramework_wSc7u8/2/slaves/201311201513-2877626796-52576-3234-2/frameworks/201311201513-2877626796-52576-3234-0000/executors/default/runs/2bd0e75d-a2b9-4ae6-be08-9782612309a5' > Fetching resources into > '/tmp/ExamplesTest_JavaFramework_wSc7u8/1/slaves/201311201513-2877626796-52576-3234-1/frameworks/201311201513-2877626796-52576-3234-0000/executors/default/runs/375b31a9-7093-4db1-964d-e6b425b1e4b4' > Fetching resources into > '/tmp/ExamplesTest_JavaFramework_wSc7u8/0/slaves/201311201513-2877626796-52576-3234-0/frameworks/201311201513-2877626796-52576-3234-0000/executors/default/runs/16d600da-da86-4614-91cb-58a7b27ab534' > I1120 15:13:40.372573 1681801216 slave.cpp:1406] Got registration for > executor 'default' of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.373258 1681801216 slave.cpp:1527] Flushing queued task 1 for > executor 'default' of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.388317 1681801216 slave.cpp:1406] Got registration for > executor 'default' of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.388983 1681801216 slave.cpp:1527] Flushing queued task 0 for > executor 'default' of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.398084 1679654912 slave.cpp:1406] Got registration for > executor 'default' of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.399344 1679654912 slave.cpp:1527] Flushing queued task 2 for > executor 'default' of framework 201311201513-2877626796-52576-3234-0000 > Registered executor on vkone.local > I1120 15:13:40.491843 1679654912 slave.cpp:1740] Handling status update > TASK_RUNNING (UUID: f04b1852-3669-444a-906f-3675f784c14f) for task 1 of > framework 201311201513-2877626796-52576-3234-0000 from > executor(1)@172.25.133.171:52577 > I1120 15:13:40.492202 1679654912 status_update_manager.cpp:305] Received > status update TASK_RUNNING (UUID: f04b1852-3669-444a-906f-3675f784c14f) for > task 1 of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.492424 1679654912 status_update_manager.cpp:356] Forwarding > status update TASK_RUNNING (UUID: f04b1852-3669-444a-906f-3675f784c14f) for > task 1 of framework 201311201513-2877626796-52576-3234-0000 to > master@172.25.133.171:52576 > Registered executor on vkone.local > I1120 15:13:40.492671 1682337792 master.cpp:1452] Status update TASK_RUNNING > (UUID: f04b1852-3669-444a-906f-3675f784c14f) for task 1 of framework > 201311201513-2877626796-52576-3234-0000 from slave(3)@172.25.133.171:52576 > I1120 15:13:40.492735 1682337792 slave.cpp:1865] Sending acknowledgement for > status update TASK_RUNNING (UUID: f04b1852-3669-444a-906f-3675f784c14f) for > task 1 of framework 201311201513-2877626796-52576-3234-0000 to > executor(1)@172.25.133.171:52577 > Status update: task 1 is in state TASK_RUNNING > I1120 15:13:40.502235 1679654912 status_update_manager.cpp:380] Received > status update acknowledgement (UUID: f04b1852-3669-444a-906f-3675f784c14f) > for task 1 of framework 201311201513-2877626796-52576-3234-0000 > Registered executor on vkone.local > I1120 15:13:40.531292 1679654912 slave.cpp:1740] Handling status update > TASK_RUNNING (UUID: c19b6a5a-19ce-4613-8a5a-08fe807ff27c) for task 2 of > framework 201311201513-2877626796-52576-3234-0000 from > executor(1)@172.25.133.171:52579 > I1120 15:13:40.532091 1680728064 status_update_manager.cpp:305] Received > status update TASK_RUNNING (UUID: c19b6a5a-19ce-4613-8a5a-08fe807ff27c) for > task 2 of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.532305 1680728064 status_update_manager.cpp:356] Forwarding > status update TASK_RUNNING (UUID: c19b6a5a-19ce-4613-8a5a-08fe807ff27c) for > task 2 of framework 201311201513-2877626796-52576-3234-0000 to > master@172.25.133.171:52576 > I1120 15:13:40.532776 1682874368 slave.cpp:1865] Sending acknowledgement for > status update TASK_RUNNING (UUID: c19b6a5a-19ce-4613-8a5a-08fe807ff27c) for > task 2 of framework 201311201513-2877626796-52576-3234-0000 to > executor(1)@172.25.133.171:52579 > I1120 15:13:40.532951 1681801216 master.cpp:1452] Status update TASK_RUNNING > (UUID: c19b6a5a-19ce-4613-8a5a-08fe807ff27c) for task 2 of framework > 201311201513-2877626796-52576-3234-0000 from slave(1)@172.25.133.171:52576 > Status update: task 2 is in state TASK_RUNNING > I1120 15:13:40.538895 1682874368 status_update_manager.cpp:380] Received > status update acknowledgement (UUID: c19b6a5a-19ce-4613-8a5a-08fe807ff27c) > for task 2 of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.541267 1682874368 slave.cpp:1740] Handling status update > TASK_RUNNING (UUID: c218b0c3-d77c-4901-8570-391c330ba117) for task 0 of > framework 201311201513-2877626796-52576-3234-0000 from > executor(1)@172.25.133.171:52578 > I1120 15:13:40.541555 1682874368 status_update_manager.cpp:305] Received > status update TASK_RUNNING (UUID: c218b0c3-d77c-4901-8570-391c330ba117) for > task 0 of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.541725 1682874368 status_update_manager.cpp:356] Forwarding > status update TASK_RUNNING (UUID: c218b0c3-d77c-4901-8570-391c330ba117) for > task 0 of framework 201311201513-2877626796-52576-3234-0000 to > master@172.25.133.171:52576 > I1120 15:13:40.542196 1682874368 master.cpp:1452] Status update TASK_RUNNING > (UUID: c218b0c3-d77c-4901-8570-391c330ba117) for task 0 of framework > 201311201513-2877626796-52576-3234-0000 from slave(2)@172.25.133.171:52576 > I1120 15:13:40.542251 1682874368 slave.cpp:1865] Sending acknowledgement for > status update TASK_RUNNING (UUID: c218b0c3-d77c-4901-8570-391c330ba117) for > task 0 of framework 201311201513-2877626796-52576-3234-0000 to > executor(1)@172.25.133.171:52578 > Status update: task 0 is in state TASK_RUNNING > I1120 15:13:40.545537 1682874368 status_update_manager.cpp:380] Received > status update acknowledgement (UUID: c218b0c3-d77c-4901-8570-391c330ba117) > for task 0 of framework 201311201513-2877626796-52576-3234-0000 > Running task value: "1" > I1120 15:13:40.764219 1682337792 slave.cpp:1740] Handling status update > TASK_FINISHED (UUID: 4a163594-146a-46f7-bd43-f906e76ad84c) for task 1 of > framework 201311201513-2877626796-52576-3234-0000 from > executor(1)@172.25.133.171:52577 > I1120 15:13:40.764629 1682337792 status_update_manager.cpp:305] Received > status update TASK_FINISHED (UUID: 4a163594-146a-46f7-bd43-f906e76ad84c) for > task 1 of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.764698 1682337792 status_update_manager.cpp:356] Forwarding > status update TASK_FINISHED (UUID: 4a163594-146a-46f7-bd43-f906e76ad84c) for > task 1 of framework 201311201513-2877626796-52576-3234-0000 to > master@172.25.133.171:52576 > I1120 15:13:40.765043 1682337792 master.cpp:1452] Status update TASK_FINISHED > (UUID: 4a163594-146a-46f7-bd43-f906e76ad84c) for task 1 of framework > 201311201513-2877626796-52576-3234-0000 from slave(3)@172.25.133.171:52576 > I1120 15:13:40.765192 1682337792 master.hpp:418] Removing task 1 with > resources cpus(*):1; mem(*):128 on slave 2Status update: task 1 is in state > TASK_FINISHED > Finished tasks: 1 > 01311201513-2877626796-52576-3234-2 (vkone.local) > I1120 15:13:40.765363 1679118336 slave.cpp:1865] Sending acknowledgement for > status update TASK_FINISHED (UUID: 4a163594-146a-46f7-bd43-f906e76ad84c) for > task 1 of framework 201311201513-2877626796-52576-3234-0000 to > executor(1)@172.25.133.171:52577 > I1120 15:13:40.772738 1682337792 hierarchical_allocator_process.hpp:637] > Recovered cpus(*):1; mem(*):128 (total allocatable: cpus(*):4; mem(*):7168; > disk(*):481998; ports(*):[31000-32000]) on slave > 201311201513-2877626796-52576-3234-2 from framework > 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.773190 1679118336 status_update_manager.cpp:380] Received > status update acknowledgement (UUID: 4a163594-146a-46f7-bd43-f906e76ad84c) > for task 1 of framework 201311201513-2877626796-52576-3234-0000 > Running task value: "0" > Running task value: "2" > I1120 15:13:40.790068 1679118336 slave.cpp:1740] Handling status update > TASK_FINISHED (UUID: 13265a94-50f1-4bc4-b2e2-9f60a1bb4086) for task 0 of > framework 201311201513-2877626796-52576-3234-0000 from > executor(1)@172.25.133.171:52578 > I1120 15:13:40.790411 1680728064 status_update_manager.cpp:305] Received > status update TASK_FINISHED (UUID: 13265a94-50f1-4bc4-b2e2-9f60a1bb4086) for > task 0 of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.790493 1680728064 status_update_manager.cpp:356] Forwarding > status update TASK_FINISHED (UUID: 13265a94-50f1-4bc4-b2e2-9f60a1bb4086) for > task 0 of framework 201311201513-2877626796-52576-3234-0000 to > master@172.25.133.171:52576 > I1120 15:13:40.790674 1679118336 master.cpp:1452] Status update TASK_FINISHED > (UUID: 13265a94-50f1-4bc4-b2e2-9f60a1bb4086) for task 0 of framework > 201311201513-2877626796-52576-3234-0000 from slave(2)@172.25.133.171:52576 > I1120 15:13:40.790798 1679118336 master.hpp:418] Removing task 0 with > resources cpus(*):1; mem(*):128 on slave 201311201513-2877626796-52576-3234-1 > (vkone.local) > I1120 15:13:40.790928 1679118336 slave.cpp:1865] Sending acknowledgement for > status update TASK_FINISHED (UUID: 13265a94-50f1-4bc4-b2e2-9f60a1bb4086) for > task 0 of framework 201311201513-2877626796-52576-3234-0000 to > executor(1)@172.25.133.171:52578 > Status update: task 0 is in state TASK_FINISHED > Finished tasks: 2 > I1120 15:13:40.791225 1680191488 hierarchical_allocator_process.hpp:637] > Recovered cpus(*):1; mem(*):128 (total allocatable: cpus(*):4; mem(*):7168; > disk(*):481998; ports(*):[31000-32000]) on slave > 201311201513-2877626796-52576-3234-1 from framework > 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.794234 1679118336 status_update_manager.cpp:380] Received > status update acknowledgement (UUID: 13265a94-50f1-4bc4-b2e2-9f60a1bb4086) > for task 0 of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.795830 1681801216 slave.cpp:1740] Handling status update > TASK_FINISHED (UUID: f6f28e88-5ea6-4519-ba92-65ead6236fff) for task 2 of > framework 201311201513-2877626796-52576-3234-0000 from > executor(1)@172.25.133.171:52579 > I1120 15:13:40.796111 1679118336 status_update_manager.cpp:305] Received > status update TASK_FINISHED (UUID: f6f28e88-5ea6-4519-ba92-65ead6236fff) for > task 2 of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.796182 1679118336 status_update_manager.cpp:356] Forwarding > status update TASK_FINISHED (UUID: f6f28e88-5ea6-4519-ba92-65ead6236fff) for > task 2 of framework 201311201513-2877626796-52576-3234-0000 to > master@172.25.133.171:52576 > I1120 15:13:40.796352 1680728064 master.cpp:1452] Status update TASK_FINISHED > (UUID: f6f28e88-5ea6-4519-ba92-65ead6236fff) for task 2 of framework > 201311201513-2877626796-52576-3234-0000 from slave(1)@172.25.133.171:52576 > I1120 15:13:40.796398 1679118336 slave.cpp:1865] Sending acknowledgement for > status update TASK_FINISHED (UUID: f6f28e88-5ea6-4519-ba92-65ead6236fff) for > task 2 of framework 201311201513-2877626796-52576-3234-0000 to > executor(1)@172.25.133.171:52579 > I1120 15:13:40.796466 1680728064 master.hpp:418] Removing task 2 with > resources cpus(*):1; mem(*):128 on slave 201311201513-2877626796-52576-3234-0 > (vkone.local) > I1120 15:13:40.796707 1679118336 hierarchical_allocator_process.hpp:637] > Recovered cpus(*):1; mem(*):128 (total allocatable: cpus(*):4; mem(*):7168; > disk(*):481998; ports(*):[31000-32000]) on slave > 201311201513-2877626796-52576-3234-0 from framework > 201311201513-2877626796-52576-3234-0000 > Status update: task 2 is in state TASK_FINISHED > Finished tasks: 3 > I1120 15:13:40.797384 1680728064 status_update_manager.cpp:380] Received > status update acknowledgement (UUID: f6f28e88-5ea6-4519-ba92-65ead6236fff) > for task 2 of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.824383 1681801216 master.cpp:1700] Sending 3 offers to > framework 201311201513-2877626796-52576-3234-0000 > Launching task 3 > Launching task 4 > I1120 15:13:40.826971 1679118336 master.cpp:2026] Processing reply for offer > 201311201513-2877626796-52576-3234-3 on slave > 201311201513-2877626796-52576-3234-1 (vkone.local) for framework > 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.827268 1679118336 master.hpp:400] Adding task 3 with resources > cpus(*):1; mem(*):128 on slave 201311201513-2877626796-52576-3234-1 > (vkone.local) > I1120 15:13:40.827348 1679118336 master.cpp:2150] Launching task 3 of > framework 201311201513-2877626796-52576-3234-0000 with resources cpus(*):1; > mem(*):128 on slave 201311201513-2877626796-52576-3234-1 (vkone.local) > I1120 15:13:40.827487 1680728064 slave.cpp:722] Got assigned task 3 for > framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.827857 1680728064 slave.cpp:833] Launching task 3 for > framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.827913 1679118336 master.cpp:2026] Processing reply for offer > 201311201513-2877626796-52576-3234-4 on slave > 201311201513-2877626796-52576-3234-2 (vkone.local) for framework > 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.827986 1680728064 slave.cpp:968] Sending task '3' to executor > 'default' of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.828126 1679118336 master.hpp:400] Adding task 4 with resources > cpus(*):1; mem(*):128 on slave 201311201513-2877626796-52576-3234-2 > (vkone.local) > I1120 15:13:40.828187 1679118336 master.cpp:2150] Launching task 4 of > framework 201311201513-2877626796-52576-3234-0000 with resources cpus(*):1; > mem(*):128 on slave 201311201513-2877626796-52576-3234-2 (vkone.local) > I1120 15:13:40.828632 1679118336 master.cpp:2026] Processing reply for offer > 201311201513-2877626796-52576-3234-5 on slave > 201311201513-2877626796-52576-3234-0 (vkone.local) for framework > 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.828655 1680728064 hierarchical_allocator_process.hpp:590] > Framework 201311201513-2877626796-52576-3234-0000 filtered slave > 201311201513-2877626796-52576-3234-1 for 1secs > I1120 15:13:40.829005 1679118336 slave.cpp:722] Got assigned task 4 for > framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.829027 1680728064 hierarchical_allocator_process.hpp:590] > Framework 201311201513-2877626796-52576-3234-0000 filtered slave > 201311201513-2877626796-52576-3234-2 for 1secs > I1120 15:13:40.829260 1679118336 slave.cpp:833] Launching task 4 for > framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.829273 1680728064 hierarchical_allocator_process.hpp:590] > Framework 201311201513-2877626796-52576-3234-0000 filtered slave > 201311201513-2877626796-52576-3234-0 for 1secs > I1120 15:13:40.829390 1679118336 slave.cpp:968] Sending task '4' to executor > 'default' of framework 201311201513-2877626796-52576-3234-0000 > Running task value: "3" > Running task value: "4" > I1120 15:13:40.839279 1682337792 slave.cpp:1740] Handling status update > TASK_RUNNING (UUID: a8d02ae6-3138-441c-a004-465d879b1277) for task 3 of > framework 201311201513-2877626796-52576-3234-0000 from > executor(1)@172.25.133.171:52578 > I1120 15:13:40.839534 1679118336 status_update_manager.cpp:305] Received > status update TASK_RUNNING (UUID: a8d02ae6-3138-441c-a004-465d879b1277) for > task 3 of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.839705 1679118336 status_update_manager.cpp:356] Forwarding > status update TASK_RUNNING (UUID: a8d02ae6-3138-441c-a004-465d879b1277) for > task 3 of framework 201311201513-2877626796-52576-3234-0000 to > master@172.25.133.171:52576 > I1120 15:13:40.839944 1682337792 master.cpp:1452] Status update TASK_RUNNING > (UUID: a8d02ae6-3138-441c-a004-465d879b1277) for task 3 of framework > 201311201513-2877626796-52576-3234-0000 from slave(2)@172.25.133.171:52576 > Status update: task 3 is in state TASK_RUNNING > I1120 15:13:40.839947 1679118336 slave.cpp:1865] Sending acknowledgement for > status update TASK_RUNNING (UUID: a8d02ae6-3138-441c-a004-465d879b1277) for > task 3 of framework 201311201513-2877626796-52576-3234-0000 to > executor(1)@172.25.133.171:52578 > I1120 15:13:40.856334 1679118336 slave.cpp:1740] Handling status update > TASK_FINISHED (UUID: 3fc45cb8-fd7f-4bed-a21d-76f234af6b36) for task 3 of > framework 201311201513-2877626796-52576-3234-0000 from > executor(1)@172.25.133.171:52578 > I1120 15:13:40.856650 1679118336 status_update_manager.cpp:380] Received > status update acknowledgement (UUID: a8d02ae6-3138-441c-a004-465d879b1277) > for task 3 of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.856818 1679118336 status_update_manager.cpp:305] Received > status update TASK_FINISHED (UUID: 3fc45cb8-fd7f-4bed-a21d-76f234af6b36) for > task 3 of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.856875 1679118336 status_update_manager.cpp:356] Forwarding > status update TASK_FINISHED (UUID: 3fc45cb8-fd7f-4bed-a21d-76f234af6b36) for > task 3 of framework 201311201513-2877626796-52576-3234-0000 to > master@172.25.133.171:52576 > I1120 15:13:40.857105 1679118336 slave.cpp:1740] Handling status update > TASK_RUNNING (UUID: 4f97c8df-1cc0-4eeb-8469-9d72df09ec73) for task 4 of > framework 201311201513-2877626796-52576-3234-0000 from > executor(1)@172.25.133.171:52577 > I1120 15:13:40.857369 1679118336 slave.cpp:1865] Sending acknowledgement for > status update TASK_FINISHED (UUID: 3fc45cb8-fd7f-4bed-a21d-76f234af6b36) for > task 3 of framework 201311201513-2877626796-52576-3234-0000 to > executor(1)@172.25.133.171:52578 > I1120 15:13:40.857498 1680728064 status_update_manager.cpp:305] Received > status update TASK_RUNNING (UUID: 4f97c8df-1cc0-4eeb-8469-9d72df09ec73) for > task 4 of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.857518 1682337792 master.cpp:1452] Status update TASK_FINISHED > (UUID: 3fc45cb8-fd7f-4bed-a21d-76f234af6b36) for task 3 of framework > 201311201513-2877626796-52576-3234-0000 from slave(2)@172.25.133.171:52576 > I1120 15:13:40.857635 1680728064 status_update_manager.cpp:356] Forwarding > status update TASK_RUNNING (UUID: 4f97c8df-1cc0-4eeb-8469-9d72df09ec73) for > task 4 of framework 201311201513-2877626796-52576-3234-0000 to > master@172.25.133.171:52576 > I1120 15:13:40.857630 1682337792 master.hpp:418] Removing task 3 with > resources cpus(*):1; mem(*):128 on slave 201311201513-2877626796-52576-3234-1 > (vkone.local) > I1120 15:13:40.857843 1682337792 master.cpp:1452] Status update TASK_RUNNING > (UUID: 4f97c8df-1cc0-4eeb-8469-9d72df09ec73) for task 4 of framework > 201311201513-2877626796-52576-3234-0000 from slave(3)@172.25.133.171:52576 > I1120 15:13:40.858043 1680728064 hierarchical_allocator_process.hpp:637] > Recovered cpus(*):1; mem(*):128 (total allocatable: cpus(*):4; mem(*):7168; > disk(*):481998; ports(*):[31000-32000]) on slave > 201311201513-2877626796-52576-3234-1 from framework > 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.858098 1680728064 slave.cpp:1865] Sending acknowledgement for > status update TASK_RUNNING (UUID: 4f97c8df-1cc0-4eeb-8469-9d72df09ec73) for > task 4 of framework 201311201513-2877626796-52576-3234-0000 to > executor(1)@172.25.133.171:52577 > Status update: task 3 is in state TASK_FINISHED > Finished tasks: 4 > Status update: task 4 is in state TASK_RUNNING > I1120 15:13:40.858896 1682337792 status_update_manager.cpp:380] Received > status update acknowledgement (UUID: 3fc45cb8-fd7f-4bed-a21d-76f234af6b36) > for task 3 of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.858957 1680728064 status_update_manager.cpp:380] Received > status update acknowledgement (UUID: 4f97c8df-1cc0-4eeb-8469-9d72df09ec73) > for task 4 of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.859905 1679654912 slave.cpp:1740] Handling status update > TASK_FINISHED (UUID: 876d7ddc-5d58-48df-a590-d82cf39d4978) for task 4 of > framework 201311201513-2877626796-52576-3234-0000 from > executor(1)@172.25.133.171:52577 > I1120 15:13:40.860174 1680728064 status_update_manager.cpp:305] Received > status update TASK_FINISHED (UUID: 876d7ddc-5d58-48df-a590-d82cf39d4978) for > task 4 of framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.860245 1680728064 status_update_manager.cpp:356] Forwarding > status update TASK_FINISHED (UUID: 876d7ddc-5d58-48df-a590-d82cf39d4978) for > task 4 of framework 201311201513-2877626796-52576-3234-0000 to > master@172.25.133.171:52576 > I1120 15:13:40.860437 1679654912 master.cpp:1452] Status update TASK_FINISHED > (UUID: 876d7ddc-5d58-48df-a590-d82cf39d4978) for task 4 of framework > 201311201513-2877626796-52576-3234-0000 from slave(3)@172.25.133.171:52576 > I1120 15:13:40.860486 1680728064 slave.cpp:1865] Sending acknowledgement for > status update TASK_FINISHED (UUID: 876d7ddc-5d58-48df-a590-d82cf39d4978) for > task 4 of framework 201311201513-2877626796-52576-3234-0000 to > executor(1)@172.25.133.171:52577 > I1120 15:13:40.860550 1679654912 master.hpp:418] Removing task 4 with > resources cpus(*):1; mem(Status update: task 4 is in state TASK_FINISHED > Finished tasks: 5 > *):128 on slave 201311201513-2877626796-52576-3234-2 (vkone.local) > I1120 15:13:40.863689 1679654912 master.cpp:996] Asked to unregister > framework 201311201513-2877626796-52576-3234-0000 > I1120 15:13:40.863750 1679654912 master.cpp:2385] Removing framework > 201311201513-2877626796-52576-3234-0000 > ../../src/tests/script.cpp:81: Failure > Failed > java_framework_test.sh terminated with signal 'Abort trap: 6' > [ FAILED ] ExamplesTest.JavaFramework (2688 ms) > [----------] 1 test from ExamplesTest (2688 ms total) > [----------] Global test environment tear-down > [==========] 1 test from 1 test case ran. (2692 ms total) > [ PASSED ] 0 tests. > [ FAILED ] 1 test, listed below: > [ FAILED ] ExamplesTest.JavaFramework -- This message was sent by Atlassian JIRA (v6.3.4#6332)