See <https://builds.apache.org/job/Mesos-Trunk-Ubuntu-Build-In-Src-Set-JAVA_HOME/1506/changes>
Changes: [vinod] Reduced the minimum number of cpus per offer to 0.1. [vinod] Fixed status update manager to backoff on status update retries. ------------------------------------------ [...truncated 8873 lines...] I1126 19:34:52.196486 11219 slave.cpp:542] Registered with master [email protected]:48458; given slave ID 201311261934-1032504131-48458-11197-0 I1126 19:34:52.196410 11221 hierarchical_allocator_process.hpp:688] Performed allocation for 0 slaves in 6159ns I1126 19:34:52.196641 11219 sched.cpp:201] Scheduler::disconnected took 27014ns I1126 19:34:52.196652 11219 sched.cpp:207] New master detected at [email protected]:48458 I1126 19:34:52.196663 11219 sched.cpp:260] Authenticating with master [email protected]:48458 I1126 19:34:52.196718 11219 sched.cpp:229] Detecting new master I1126 19:34:52.196743 11222 authenticatee.hpp:124] Creating new client SASL connection I1126 19:34:52.196775 11221 hierarchical_allocator_process.hpp:445] Added slave 201311261934-1032504131-48458-11197-0 (juno.apache.org) with cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] (and cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] available) I1126 19:34:52.196836 11221 hierarchical_allocator_process.hpp:752] Offering cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] on slave 201311261934-1032504131-48458-11197-0 to framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.196867 11222 master.cpp:1050] Deactivating framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.196888 11222 master.cpp:1840] Authenticating framework at scheduler(49)@67.195.138.61:48458 I1126 19:34:52.196955 11219 authenticator.hpp:140] Creating new server SASL connection I1126 19:34:52.196964 11221 hierarchical_allocator_process.hpp:708] Performed allocation for slave 201311261934-1032504131-48458-11197-0 in 154416ns W1126 19:34:52.196979 11222 master.cpp:1729] Master returning resources offered to framework 201311261934-1032504131-48458-11197-0000 because the framework has terminated or is inactive I1126 19:34:52.197000 11221 hierarchical_allocator_process.hpp:408] Deactivated framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.197095 11222 authenticatee.hpp:212] Received SASL authentication mechanisms: CRAM-MD5 I1126 19:34:52.197132 11222 authenticatee.hpp:238] Attempting to authenticate with mechanism 'CRAM-MD5' I1126 19:34:52.197170 11222 authenticator.hpp:243] Received SASL authentication start I1126 19:34:52.197162 11219 hierarchical_allocator_process.hpp:637] Recovered cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] (total allocatable: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000]) on slave 201311261934-1032504131-48458-11197-0 from framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.197216 11222 authenticator.hpp:325] Authentication requires more steps I1126 19:34:52.197249 11222 authenticatee.hpp:258] Received SASL authentication step I1126 19:34:52.197286 11222 authenticator.hpp:271] Received SASL authentication step I1126 19:34:52.197304 11222 auxprop.cpp:81] Request to lookup properties for user: 'test-principal' realm: 'juno.apache.org' server FQDN: 'juno.apache.org' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false I1126 19:34:52.197314 11222 auxprop.cpp:153] Looking up auxiliary property '*userPassword' I1126 19:34:52.197326 11222 auxprop.cpp:153] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' I1126 19:34:52.197337 11222 auxprop.cpp:81] Request to lookup properties for user: 'test-principal' realm: 'juno.apache.org' server FQDN: 'juno.apache.org' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true I1126 19:34:52.197345 11222 auxprop.cpp:103] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true I1126 19:34:52.197351 11222 auxprop.cpp:103] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true I1126 19:34:52.197362 11222 authenticator.hpp:317] Authentication success I1126 19:34:52.197407 11218 authenticatee.hpp:298] Authentication success I1126 19:34:52.197418 11222 master.cpp:1880] Successfully authenticated framework at scheduler(49)@67.195.138.61:48458 I1126 19:34:52.197487 11218 sched.cpp:334] Successfully authenticated with master [email protected]:48458 I1126 19:34:52.197536 11218 master.cpp:887] Re-registering framework 201311261934-1032504131-48458-11197-0000 at scheduler(49)@67.195.138.61:48458 I1126 19:34:52.197551 11218 master.cpp:925] Allowing the Framework 201311261934-1032504131-48458-11197-0000 to re-register with an already used id I1126 19:34:52.197587 11218 sched.cpp:424] Framework re-registered with 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.197608 11218 sched.cpp:438] Scheduler::reregistered took 12999ns I1126 19:34:52.197708 11222 sched.cpp:719] Stopping framework '201311261934-1032504131-48458-11197-0000' I1126 19:34:52.197716 11223 master.cpp:554] Master terminating I1126 19:34:52.197767 11223 slave.cpp:1945] [email protected]:48458 exited W1126 19:34:52.197782 11223 slave.cpp:1948] Master disconnected! Waiting for a new master to be elected I1126 19:34:52.197808 11197 master.cpp:210] Shutting down master I1126 19:34:52.197854 11197 master.cpp:253] Removing slave 201311261934-1032504131-48458-11197-0 (juno.apache.org) I1126 19:34:52.305867 11221 slave.cpp:391] Slave terminating [ OK ] FaultToleranceTest.FrameworkReregister (113 ms) [ RUN ] FaultToleranceTest.TaskLost I1126 19:34:52.329187 11219 master.cpp:285] Master started on 67.195.138.61:48458 I1126 19:34:52.329216 11219 master.cpp:299] Master ID: 201311261934-1032504131-48458-11197 I1126 19:34:52.329223 11219 master.cpp:302] Master only allowing authenticated frameworks to register! I1126 19:34:52.329504 11223 master.cpp:85] No whitelist given. Advertising offers for all slaves I1126 19:34:52.329525 11216 hierarchical_allocator_process.hpp:302] Initializing hierarchical allocator process with master : [email protected]:48458 I1126 19:34:52.329824 11221 master.cpp:744] The newly elected leader is [email protected]:48458 I1126 19:34:52.329840 11221 master.cpp:748] Elected as the leading master! I1126 19:34:52.352182 11217 slave.cpp:112] Slave started on 35)@67.195.138.61:48458 I1126 19:34:52.352303 11217 slave.cpp:212] Slave resources: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] I1126 19:34:52.352463 11216 sched.cpp:207] New master detected at [email protected]:48458 I1126 19:34:52.352480 11216 sched.cpp:260] Authenticating with master [email protected]:48458 I1126 19:34:52.352511 11216 sched.cpp:229] Detecting new master I1126 19:34:52.352545 11216 authenticatee.hpp:124] Creating new client SASL connection I1126 19:34:52.352728 11216 master.cpp:1840] Authenticating framework at scheduler(50)@67.195.138.61:48458 I1126 19:34:52.352870 11216 authenticator.hpp:140] Creating new server SASL connection I1126 19:34:52.352970 11223 state.cpp:33] Recovering state from '/tmp/FaultToleranceTest_TaskLost_EXWgoM/meta' I1126 19:34:52.353082 11222 status_update_manager.cpp:186] Recovering status update manager I1126 19:34:52.353147 11221 authenticatee.hpp:212] Received SASL authentication mechanisms: CRAM-MD5 I1126 19:34:52.353166 11221 authenticatee.hpp:238] Attempting to authenticate with mechanism 'CRAM-MD5' I1126 19:34:52.353265 11218 authenticator.hpp:243] Received SASL authentication start I1126 19:34:52.353272 11222 slave.cpp:2748] Finished recovery I1126 19:34:52.353307 11218 authenticator.hpp:325] Authentication requires more steps I1126 19:34:52.353353 11218 authenticatee.hpp:258] Received SASL authentication step I1126 19:34:52.353368 11216 slave.cpp:497] New master detected at [email protected]:48458 I1126 19:34:52.353394 11218 authenticator.hpp:271] Received SASL authentication step I1126 19:34:52.353411 11222 status_update_manager.cpp:160] New master detected at [email protected]:48458 I1126 19:34:52.353420 11216 slave.cpp:524] Detecting new master I1126 19:34:52.353479 11221 master.cpp:1364] Attempting to register slave on juno.apache.org at slave(35)@67.195.138.61:48458 I1126 19:34:52.353498 11221 master.cpp:2619] Adding slave 201311261934-1032504131-48458-11197-0 at juno.apache.org with cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] I1126 19:34:52.353562 11216 slave.cpp:542] Registered with master [email protected]:48458; given slave ID 201311261934-1032504131-48458-11197-0 I1126 19:34:52.353415 11218 auxprop.cpp:81] Request to lookup properties for user: 'test-principal' realm: 'juno.apache.org' server FQDN: 'juno.apache.org' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false I1126 19:34:52.353631 11218 auxprop.cpp:153] Looking up auxiliary property '*userPassword' I1126 19:34:52.353643 11218 auxprop.cpp:153] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' I1126 19:34:52.353657 11218 auxprop.cpp:81] Request to lookup properties for user: 'test-principal' realm: 'juno.apache.org' server FQDN: 'juno.apache.org' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true I1126 19:34:52.353665 11218 auxprop.cpp:103] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true I1126 19:34:52.353672 11218 auxprop.cpp:103] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true I1126 19:34:52.353659 11216 hierarchical_allocator_process.hpp:445] Added slave 201311261934-1032504131-48458-11197-0 (juno.apache.org) with cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] (and cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] available) I1126 19:34:52.353683 11218 authenticator.hpp:317] Authentication success I1126 19:34:52.353689 11216 hierarchical_allocator_process.hpp:708] Performed allocation for slave 201311261934-1032504131-48458-11197-0 in 4269ns I1126 19:34:52.353751 11216 master.cpp:1880] Successfully authenticated framework at scheduler(50)@67.195.138.61:48458 I1126 19:34:52.353768 11217 authenticatee.hpp:298] Authentication success I1126 19:34:52.353835 11217 sched.cpp:334] Successfully authenticated with master [email protected]:48458 I1126 19:34:52.353905 11216 master.cpp:799] Received registration request from scheduler(50)@67.195.138.61:48458 I1126 19:34:52.354027 11216 master.cpp:817] Registering framework 201311261934-1032504131-48458-11197-0000 at scheduler(50)@67.195.138.61:48458 I1126 19:34:52.354101 11217 sched.cpp:383] Framework registered with 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.354120 11216 hierarchical_allocator_process.hpp:332] Added framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.354123 11217 sched.cpp:397] Scheduler::registered took 9302ns I1126 19:34:52.354166 11216 hierarchical_allocator_process.hpp:752] Offering cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] on slave 201311261934-1032504131-48458-11197-0 to framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.354280 11216 hierarchical_allocator_process.hpp:688] Performed allocation for 1 slaves in 142743ns I1126 19:34:52.354326 11223 master.hpp:432] Adding offer 201311261934-1032504131-48458-11197-0 with resources cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] on slave 201311261934-1032504131-48458-11197-0 (juno.apache.org) I1126 19:34:52.354369 11223 master.cpp:1801] Sending 1 offers to framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.354493 11219 sched.cpp:517] Scheduler::resourceOffers took 23738ns I1126 19:34:52.354720 11223 sched.cpp:201] Scheduler::disconnected took 13544ns I1126 19:34:52.354735 11223 sched.cpp:223] No master detected I1126 19:34:52.354740 11223 sched.cpp:229] Detecting new master I1126 19:34:52.354904 11223 sched.cpp:797] Ignoring launch tasks message as master is disconnected I1126 19:34:52.355684 11223 sched.cpp:608] Scheduler::statusUpdate took 18212ns I1126 19:34:52.355767 11223 sched.cpp:719] Stopping framework '201311261934-1032504131-48458-11197-0000' I1126 19:34:52.355778 11197 master.cpp:554] Master terminating I1126 19:34:52.355798 11197 master.cpp:210] Shutting down master I1126 19:34:52.355824 11221 slave.cpp:1945] [email protected]:48458 exited W1126 19:34:52.355839 11221 slave.cpp:1948] Master disconnected! Waiting for a new master to be elected I1126 19:34:52.355833 11197 master.hpp:442] Removing offer 201311261934-1032504131-48458-11197-0 with resources cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] on slave 201311261934-1032504131-48458-11197-0 (juno.apache.org) I1126 19:34:52.355890 11197 master.cpp:253] Removing slave 201311261934-1032504131-48458-11197-0 (juno.apache.org) I1126 19:34:52.462956 11222 slave.cpp:391] Slave terminating [ OK ] FaultToleranceTest.TaskLost (157 ms) [ RUN ] FaultToleranceTest.SchedulerFailoverStatusUpdate I1126 19:34:52.463734 11216 master.cpp:285] Master started on 67.195.138.61:48458 I1126 19:34:52.463762 11216 master.cpp:299] Master ID: 201311261934-1032504131-48458-11197 I1126 19:34:52.463770 11216 master.cpp:302] Master only allowing authenticated frameworks to register! I1126 19:34:52.464002 11219 master.cpp:85] No whitelist given. Advertising offers for all slaves I1126 19:34:52.464058 11220 hierarchical_allocator_process.hpp:302] Initializing hierarchical allocator process with master : [email protected]:48458 I1126 19:34:52.464253 11217 master.cpp:744] The newly elected leader is [email protected]:48458 I1126 19:34:52.464268 11217 master.cpp:748] Elected as the leading master! I1126 19:34:52.497206 11217 slave.cpp:112] Slave started on 36)@67.195.138.61:48458 I1126 19:34:52.497308 11217 slave.cpp:212] Slave resources: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] I1126 19:34:52.497473 11220 sched.cpp:207] New master detected at [email protected]:48458 I1126 19:34:52.497493 11220 sched.cpp:260] Authenticating with master [email protected]:48458 I1126 19:34:52.497541 11220 sched.cpp:229] Detecting new master I1126 19:34:52.497552 11221 authenticatee.hpp:124] Creating new client SASL connection I1126 19:34:52.497818 11221 master.cpp:1840] Authenticating framework at scheduler(51)@67.195.138.61:48458 I1126 19:34:52.497849 11217 state.cpp:33] Recovering state from '/tmp/FaultToleranceTest_SchedulerFailoverStatusUpdate_FGRnt1/meta' I1126 19:34:52.497895 11221 authenticator.hpp:140] Creating new server SASL connection I1126 19:34:52.497920 11217 status_update_manager.cpp:186] Recovering status update manager I1126 19:34:52.497972 11221 authenticatee.hpp:212] Received SASL authentication mechanisms: CRAM-MD5 I1126 19:34:52.497987 11221 authenticatee.hpp:238] Attempting to authenticate with mechanism 'CRAM-MD5' I1126 19:34:52.497993 11217 slave.cpp:2748] Finished recovery I1126 19:34:52.498003 11221 authenticator.hpp:243] Received SASL authentication start I1126 19:34:52.498036 11221 authenticator.hpp:325] Authentication requires more steps I1126 19:34:52.498045 11217 slave.cpp:497] New master detected at [email protected]:48458 I1126 19:34:52.498052 11221 authenticatee.hpp:258] Received SASL authentication step I1126 19:34:52.498077 11221 status_update_manager.cpp:160] New master detected at [email protected]:48458 I1126 19:34:52.498088 11217 slave.cpp:524] Detecting new master I1126 19:34:52.498092 11221 authenticator.hpp:271] Received SASL authentication step I1126 19:34:52.498106 11221 auxprop.cpp:81] Request to lookup properties for user: 'test-principal' realm: 'juno.apache.org' server FQDN: 'juno.apache.org' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false I1126 19:34:52.498114 11221 auxprop.cpp:153] Looking up auxiliary property '*userPassword' I1126 19:34:52.498126 11221 auxprop.cpp:153] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' I1126 19:34:52.498132 11217 master.cpp:1364] Attempting to register slave on juno.apache.org at slave(36)@67.195.138.61:48458 I1126 19:34:52.498137 11221 auxprop.cpp:81] Request to lookup properties for user: 'test-principal' realm: 'juno.apache.org' server FQDN: 'juno.apache.org' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true I1126 19:34:52.498145 11221 auxprop.cpp:103] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true I1126 19:34:52.498150 11221 auxprop.cpp:103] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true I1126 19:34:52.498142 11217 master.cpp:2619] Adding slave 201311261934-1032504131-48458-11197-0 at juno.apache.org with cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] I1126 19:34:52.498162 11221 authenticator.hpp:317] Authentication success I1126 19:34:52.498191 11221 authenticatee.hpp:298] Authentication success I1126 19:34:52.498210 11221 slave.cpp:542] Registered with master [email protected]:48458; given slave ID 201311261934-1032504131-48458-11197-0 I1126 19:34:52.498225 11217 master.cpp:1880] Successfully authenticated framework at scheduler(51)@67.195.138.61:48458 I1126 19:34:52.498261 11221 sched.cpp:334] Successfully authenticated with master [email protected]:48458 I1126 19:34:52.498293 11219 hierarchical_allocator_process.hpp:445] Added slave 201311261934-1032504131-48458-11197-0 (juno.apache.org) with cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] (and cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] available) I1126 19:34:52.498332 11219 hierarchical_allocator_process.hpp:708] Performed allocation for slave 201311261934-1032504131-48458-11197-0 in 9386ns I1126 19:34:52.498391 11217 master.cpp:799] Received registration request from scheduler(51)@67.195.138.61:48458 I1126 19:34:52.498497 11217 master.cpp:817] Registering framework 201311261934-1032504131-48458-11197-0000 at scheduler(51)@67.195.138.61:48458 I1126 19:34:52.498538 11217 sched.cpp:383] Framework registered with 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.498556 11217 sched.cpp:397] Scheduler::registered took 10202ns I1126 19:34:52.498576 11217 hierarchical_allocator_process.hpp:332] Added framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.498613 11217 hierarchical_allocator_process.hpp:752] Offering cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] on slave 201311261934-1032504131-48458-11197-0 to framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.498728 11217 hierarchical_allocator_process.hpp:688] Performed allocation for 1 slaves in 141141ns I1126 19:34:52.498777 11217 master.hpp:432] Adding offer 201311261934-1032504131-48458-11197-0 with resources cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] on slave 201311261934-1032504131-48458-11197-0 (juno.apache.org) I1126 19:34:52.498826 11217 master.cpp:1801] Sending 1 offers to framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.498903 11217 sched.cpp:517] Scheduler::resourceOffers took 17486ns I1126 19:34:52.499302 11220 master.cpp:2132] Processing reply for offer 201311261934-1032504131-48458-11197-0 on slave 201311261934-1032504131-48458-11197-0 (juno.apache.org) for framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.499449 11220 master.hpp:404] Adding task 1 with resources cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] on slave 201311261934-1032504131-48458-11197-0 (juno.apache.org) I1126 19:34:52.499495 11220 master.cpp:2256] Launching task 1 of framework 201311261934-1032504131-48458-11197-0000 with resources cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] on slave 201311261934-1032504131-48458-11197-0 (juno.apache.org) I1126 19:34:52.499608 11220 master.hpp:442] Removing offer 201311261934-1032504131-48458-11197-0 with resources cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] on slave 201311261934-1032504131-48458-11197-0 (juno.apache.org) I1126 19:34:52.499683 11220 slave.cpp:722] Got assigned task 1 for framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.499830 11220 slave.cpp:833] Launching task 1 for framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.500859 11220 slave.cpp:943] Queuing task '1' for executor default of framework '201311261934-1032504131-48458-11197-0000 I1126 19:34:52.500958 11220 slave.cpp:466] Successfully attached file '/tmp/FaultToleranceTest_SchedulerFailoverStatusUpdate_FGRnt1/slaves/201311261934-1032504131-48458-11197-0/frameworks/201311261934-1032504131-48458-11197-0000/executors/default/runs/029531df-b31f-454f-9ef9-9b5eedf478b4' I1126 19:34:52.501799 11222 exec.cpp:178] Executor started at: executor(11)@67.195.138.61:48458 with pid 11197 I1126 19:34:52.501806 11216 slave.cpp:2078] Monitoring executor default of framework 201311261934-1032504131-48458-11197-0000 forked at pid 11197 I1126 19:34:52.501901 11216 slave.cpp:1411] Got registration for executor 'default' of framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.502056 11216 slave.cpp:1532] Flushing queued task 1 for executor 'default' of framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.502076 11222 exec.cpp:202] Executor registered on slave 201311261934-1032504131-48458-11197-0 I1126 19:34:52.503017 11222 exec.cpp:214] Executor::registered took 11508ns I1126 19:34:52.503090 11222 exec.cpp:289] Executor asked to run task '1' I1126 19:34:52.503123 11222 exec.cpp:298] Executor::launchTask took 22249ns I1126 19:34:52.504050 11222 exec.cpp:521] Executor sending status update TASK_RUNNING (UUID: cbe964f7-85b1-452c-a4b7-cbb4963c76ef) for task 1 of framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.504137 11222 slave.cpp:1745] Handling status update TASK_RUNNING (UUID: cbe964f7-85b1-452c-a4b7-cbb4963c76ef) for task 1 of framework 201311261934-1032504131-48458-11197-0000 from executor(11)@67.195.138.61:48458 I1126 19:34:52.504257 11220 status_update_manager.cpp:312] Received status update TASK_RUNNING (UUID: cbe964f7-85b1-452c-a4b7-cbb4963c76ef) for task 1 of framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.504272 11220 status_update_manager.cpp:491] Creating StatusUpdate stream for task 1 of framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.504328 11220 status_update_manager.cpp:365] Forwarding status update TASK_RUNNING (UUID: cbe964f7-85b1-452c-a4b7-cbb4963c76ef) for task 1 of framework 201311261934-1032504131-48458-11197-0000 to [email protected]:48458 I1126 19:34:52.504454 11220 master.cpp:1550] Status update TASK_RUNNING (UUID: cbe964f7-85b1-452c-a4b7-cbb4963c76ef) for task 1 of framework 201311261934-1032504131-48458-11197-0000 from slave(36)@67.195.138.61:48458 I1126 19:34:52.504487 11220 slave.cpp:1864] Status update manager successfully handled status update TASK_RUNNING (UUID: cbe964f7-85b1-452c-a4b7-cbb4963c76ef) for task 1 of framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.504497 11220 slave.cpp:1870] Sending acknowledgement for status update TASK_RUNNING (UUID: cbe964f7-85b1-452c-a4b7-cbb4963c76ef) for task 1 of framework 201311261934-1032504131-48458-11197-0000 to executor(11)@67.195.138.61:48458 I1126 19:34:52.504575 11220 exec.cpp:335] Executor received status update acknowledgement cbe964f7-85b1-452c-a4b7-cbb4963c76ef for task 1 of framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.504886 11216 sched.cpp:207] New master detected at [email protected]:48458 I1126 19:34:52.504904 11216 sched.cpp:260] Authenticating with master [email protected]:48458 I1126 19:34:52.504940 11216 sched.cpp:229] Detecting new master I1126 19:34:52.504979 11216 authenticatee.hpp:124] Creating new client SASL connection I1126 19:34:52.505080 11216 master.cpp:1840] Authenticating framework at scheduler(52)@67.195.138.61:48458 I1126 19:34:52.505154 11220 authenticator.hpp:140] Creating new server SASL connection I1126 19:34:52.505271 11220 authenticatee.hpp:212] Received SASL authentication mechanisms: CRAM-MD5 I1126 19:34:52.505290 11220 authenticatee.hpp:238] Attempting to authenticate with mechanism 'CRAM-MD5' I1126 19:34:52.505326 11220 authenticator.hpp:243] Received SASL authentication start I1126 19:34:52.505354 11220 authenticator.hpp:325] Authentication requires more steps I1126 19:34:52.505383 11220 authenticatee.hpp:258] Received SASL authentication step I1126 19:34:52.505427 11220 authenticator.hpp:271] Received SASL authentication step I1126 19:34:52.505445 11220 auxprop.cpp:81] Request to lookup properties for user: 'test-principal' realm: 'juno.apache.org' server FQDN: 'juno.apache.org' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false I1126 19:34:52.505455 11220 auxprop.cpp:153] Looking up auxiliary property '*userPassword' I1126 19:34:52.505466 11220 auxprop.cpp:153] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' I1126 19:34:52.505477 11220 auxprop.cpp:81] Request to lookup properties for user: 'test-principal' realm: 'juno.apache.org' server FQDN: 'juno.apache.org' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true I1126 19:34:52.505484 11220 auxprop.cpp:103] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true I1126 19:34:52.505489 11220 auxprop.cpp:103] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true I1126 19:34:52.505501 11220 authenticator.hpp:317] Authentication success I1126 19:34:52.505533 11220 authenticatee.hpp:298] Authentication success I1126 19:34:52.505558 11220 master.cpp:1880] Successfully authenticated framework at scheduler(52)@67.195.138.61:48458 I1126 19:34:52.505638 11219 sched.cpp:334] Successfully authenticated with master [email protected]:48458 I1126 19:34:52.505684 11219 master.cpp:887] Re-registering framework 201311261934-1032504131-48458-11197-0000 at scheduler(52)@67.195.138.61:48458 I1126 19:34:52.505694 11219 master.cpp:913] Framework 201311261934-1032504131-48458-11197-0000 failed over I1126 19:34:52.505734 11219 sched.cpp:703] Got error 'Framework failed over' I1126 19:34:52.505751 11219 sched.cpp:714] Scheduler::error took 7209ns I1126 19:34:52.505765 11219 sched.cpp:744] Aborting framework '201311261934-1032504131-48458-11197-0000' I1126 19:34:52.505787 11219 sched.cpp:383] Framework registered with 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.505803 11219 sched.cpp:397] Scheduler::registered took 8853ns I1126 19:34:52.505821 11219 slave.cpp:1292] Updating framework 201311261934-1032504131-48458-11197-0000 pid to scheduler(52)@67.195.138.61:48458 W1126 19:34:52.505856 11219 master.cpp:1035] Ignoring deactivate framework message for framework 201311261934-1032504131-48458-11197-0000 from 'scheduler(51)@67.195.138.61:48458' because it is not from the registered framework 'scheduler(52)@67.195.138.61:48458' W1126 19:34:52.505882 11219 status_update_manager.cpp:174] Resending status update TASK_RUNNING (UUID: cbe964f7-85b1-452c-a4b7-cbb4963c76ef) for task 1 of framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.505893 11219 status_update_manager.cpp:365] Forwarding status update TASK_RUNNING (UUID: cbe964f7-85b1-452c-a4b7-cbb4963c76ef) for task 1 of framework 201311261934-1032504131-48458-11197-0000 to [email protected]:48458 I1126 19:34:52.505987 11219 master.cpp:1550] Status update TASK_RUNNING (UUID: cbe964f7-85b1-452c-a4b7-cbb4963c76ef) for task 1 of framework 201311261934-1032504131-48458-11197-0000 from slave(36)@67.195.138.61:48458 GMOCK WARNING: Uninteresting mock function call - returning directly. Function call: statusUpdate(0x7fff145414c0, @0x2b6914001ea0 72-byte object <30-DA 9C-EF 68-2B 00-00 00-00 00-00 00-00 00-00 F0-5E 00-14 69-2B 00-00 40-DE C4-00 00-00 00-00 40-DE C4-00 00-00 00-00 90-5E 00-14 69-2B 00-00 98-33 20-F7 3D-A5 D4-41 01-00 00-00 00-00 00-00 33-00 00-00 75-73 20-70>) Stack trace: I1126 19:34:52.506075 11219 sched.cpp:608] Scheduler::statusUpdate took 44593ns I1126 19:34:52.506147 11219 status_update_manager.cpp:390] Received status update acknowledgement (UUID: cbe964f7-85b1-452c-a4b7-cbb4963c76ef) for task 1 of framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.506191 11219 slave.cpp:1351] Status update manager successfully handled status update acknowledgement (UUID: cbe964f7-85b1-452c-a4b7-cbb4963c76ef) for task 1 of framework 201311261934-1032504131-48458-11197-0000 I1126 19:34:52.506577 11216 hierarchical_allocator_process.hpp:688] Performed allocation for 1 slaves in 16028ns I1126 19:34:52.506623 11221 sched.cpp:345] Ignoring authentication timeout because the driver is aborted! I1126 19:34:52.506644 11216 master.cpp:85] No whitelist given. Advertising offers for all slaves I1126 19:34:52.506795 11223 monitor.cpp:193] Publishing resource usage for executor 'default' of framework '201311261934-1032504131-48458-11197-0000' I1126 19:34:52.628629 11745 exec.cpp:84] Committing suicide by killing the process group I1126 19:34:52.629223 11741 exec.cpp:84] Committing suicide by killing the process group I1126 19:34:52.629232 11731 exec.cpp:84] Committing suicide by killing the process group I1126 19:34:55.268442 11905 exec.cpp:84] Committing suicide by killing the process group I1126 19:34:55.269196 11858 exec.cpp:84] Committing suicide by killing the process group I1126 19:34:55.269722 11870 exec.cpp:84] Committing suicide by killing the process group Build timed out (after 382 minutes). Marking the build as failed. make[3]: *** [check-local] Terminated make[3]: Leaving directory `<https://builds.apache.org/job/Mesos-Trunk-Ubuntu-Build-In-Src-Set-JAVA_HOME/ws/src'> make[2]: *** [check-am] Error 2 make[2]: Leaving directory `<https://builds.apache.org/job/Mesos-Trunk-Ubuntu-Build-In-Src-Set-JAVA_HOME/ws/src'> make[1]: *** [check] Error 2 make[1]: Leaving directory `<https://builds.apache.org/job/Mesos-Trunk-Ubuntu-Build-In-Src-Set-JAVA_HOME/ws/src'> make: *** [check-recursive] Error 1
