----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72364/#review220606 -----------------------------------------------------------
Bad patch! Reviews applied: [72368, 72364] Failed command: ['bash', '-c', "set -o pipefail; export OS='ubuntu:16.04' BUILDTOOL='autotools' COMPILER='gcc' CONFIGURATION='--verbose --disable-libtool-wrappers --disable-parallel-test-execution' ENVIRONMENT='GLOG_v=1 MESOS_VERBOSE=1'; ./support/jenkins/buildbot.sh 2>&1 | tee build_72364"] Error: ...<truncated>... )/api/v1/resource_provider I0504 18:19:49.941777 2187 process.cpp:3671] Handling HTTP event for process 'slave(1247)' with path: '/slave(1247)/api/v1/resource_provider' I0504 18:19:49.946017 2205 hierarchical.cpp:1853] Performed allocation for 1 agents in 1.983256ms I0504 18:19:49.947141 2185 master.cpp:9476] Sending offers [ 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-O3 ] to framework 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-0000 (default) at [email protected]:40073 I0504 18:19:49.948379 2193 sched.cpp:934] Scheduler::resourceOffers took 108336ns I0504 18:19:49.952947 2195 process.cpp:3671] Handling HTTP event for process 'master' with path: '/master/api/v1' I0504 18:19:49.955690 2186 http.cpp:1436] HTTP POST for /master/api/v1 from 172.17.0.2:38790 I0504 18:19:49.955963 2186 http.cpp:277] Processing call CREATE_VOLUMES I0504 18:19:49.957028 2186 master.cpp:3693] Authorizing principal 'test-principal' to perform action CREATE_VOLUME on object {"value":"storage/default-role","resource":{"provider_id":{"value":"ceffd29f-ed62-4c30-b402-b293d9770f3b"},"name":"disk","type":"SCALAR","scalar":{"value":2048.0},"reservations":[{"type":"DYNAMIC","role":"storage"},{"type":"DYNAMIC","role":"storage/default-role","principal":"test-principal"}],"disk":{"persistence":{"id":"2607cfb8-8469-45ac-bb1a-49af4964a42f","principal":"test-principal"},"volume":{"mode":"RW","container_path":"volume"},"source":{"type":"MOUNT","mount":{"root":"./csi/org.apache.mesos.csi.test/local/mounts"},"vendor":"org.apache.mesos.csi.test.local","id":"/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_qmHcEB/2GB-b39c4443-f320-4d72-8119-88bea7603581","profile":"test"}}}} I0504 18:19:49.958791 2192 sched.cpp:960] Rescinded offer 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-O3 I0504 18:19:49.958904 2192 sched.cpp:971] Scheduler::offerRescinded took 34095ns I0504 18:19:49.959444 2190 hierarchical.cpp:1576] Recovered ports(allocated: storage/default-role):[31000-32000]; disk(allocated: storage/default-role)(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_qmHcEB/2GB-b39c4443-f320-4d72-8119-88bea7603581,test)]:2048; cpus(allocated: storage/default-role):2; mem(allocated: storage/default-role):1024; disk(allocated: storage/default-role):1024 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_qmHcEB/2GB-b39c4443-f320-4d72-8119-88bea7603581,test)]:2048, offered or allocated: {}) on agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 from framework 3dfbc 6f2-f928-4a58-a2e1-f9498886edc7-0000 I0504 18:19:49.959580 2204 master.cpp:11775] Removing offer 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-O3 I0504 18:19:49.961390 2190 hierarchical.cpp:1625] Framework 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-0000 filtered agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 for 5secs I0504 18:19:49.964745 2194 master.cpp:11640] Sending operation '' (uuid: 0a4c08a8-4077-42fe-bb3d-0db501bcd93a) to agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 at slave(1247)@172.17.0.2:40073 (e72e52c70698) I0504 18:19:49.965557 2197 slave.cpp:4557] Ignoring new checkpointed resources and operations identical to the current version I0504 18:19:49.969734 2184 provider.cpp:498] Received APPLY_OPERATION event I0504 18:19:49.969800 2184 provider.cpp:1351] Received CREATE operation '' (uuid: 0a4c08a8-4077-42fe-bb3d-0db501bcd93a) I0504 18:19:49.970155 2186 master.cpp:5521] Processing REVIVE call for framework 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-0000 (default) at [email protected]:40073 I0504 18:19:49.970742 2202 hierarchical.cpp:1721] Unsuppressed offers and cleared filters for roles { storage/default-role } of framework 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-0000 I0504 18:19:49.972522 2202 hierarchical.cpp:1853] Performed allocation for 1 agents in 1.490624ms I0504 18:19:49.972906 2202 hierarchical.cpp:1853] Performed allocation for 1 agents in 171581ns I0504 18:19:49.973218 2189 master.cpp:9476] Sending offers [ 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-O4 ] to framework 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-0000 (default) at [email protected]:40073 I0504 18:19:49.973999 2192 sched.cpp:934] Scheduler::resourceOffers took 117181ns I0504 18:19:49.985782 2205 http.cpp:1436] HTTP POST for /slave(1247)/api/v1/resource_provider from 172.17.0.2:38784 I0504 18:19:49.987293 2185 slave.cpp:8714] Handling resource provider message 'UPDATE_OPERATION_STATUS: (uuid: 73f2648c-1394-469b-ad75-7be07bae8dac) for framework (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED)' I0504 18:19:49.987723 2185 slave.cpp:9167] Updating the state of operation with no ID (uuid: 73f2648c-1394-469b-ad75-7be07bae8dac) for an operation API call (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED) I0504 18:19:49.987814 2185 slave.cpp:8921] Forwarding status update of operation with no ID (operation_uuid: 73f2648c-1394-469b-ad75-7be07bae8dac) for an operator API call I0504 18:19:49.988261 2188 master.cpp:11292] Updating the state of operation '' (uuid: 73f2648c-1394-469b-ad75-7be07bae8dac) for an operator API call (latest state: OPERATION_PENDING, status update state: OPERATION_FINISHED) I0504 18:19:49.988864 2207 slave.cpp:4557] Ignoring new checkpointed resources and operations identical to the current version I0504 18:19:50.056411 2192 status_update_manager_process.hpp:152] Received operation status update OPERATION_FINISHED (Status UUID: 3e965fc5-d8d1-4d2f-9c15-56b2aa1fefbc) for operation UUID 0a4c08a8-4077-42fe-bb3d-0db501bcd93a on agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 I0504 18:19:50.056476 2192 status_update_manager_process.hpp:414] Creating operation status update stream 0a4c08a8-4077-42fe-bb3d-0db501bcd93a checkpoint=true I0504 18:19:50.056501 2184 provider.cpp:498] Received ACKNOWLEDGE_OPERATION_STATUS event I0504 18:19:50.056746 2192 status_update_manager_process.hpp:929] Checkpointing UPDATE for operation status update OPERATION_FINISHED (Status UUID: 3e965fc5-d8d1-4d2f-9c15-56b2aa1fefbc) for operation UUID 0a4c08a8-4077-42fe-bb3d-0db501bcd93a on agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 I0504 18:19:50.123260 2192 status_update_manager_process.hpp:528] Forwarding operation status update OPERATION_FINISHED (Status UUID: 3e965fc5-d8d1-4d2f-9c15-56b2aa1fefbc) for operation UUID 0a4c08a8-4077-42fe-bb3d-0db501bcd93a on agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 I0504 18:19:50.123657 2192 status_update_manager_process.hpp:252] Received operation status update acknowledgement (UUID: c3891d79-9fb8-45db-989a-0f60ea871170) for stream 73f2648c-1394-469b-ad75-7be07bae8dac I0504 18:19:50.123733 2192 status_update_manager_process.hpp:929] Checkpointing ACK for operation status update OPERATION_FINISHED (Status UUID: c3891d79-9fb8-45db-989a-0f60ea871170) for operation UUID 73f2648c-1394-469b-ad75-7be07bae8dac on agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 I0504 18:19:50.124222 2198 http_connection.hpp:131] Sending UPDATE_OPERATION_STATUS call to http://172.17.0.2:40073/slave(1247)/api/v1/resource_provider I0504 18:19:50.125530 2203 process.cpp:3671] Handling HTTP event for process 'slave(1247)' with path: '/slave(1247)/api/v1/resource_provider' I0504 18:19:50.169500 2191 http.cpp:1436] HTTP POST for /slave(1247)/api/v1/resource_provider from 172.17.0.2:38784 I0504 18:19:50.170663 2199 slave.cpp:8714] Handling resource provider message 'UPDATE_OPERATION_STATUS: (uuid: 0a4c08a8-4077-42fe-bb3d-0db501bcd93a) for framework (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED)' I0504 18:19:50.171032 2199 slave.cpp:9167] Updating the state of operation with no ID (uuid: 0a4c08a8-4077-42fe-bb3d-0db501bcd93a) for an operation API call (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED) I0504 18:19:50.171128 2199 slave.cpp:8921] Forwarding status update of operation with no ID (operation_uuid: 0a4c08a8-4077-42fe-bb3d-0db501bcd93a) for an operator API call I0504 18:19:50.171977 2206 master.cpp:11292] Updating the state of operation '' (uuid: 0a4c08a8-4077-42fe-bb3d-0db501bcd93a) for an operator API call (latest state: OPERATION_PENDING, status update state: OPERATION_FINISHED) I0504 18:19:50.172972 2196 slave.cpp:4557] Ignoring new checkpointed resources and operations identical to the current version I0504 18:19:50.174471 2194 provider.cpp:498] Received ACKNOWLEDGE_OPERATION_STATUS event I0504 18:19:50.190063 2192 status_update_manager_process.hpp:490] Cleaning up operation status update stream 73f2648c-1394-469b-ad75-7be07bae8dac I0504 18:19:50.190289 2192 status_update_manager_process.hpp:252] Received operation status update acknowledgement (UUID: 3e965fc5-d8d1-4d2f-9c15-56b2aa1fefbc) for stream 0a4c08a8-4077-42fe-bb3d-0db501bcd93a I0504 18:19:50.190374 2192 status_update_manager_process.hpp:929] Checkpointing ACK for operation status update OPERATION_FINISHED (Status UUID: 3e965fc5-d8d1-4d2f-9c15-56b2aa1fefbc) for operation UUID 0a4c08a8-4077-42fe-bb3d-0db501bcd93a on agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 I0504 18:19:50.307299 2192 status_update_manager_process.hpp:490] Cleaning up operation status update stream 0a4c08a8-4077-42fe-bb3d-0db501bcd93a I0504 18:19:50.378427 2185 process.cpp:3671] Handling HTTP event for process 'master' with path: '/master/api/v1' I0504 18:19:50.380920 2195 http.cpp:1436] HTTP POST for /master/api/v1 from 172.17.0.2:38792 I0504 18:19:50.381386 2195 http.cpp:277] Processing call DESTROY_VOLUMES I0504 18:19:50.382913 2195 master.cpp:3693] Authorizing principal 'test-principal' to perform action DESTROY_VOLUME on object {"value":"test-principal","resource":{"provider_id":{"value":"ceffd29f-ed62-4c30-b402-b293d9770f3b"},"name":"disk","type":"SCALAR","scalar":{"value":2048.0},"reservations":[{"type":"DYNAMIC","role":"storage"},{"type":"DYNAMIC","role":"storage/default-role","principal":"test-principal"}],"disk":{"persistence":{"id":"2607cfb8-8469-45ac-bb1a-49af4964a42f","principal":"test-principal"},"volume":{"mode":"RW","container_path":"volume"},"source":{"type":"MOUNT","mount":{"root":"./csi/org.apache.mesos.csi.test/local/mounts"},"vendor":"org.apache.mesos.csi.test.local","id":"/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_qmHcEB/2GB-b39c4443-f320-4d72-8119-88bea7603581","profile":"test"}}}} I0504 18:19:50.385536 2201 sched.cpp:960] Rescinded offer 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-O4 I0504 18:19:50.385721 2201 sched.cpp:971] Scheduler::offerRescinded took 79368ns I0504 18:19:50.386637 2184 hierarchical.cpp:1576] Recovered ports(allocated: storage/default-role):[31000-32000]; disk(allocated: storage/default-role)(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_qmHcEB/2GB-b39c4443-f320-4d72-8119-88bea7603581,test),2607cfb8-8469-45ac-bb1a-49af4964a42f:volume]:2048; cpus(allocated: storage/default-role):2; mem(allocated: storage/default-role):1024; disk(allocated: storage/default-role):1024 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_qmHcEB/2GB-b39c4443-f320-4d72-8119-88bea7603581,test),2607cfb8-8469-45ac-bb1a-49af4964a42f:volume]:2048, offered or allocated: {}) on agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 from framework 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-0000 I0504 18:19:50.386900 2196 master.cpp:11775] Removing offer 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-O4 I0504 18:19:50.390131 2184 hierarchical.cpp:1625] Framework 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-0000 filtered agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 for 5secs I0504 18:19:50.394438 2204 master.cpp:11640] Sending operation '' (uuid: c4edc0be-98ce-45ba-8e8e-7d148522fa5d) to agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 at slave(1247)@172.17.0.2:40073 (e72e52c70698) I0504 18:19:50.395275 2190 slave.cpp:4557] Ignoring new checkpointed resources and operations identical to the current version I0504 18:19:50.399580 2187 hierarchical.cpp:1853] Performed allocation for 1 agents in 1.750185ms I0504 18:19:50.400287 2195 provider.cpp:498] Received APPLY_OPERATION event I0504 18:19:50.400347 2195 provider.cpp:1351] Received DESTROY operation '' (uuid: c4edc0be-98ce-45ba-8e8e-7d148522fa5d) I0504 18:19:50.400643 2200 master.cpp:9476] Sending offers [ 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-O5 ] to framework 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-0000 (default) at [email protected]:40073 I0504 18:19:50.401754 2186 sched.cpp:934] Scheduler::resourceOffers took 158579ns I0504 18:19:50.501161 2201 status_update_manager_process.hpp:152] Received operation status update OPERATION_FINISHED (Status UUID: 030e69f4-bef2-4bd3-97c7-7aa2553be1a6) for operation UUID c4edc0be-98ce-45ba-8e8e-7d148522fa5d on agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 I0504 18:19:50.501261 2201 status_update_manager_process.hpp:414] Creating operation status update stream c4edc0be-98ce-45ba-8e8e-7d148522fa5d checkpoint=true I0504 18:19:50.501735 2201 status_update_manager_process.hpp:929] Checkpointing UPDATE for operation status update OPERATION_FINISHED (Status UUID: 030e69f4-bef2-4bd3-97c7-7aa2553be1a6) for operation UUID c4edc0be-98ce-45ba-8e8e-7d148522fa5d on agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 I0504 18:19:50.551297 2201 status_update_manager_process.hpp:528] Forwarding operation status update OPERATION_FINISHED (Status UUID: 030e69f4-bef2-4bd3-97c7-7aa2553be1a6) for operation UUID c4edc0be-98ce-45ba-8e8e-7d148522fa5d on agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 I0504 18:19:50.552567 2189 http_connection.hpp:131] Sending UPDATE_OPERATION_STATUS call to http://172.17.0.2:40073/slave(1247)/api/v1/resource_provider I0504 18:19:50.553516 2203 process.cpp:3671] Handling HTTP event for process 'slave(1247)' with path: '/slave(1247)/api/v1/resource_provider' I0504 18:19:50.556669 2202 process.cpp:3671] Handling HTTP event for process 'master' with path: '/master/api/v1' I0504 18:19:50.558715 2191 http.cpp:1436] HTTP POST for /master/api/v1 from 172.17.0.2:38794 I0504 18:19:50.559049 2191 http.cpp:277] Processing call UNRESERVE_RESOURCES I0504 18:19:50.560046 2191 master.cpp:3693] Authorizing principal 'test-principal' to perform action UNRESERVE_RESOURCES on object {"value":"test-principal","resource":{"provider_id":{"value":"ceffd29f-ed62-4c30-b402-b293d9770f3b"},"name":"disk","type":"SCALAR","scalar":{"value":2048.0},"reservations":[{"type":"DYNAMIC","role":"storage"},{"type":"DYNAMIC","role":"storage/default-role","principal":"test-principal"}],"disk":{"source":{"type":"MOUNT","mount":{"root":"./csi/org.apache.mesos.csi.test/local/mounts"},"vendor":"org.apache.mesos.csi.test.local","id":"/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_qmHcEB/2GB-b39c4443-f320-4d72-8119-88bea7603581","profile":"test"}}}} I0504 18:19:50.561625 2207 sched.cpp:960] Rescinded offer 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-O5 I0504 18:19:50.561731 2207 sched.cpp:971] Scheduler::offerRescinded took 41779ns I0504 18:19:50.562137 2206 hierarchical.cpp:1576] Recovered ports(allocated: storage/default-role):[31000-32000]; disk(allocated: storage/default-role)(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_qmHcEB/2GB-b39c4443-f320-4d72-8119-88bea7603581,test)]:2048; cpus(allocated: storage/default-role):2; mem(allocated: storage/default-role):1024; disk(allocated: storage/default-role):1024 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_qmHcEB/2GB-b39c4443-f320-4d72-8119-88bea7603581,test)]:2048, offered or allocated: {}) on agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 from framework 3dfbc 6f2-f928-4a58-a2e1-f9498886edc7-0000 I0504 18:19:50.562248 2188 master.cpp:11775] Removing offer 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-O5 I0504 18:19:50.564014 2206 hierarchical.cpp:1625] Framework 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-0000 filtered agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 for 5secs I0504 18:19:50.567469 2195 master.cpp:11640] Sending operation '' (uuid: ba5fddf5-74b1-4f9a-98f0-4b9530d59aa5) to agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 at slave(1247)@172.17.0.2:40073 (e72e52c70698) I0504 18:19:50.568289 2189 slave.cpp:4557] Ignoring new checkpointed resources and operations identical to the current version I0504 18:19:50.571990 2193 provider.cpp:498] Received APPLY_OPERATION event I0504 18:19:50.572057 2193 provider.cpp:1351] Received UNRESERVE operation '' (uuid: ba5fddf5-74b1-4f9a-98f0-4b9530d59aa5) I0504 18:19:50.577417 2191 hierarchical.cpp:1853] Performed allocation for 1 agents in 1.169782ms I0504 18:19:50.578069 2197 master.cpp:9476] Sending offers [ 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-O6 ] to framework 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-0000 (default) at [email protected]:40073 I0504 18:19:50.579007 2187 sched.cpp:934] Scheduler::resourceOffers took 140087ns I0504 18:19:50.597050 2201 http.cpp:1436] HTTP POST for /slave(1247)/api/v1/resource_provider from 172.17.0.2:38784 I0504 18:19:50.598296 2195 slave.cpp:8714] Handling resource provider message 'UPDATE_OPERATION_STATUS: (uuid: c4edc0be-98ce-45ba-8e8e-7d148522fa5d) for framework (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED)' I0504 18:19:50.598635 2195 slave.cpp:9167] Updating the state of operation with no ID (uuid: c4edc0be-98ce-45ba-8e8e-7d148522fa5d) for an operation API call (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED) I0504 18:19:50.598721 2195 slave.cpp:8921] Forwarding status update of operation with no ID (operation_uuid: c4edc0be-98ce-45ba-8e8e-7d148522fa5d) for an operator API call I0504 18:19:50.599138 2203 master.cpp:11292] Updating the state of operation '' (uuid: c4edc0be-98ce-45ba-8e8e-7d148522fa5d) for an operator API call (latest state: OPERATION_PENDING, status update state: OPERATION_FINISHED) I0504 18:19:50.599823 2189 slave.cpp:4557] Ignoring new checkpointed resources and operations identical to the current version I0504 18:19:50.677325 2187 status_update_manager_process.hpp:152] Received operation status update OPERATION_FINISHED (Status UUID: 43d8511b-11b6-4e30-8f38-88c1976330d1) for operation UUID ba5fddf5-74b1-4f9a-98f0-4b9530d59aa5 on agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 I0504 18:19:50.677369 2193 provider.cpp:498] Received ACKNOWLEDGE_OPERATION_STATUS event I0504 18:19:50.677433 2187 status_update_manager_process.hpp:414] Creating operation status update stream ba5fddf5-74b1-4f9a-98f0-4b9530d59aa5 checkpoint=true I0504 18:19:50.677861 2187 status_update_manager_process.hpp:929] Checkpointing UPDATE for operation status update OPERATION_FINISHED (Status UUID: 43d8511b-11b6-4e30-8f38-88c1976330d1) for operation UUID ba5fddf5-74b1-4f9a-98f0-4b9530d59aa5 on agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 I0504 18:19:50.744217 2187 status_update_manager_process.hpp:528] Forwarding operation status update OPERATION_FINISHED (Status UUID: 43d8511b-11b6-4e30-8f38-88c1976330d1) for operation UUID ba5fddf5-74b1-4f9a-98f0-4b9530d59aa5 on agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 I0504 18:19:50.744753 2187 status_update_manager_process.hpp:252] Received operation status update acknowledgement (UUID: 030e69f4-bef2-4bd3-97c7-7aa2553be1a6) for stream c4edc0be-98ce-45ba-8e8e-7d148522fa5d I0504 18:19:50.744868 2187 status_update_manager_process.hpp:929] Checkpointing ACK for operation status update OPERATION_FINISHED (Status UUID: 030e69f4-bef2-4bd3-97c7-7aa2553be1a6) for operation UUID c4edc0be-98ce-45ba-8e8e-7d148522fa5d on agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 I0504 18:19:50.745116 2188 http_connection.hpp:131] Sending UPDATE_OPERATION_STATUS call to http://172.17.0.2:40073/slave(1247)/api/v1/resource_provider I0504 18:19:50.746271 2206 process.cpp:3671] Handling HTTP event for process 'slave(1247)' with path: '/slave(1247)/api/v1/resource_provider' I0504 18:19:50.789599 2203 http.cpp:1436] HTTP POST for /slave(1247)/api/v1/resource_provider from 172.17.0.2:38784 I0504 18:19:50.790588 2204 slave.cpp:8714] Handling resource provider message 'UPDATE_OPERATION_STATUS: (uuid: ba5fddf5-74b1-4f9a-98f0-4b9530d59aa5) for framework (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED)' I0504 18:19:50.790776 2204 slave.cpp:9167] Updating the state of operation with no ID (uuid: ba5fddf5-74b1-4f9a-98f0-4b9530d59aa5) for an operation API call (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED) I0504 18:19:50.790828 2204 slave.cpp:8921] Forwarding status update of operation with no ID (operation_uuid: ba5fddf5-74b1-4f9a-98f0-4b9530d59aa5) for an operator API call I0504 18:19:50.791179 2202 master.cpp:11292] Updating the state of operation '' (uuid: ba5fddf5-74b1-4f9a-98f0-4b9530d59aa5) for an operator API call (latest state: OPERATION_PENDING, status update state: OPERATION_FINISHED) I0504 18:19:50.791733 2190 slave.cpp:4557] Ignoring new checkpointed resources and operations identical to the current version I0504 18:19:50.793853 2186 provider.cpp:498] Received ACKNOWLEDGE_OPERATION_STATUS event I0504 18:19:50.811022 2187 status_update_manager_process.hpp:490] Cleaning up operation status update stream c4edc0be-98ce-45ba-8e8e-7d148522fa5d I0504 18:19:50.811431 2187 status_update_manager_process.hpp:252] Received operation status update acknowledgement (UUID: 43d8511b-11b6-4e30-8f38-88c1976330d1) for stream ba5fddf5-74b1-4f9a-98f0-4b9530d59aa5 I0504 18:19:50.811545 2187 status_update_manager_process.hpp:929] Checkpointing ACK for operation status update OPERATION_FINISHED (Status UUID: 43d8511b-11b6-4e30-8f38-88c1976330d1) for operation UUID ba5fddf5-74b1-4f9a-98f0-4b9530d59aa5 on agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 I0504 18:19:50.903065 2187 status_update_manager_process.hpp:490] Cleaning up operation status update stream ba5fddf5-74b1-4f9a-98f0-4b9530d59aa5 I0504 18:19:50.971637 2198 master.cpp:1407] Framework 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-0000 (default) at [email protected]:40073 disconnected I0504 18:19:50.971707 2198 master.cpp:3326] Deactivating framework 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-0000 (default) at [email protected]:40073 I0504 18:19:50.972093 2204 hierarchical.cpp:813] Deactivated framework 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-0000 I0504 18:19:50.972577 2183 slave.cpp:1000] Agent terminating I0504 18:19:50.972779 2190 hierarchical.cpp:1576] Recovered ports(allocated: storage/default-role):[31000-32000]; disk(allocated: storage/default-role)(reservations: [(DYNAMIC,storage)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_qmHcEB/2GB-b39c4443-f320-4d72-8119-88bea7603581,test)]:2048; cpus(allocated: storage/default-role):2; mem(allocated: storage/default-role):1024; disk(allocated: storage/default-role):1024 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk(reservations: [(DYNAMIC,storage)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_qmHcEB/2GB-b39c4443-f320-4d72-8119-88bea7603581,test)]:2048, offered or allocated: {}) on agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 from framework 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-0000 I0504 18:19:50.973325 2198 master.cpp:11775] Removing offer 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-O6 I0504 18:19:50.973409 2183 manager.cpp:127] Terminating resource provider ceffd29f-ed62-4c30-b402-b293d9770f3b I0504 18:19:50.973454 2198 master.cpp:3310] Disconnecting framework 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-0000 (default) at [email protected]:40073 I0504 18:19:50.973721 2198 master.cpp:1422] Giving framework 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-0000 (default) at [email protected]:40073 0ns to failover I0504 18:19:50.974059 2198 master.cpp:1292] Agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 at slave(1247)@172.17.0.2:40073 (e72e52c70698) disconnected I0504 18:19:50.974115 2198 master.cpp:3361] Disconnecting agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 at slave(1247)@172.17.0.2:40073 (e72e52c70698) I0504 18:19:50.974243 2198 master.cpp:3380] Deactivating agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 at slave(1247)@172.17.0.2:40073 (e72e52c70698) I0504 18:19:50.974437 2202 hierarchical.cpp:1156] Agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 deactivated E0504 18:19:50.974493 2194 http_connection.hpp:449] End-Of-File received I0504 18:19:50.975024 2199 master.cpp:9260] Framework failover timeout, removing framework 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-0000 (default) at [email protected]:40073 I0504 18:19:50.975054 2194 http_connection.hpp:217] Re-detecting endpoint I0504 18:19:50.975077 2199 master.cpp:10276] Removing framework 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-0000 (default) at [email protected]:40073 I0504 18:19:50.975541 2194 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0504 18:19:50.975692 2205 hierarchical.cpp:1777] Allocation paused I0504 18:19:50.975757 2194 http_connection.hpp:227] New endpoint detected at http://172.17.0.2:40073/slave(1247)/api/v1/resource_provider I0504 18:19:50.975798 2206 provider.cpp:488] Disconnected from resource provider manager I0504 18:19:50.975929 2186 status_update_manager_process.hpp:379] Pausing operation status update manager I0504 18:19:50.975948 2194 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0504 18:19:50.976567 2205 hierarchical.cpp:757] Removed framework 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-0000 I0504 18:19:50.976662 2205 hierarchical.cpp:1787] Allocation resumed I0504 18:19:50.977340 2203 containerizer.cpp:2623] Destroying container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE in RUNNING state I0504 18:19:50.977396 2203 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from RUNNING to DESTROYING after 2.738105984secs I0504 18:19:50.977869 2203 launcher.cpp:161] Asked to destroy container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0504 18:19:50.981849 2191 hierarchical.cpp:1853] Performed allocation for 1 agents in 160640ns I0504 18:19:50.982512 2199 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.2:40073/slave(1247)/api/v1/resource_provider I0504 18:19:50.983301 2184 provider.cpp:476] Connected to resource provider manager I0504 18:19:50.984359 2205 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.2:40073/slave(1247)/api/v1/resource_provider I0504 18:19:50.985122 2208 process.cpp:2781] Returning '404 Not Found' for '/slave(1247)/api/v1/resource_provider' E0504 18:19:50.986364 2198 provider.cpp:721] Failed to subscribe resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test': Received '404 Not Found' () I0504 18:19:51.033524 2196 hierarchical.cpp:1853] Performed allocation for 1 agents in 192804ns I0504 18:19:51.085032 2191 containerizer.cpp:3159] Container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE has exited I0504 18:19:51.085383 2192 hierarchical.cpp:1853] Performed allocation for 1 agents in 266819ns I0504 18:19:51.087213 2201 provisioner.cpp:652] Ignoring destroy request for unknown container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0504 18:19:51.091058 2196 container_daemon.cpp:189] Invoking post-stop hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0504 18:19:51.091468 2185 service_manager.cpp:723] Disconnected from endpoint 'unix:///tmp/mesos-csi-ZqvboB/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0504 18:19:51.091807 2197 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0504 18:19:51.095368 2208 process.cpp:2781] Returning '404 Not Found' for '/slave(1247)/api/v1' I0504 18:19:51.109108 2183 master.cpp:1140] Master terminating I0504 18:19:51.109951 2193 hierarchical.cpp:1132] Removed all filters for agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 I0504 18:19:51.109980 2193 hierarchical.cpp:1008] Removed agent 3dfbc6f2-f928-4a58-a2e1-f9498886edc7-S0 [ OK ] CSIVersion/StorageLocalResourceProviderTest.OperatorOperationsWithResourceProviderResources/v1 (2630 ms) [ RUN ] CSIVersion/StorageLocalResourceProviderTest.Update/v0 I0504 18:19:51.126927 2183 cluster.cpp:186] Creating default 'local' authorizer I0504 18:19:51.132762 2196 master.cpp:443] Master 3cc96e9c-0407-4b39-9aaf-2a45b8121214 (e72e52c70698) started on 172.17.0.2:40073 I0504 18:19:51.132795 2196 master.cpp:446] Flags at startup: --acls="" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins" --allocation_interval="50ms" --allocator="hierarchical" --authenticate_agents="true" --authenticate_frameworks="true" --authenticate_http_frameworks="true" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authentication_v0_timeout="15secs" --authenticators="crammd5" --authorizers="local" --credentials="/tmp/94iSa6/credentials" --filter_gpu_resources="true" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_framework_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_operator_event_stream_subscribers="1000" --max_unreachable_tasks_per_framework="1000" --memory_profiling="false" --min_alloca table_resources="cpus:0.01|mem:32" --port="5050" --publish_per_framework_metrics="true" --quiet="false" --recovery_agent_removal_limit="100%" --registry="in_memory" --registry_fetch_timeout="1mins" --registry_gc_interval="15mins" --registry_max_agent_age="2weeks" --registry_max_agent_count="102400" --registry_store_timeout="100secs" --registry_strict="false" --require_agent_domain="false" --role_sorter="drf" --root_submissions="true" --version="false" --webui_dir="/tmp/SRC/build/mesos-1.10.0/_inst/share/mesos/webui" --work_dir="/tmp/94iSa6/master" --zk_session_timeout="10secs" I0504 18:19:51.133224 2196 master.cpp:495] Master only allowing authenticated frameworks to register I0504 18:19:51.133239 2196 master.cpp:501] Master only allowing authenticated agents to register I0504 18:19:51.133255 2196 master.cpp:507] Master only allowing authenticated HTTP frameworks to register I0504 18:19:51.133275 2196 credentials.hpp:37] Loading credentials for authentication from '/tmp/94iSa6/credentials' I0504 18:19:51.133618 2196 master.cpp:551] Using default 'crammd5' authenticator I0504 18:19:51.133864 2196 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readonly' I0504 18:19:51.134133 2196 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readwrite' I0504 18:19:51.134361 2196 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-master-scheduler' I0504 18:19:51.134567 2196 master.cpp:632] Authorization enabled I0504 18:19:51.134923 2186 hierarchical.cpp:567] Initialized hierarchical allocator process I0504 18:19:51.134999 2202 whitelist_watcher.cpp:77] No whitelist given I0504 18:19:51.139504 2207 master.cpp:2165] Elected as the leading master! I0504 18:19:51.139550 2207 master.cpp:1661] Recovering from registrar I0504 18:19:51.139789 2188 registrar.cpp:339] Recovering registrar I0504 18:19:51.140691 2188 registrar.cpp:383] Successfully fetched the registry (0B) in 0ns I0504 18:19:51.140841 2188 registrar.cpp:487] Applied 1 operations in 50973ns; attempting to update the registry I0504 18:19:51.141571 2188 registrar.cpp:544] Successfully updated the registry in 0ns I0504 18:19:51.141713 2188 registrar.cpp:416] Successfully recovered registrar I0504 18:19:51.142262 2192 master.cpp:1814] Recovered 0 agents from the registry (144B); allowing 10mins for agents to reregister I0504 18:19:51.142282 2204 hierarchical.cpp:606] Skipping recovery of hierarchical allocator: nothing to recover W0504 18:19:51.148949 2183 process.cpp:2877] Attempted to spawn already running process [email protected]:40073 I0504 18:19:51.150508 2183 containerizer.cpp:317] Using isolation { environment_secret, posix/cpu, posix/mem, filesystem/posix, network/cni } W0504 18:19:51.151216 2183 backend.cpp:76] Failed to create 'overlay' backend: OverlayBackend requires root privileges W0504 18:19:51.151249 2183 backend.cpp:76] Failed to create 'aufs' backend: AufsBackend requires root privileges W0504 18:19:51.151268 2183 backend.cpp:76] Failed to create 'bind' backend: BindBackend requires root privileges I0504 18:19:51.151304 2183 provisioner.cpp:294] Using default backend 'copy' I0504 18:19:51.154345 2183 cluster.cpp:533] Creating default 'local' authorizer I0504 18:19:51.157217 2206 slave.cpp:279] Mesos agent started on (1248)@172.17.0.2:40073 I0504 18:19:51.157251 2206 slave.cpp:280] Flags at startup: --acls="" --appc_simple_discovery_uri_prefix="http://" --appc_store_dir="/tmp/94iSa6/nS4TRj/store/appc" --authenticate_http_readonly="true" --authenticate_http_readwrite="false" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authentication_timeout_max="1mins" --authentication_timeout_min="5secs" --authorizer="local" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_destroy_timeout="1mins" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="mesos" --credential="/tmp/94iSa6/nS4TRj/credential" --default_role="*" --disallow_sharing_agent_ipc_namespace="false" --disallow_sharing_agent_pid_namespace="false" --disk_profile_adaptor="org_apache_mesos_UriDiskProfileAdaptor" --disk_watch_interval="1mins" --docker="docker" --docker_ignore_runtime="false" --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io" --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/94iSa6/nS4TRj/store/docker" --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume" --docker_volume_chown="false" --enforce_container_disk_quota="false" --executor_registration_timeout="1mins" --executor_reregistration_timeout="2secs" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/94iSa6/nS4TRj/fetch" --fetcher_cache_size="2GB" --fetcher_stall_timeout="1mins" --frameworks_home="/tmp/94iSa6/nS4TRj/frameworks" --gc_delay="1weeks" --gc_disk_headroom="0.1" --gc_non_executor_container_sandboxes="false" --help="false" --hostname_lookup="true" --http_command_executor="false" --http_credentials="/tmp/94iSa6/nS4TRj/http_credentials" --http_executor_domain_sockets="false" --http_heartbeat_interval="30secs" --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem" --launcher="posi x" --launcher_dir="/tmp/SRC/build/mesos-1.10.0/_build/sub/src" --logbufsecs="0" --logging_level="INFO" --max_completed_executors_per_framework="150" --memory_profiling="false" --network_cni_metrics="true" --network_cni_root_dir_persist="false" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns" --quiet="false" --reconfiguration_policy="equal" --recover="reconnect" --recovery_timeout="15mins" --registration_backoff_factor="10ms" --resource_provider_config_dir="/tmp/94iSa6/resource_provider_configs" --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]" --revocable_cpu_low_priority="true" --runtime_dir="/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_ykKKEv" --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true" --systemd_enable_support="true" --systemd_runtime_directory="/run/systemd/system" --version="false" --work_dir="/tmp/CSIVersion_StorageLoca lResourceProviderTest_Update_v0_T7gMxI" --zk_session_timeout="10secs" I0504 18:19:51.157999 2206 credentials.hpp:86] Loading credential for authentication from '/tmp/94iSa6/nS4TRj/credential' I0504 18:19:51.158150 2206 slave.cpp:312] Agent using credential for: test-principal I0504 18:19:51.158176 2206 credentials.hpp:37] Loading credentials for authentication from '/tmp/94iSa6/nS4TRj/http_credentials' I0504 18:19:51.158368 2206 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-agent-readonly' I0504 18:19:51.158723 2206 disk_profile_adaptor.cpp:82] Creating disk profile adaptor module 'org_apache_mesos_UriDiskProfileAdaptor' I0504 18:19:51.160535 2199 uri_disk_profile_adaptor.cpp:305] Updated disk profile mapping to 1 active profiles I0504 18:19:51.160531 2206 slave.cpp:627] Agent resources: [{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}] I0504 18:19:51.160768 2206 slave.cpp:635] Agent attributes: [ ] I0504 18:19:51.160792 2206 slave.cpp:644] Agent hostname: e72e52c70698 I0504 18:19:51.160962 2190 status_update_manager_process.hpp:379] Pausing operation status update manager I0504 18:19:51.160969 2207 task_status_update_manager.cpp:181] Pausing sending task status updates I0504 18:19:51.162600 2193 hierarchical.cpp:1853] Performed allocation for 0 agents in 97429ns I0504 18:19:51.162868 2187 state.cpp:68] Recovering state from '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_T7gMxI/meta' I0504 18:19:51.163162 2195 slave.cpp:7723] Finished recovering checkpointed state from '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_T7gMxI/meta', beginning agent recovery I0504 18:19:51.163939 2205 task_status_update_manager.cpp:207] Recovering task status update manager I0504 18:19:51.164559 2189 containerizer.cpp:822] Recovering Mesos containers I0504 18:19:51.164970 2189 containerizer.cpp:1162] Recovering isolators I0504 18:19:51.166019 2197 containerizer.cpp:1201] Recovering provisioner I0504 18:19:51.166960 2207 provisioner.cpp:518] Provisioner recovery complete I0504 18:19:51.168076 2188 composing.cpp:343] Finished recovering all containerizers I0504 18:19:51.168506 2198 slave.cpp:8205] Recovering executors I0504 18:19:51.168673 2198 slave.cpp:8358] Finished recovery I0504 18:19:51.169904 2186 status_update_manager_process.hpp:379] Pausing operation status update manager I0504 18:19:51.169931 2198 slave.cpp:1471] New master detected at [email protected]:40073 I0504 18:19:51.169901 2194 task_status_update_manager.cpp:181] Pausing sending task status updates I0504 18:19:51.170048 2198 slave.cpp:1536] Detecting new master I0504 18:19:51.176975 2200 slave.cpp:1563] Authenticating with master [email protected]:40073 I0504 18:19:51.177117 2200 slave.cpp:1572] Using default CRAM-MD5 authenticatee I0504 18:19:51.177527 2190 authenticatee.cpp:121] Creating new client SASL connection I0504 18:19:51.177965 2199 master.cpp:9667] Authenticating slave(1248)@172.17.0.2:40073 I0504 18:19:51.178155 2202 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(2110)@172.17.0.2:40073 I0504 18:19:51.178591 2203 authenticator.cpp:98] Creating new server SASL connection I0504 18:19:51.178880 2207 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 I0504 18:19:51.178930 2207 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' I0504 18:19:51.179145 2193 authenticator.cpp:204] Received SASL authentication start I0504 18:19:51.179265 2193 authenticator.cpp:326] Authentication requires more steps I0504 18:19:51.179493 2206 authenticatee.cpp:259] Received SASL authentication step I0504 18:19:51.179740 2206 authenticator.cpp:232] Received SASL authentication step I0504 18:19:51.179811 2206 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'e72e52c70698' server FQDN: 'e72e52c70698' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false I0504 18:19:51.179837 2206 auxprop.cpp:181] Looking up auxiliary property '*userPassword' I0504 18:19:51.179903 2206 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' I0504 18:19:51.179945 2206 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'e72e52c70698' server FQDN: 'e72e52c70698' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true I0504 18:19:51.179963 2206 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true I0504 18:19:51.179985 2206 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true I0504 18:19:51.180008 2206 authenticator.cpp:318] Authentication success I0504 18:19:51.180148 2201 authenticatee.cpp:299] Authentication success I0504 18:19:51.180260 2187 master.cpp:9699] Successfully authenticated principal 'test-principal' at slave(1248)@172.17.0.2:40073 I0504 18:19:51.180315 2195 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(2110)@172.17.0.2:40073 I0504 18:19:51.180766 2205 slave.cpp:1663] Successfully authenticated with master [email protected]:40073 I0504 18:19:51.181445 2205 slave.cpp:2113] Will retry registration in 13.082707ms if necessary I0504 18:19:51.181722 2184 master.cpp:6162] Received register agent message from slave(1248)@172.17.0.2:40073 (e72e52c70698) I0504 18:19:51.182322 2184 master.cpp:3693] Authorizing principal 'test-principal' to perform action REGISTER_AGENT on ANY object I0504 18:19:51.183286 2196 master.cpp:6229] Authorized registration of agent at slave(1248)@172.17.0.2:40073 (e72e52c70698) I0504 18:19:51.183475 2196 master.cpp:6341] Registering agent at slave(1248)@172.17.0.2:40073 (e72e52c70698) with id 3cc96e9c-0407-4b39-9aaf-2a45b8121214-S0 I0504 18:19:51.184459 2197 registrar.cpp:487] Applied 1 operations in 332846ns; attempting to update the registry I0504 18:19:51.185412 2197 registrar.cpp:544] Successfully updated the registry in 844800ns I0504 18:19:51.185660 2203 master.cpp:6389] Admitted agent 3cc96e9c-0407-4b39-9aaf-2a45b8121214-S0 at slave(1248)@172.17.0.2:40073 (e72e52c70698) I0504 18:19:51.186723 2203 master.cpp:6434] Registered agent 3cc96e9c-0407-4b39-9aaf-2a45b8121214-S0 at slave(1248)@172.17.0.2:40073 (e72e52c70698) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0504 18:19:51.186890 2193 slave.cpp:1696] Registered with master [email protected]:40073; given agent ID 3cc96e9c-0407-4b39-9aaf-2a45b8121214-S0 I0504 18:19:51.187031 2207 hierarchical.cpp:959] Added agent 3cc96e9c-0407-4b39-9aaf-2a45b8121214-S0 (e72e52c70698) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] (offered or allocated: {}) I0504 18:19:51.187121 2187 task_status_update_manager.cpp:188] Resuming sending task status updates I0504 18:19:51.187633 2207 hierarchical.cpp:1853] Performed allocation for 1 agents in 264760ns I0504 18:19:51.187656 2193 slave.cpp:1731] Checkpointing SlaveInfo to '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_T7gMxI/meta/slaves/3cc96e9c-0407-4b39-9aaf-2a45b8121214-S0/slave.info' I0504 18:19:51.187763 2192 status_update_manager_process.hpp:385] Resuming operation status update manager I0504 18:19:51.189529 2193 slave.cpp:1783] Forwarding agent update {"operations":{},"resource_providers":{},"resource_version_uuid":{"value":"2e1cviWQQOOzHrD1Jn/U3w=="},"slave_id":{"value":"3cc96e9c-0407-4b39-9aaf-2a45b8121214-S0"},"update_oversubscribed_resources":false} I0504 18:19:51.190490 2194 master.cpp:7575] Ignoring update on agent 3cc96e9c-0407-4b39-9aaf-2a45b8121214-S0 at slave(1248)@172.17.0.2:40073 (e72e52c70698) as it reports no changes I0504 18:19:51.196298 2202 process.cpp:3671] Handling HTTP event for process 'slave(1248)' with path: '/slave(1248)/api/v1' I0504 18:19:51.198040 2192 http.cpp:1436] HTTP POST for /slave(1248)/api/v1 from 172.17.0.2:38802 I0504 18:19:51.198668 2192 http.cpp:2828] Processing GET_CONTAINERS call I0504 18:19:51.207010 2191 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0504 18:19:51.210368 2187 process.cpp:3671] Handling HTTP event for process 'slave(1248)' with path: '/slave(1248)/api/v1' I0504 18:19:51.211779 2185 http.cpp:1436] HTTP POST for /slave(1248)/api/v1 from 172.17.0.2:38804 I0504 18:19:51.212711 2185 http.cpp:3289] Processing LAUNCH_CONTAINER call for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0504 18:19:51.213717 2193 hierarchical.cpp:1853] Performed allocation for 1 agents in 231880ns I0504 18:19:51.214417 2188 http.cpp:3399] Creating sandbox '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_T7gMxI/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0504 18:19:51.215610 2196 containerizer.cpp:1397] Starting container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0504 18:19:51.216598 2196 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from STARTING to PROVISIONING after 382976ns I0504 18:19:51.217959 2196 containerizer.cpp:1575] Checkpointed ContainerConfig at '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_ykKKEv/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE/config' I0504 18:19:51.218042 2196 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from PROVISIONING to PREPARING after 1.447168ms I0504 18:19:51.222456 2191 containerizer.cpp:2101] Launching 'mesos-containerizer' with flags '--help="false" --launch_info="{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v0","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_SHnEkU","--available_capacity=0B","--volumes=","--forward=unix:///tmp/94iSa6/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"environment":{"variables":[{"name":"MESOS_SANDBOX","type":"VALUE","value":"/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_T7gMxI/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE"},{"name":"CSI_ENDPOINT","type":"VALUE","value":"unix:///tmp/mesos-csi-duMX8y/endpoint.sock"}]},"task_environment":{},"working_directory":"/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_T7gMxI/containers/o rg-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE"}" --pipe_read="110" --pipe_write="111" --runtime_directory="/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_ykKKEv/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE" --unshare_namespace_mnt="false"' I0504 18:19:51.237167 2191 launcher.cpp:145] Forked child with pid '16758' for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0504 18:19:51.238137 2191 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from PREPARING to ISOLATING after 20.089856ms I0504 18:19:51.239562 2191 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from ISOLATING to FETCHING after 1.432064ms I0504 18:19:51.239893 2184 fetcher.cpp:369] Starting to fetch URIs for container: org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE, directory: /tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_T7gMxI/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0504 18:19:51.241264 2193 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from FETCHING to RUNNING after 1.604096ms I0504 18:19:51.245787 2199 container_daemon.cpp:140] Invoking post-start hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0504 18:19:51.246083 2189 service_manager.cpp:703] Connecting to endpoint 'unix:///tmp/mesos-csi-duMX8y/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0504 18:19:51.265272 2206 hierarchical.cpp:1853] Performed allocation for 1 agents in 277012ns I0504 18:19:51.316578 2191 hierarchical.cpp:1853] Performed allocation for 1 agents in 173460ns I0504 18:19:51.368160 2198 hierarchical.cpp:1853] Performed allocation for 1 agents in 224825ns I0504 18:19:51.419787 2203 hierarchical.cpp:1853] Performed allocation for 1 agents in 196490ns I0504 18:19:51.470963 2195 hierarchical.cpp:1853] Performed allocation for 1 agents in 246236ns I0504 18:19:51.522469 2188 hierarchical.cpp:1853] Performed allocation for 1 agents in 249471ns I0504 18:19:51.574324 2200 hierarchical.cpp:1853] Performed allocation for 1 agents in 206052ns I0504 18:19:51.625877 2206 hierarchical.cpp:1853] Performed allocation for 1 agents in 193464ns I0504 18:19:51.672427 2194 service_manager.cpp:545] Probing endpoint 'unix:///tmp/mesos-csi-duMX8y/endpoint.sock' with CSI v1 I0504 18:19:51.675966 2193 service_manager.cpp:532] Probing endpoint 'unix:///tmp/mesos-csi-duMX8y/endpoint.sock' with CSI v0 I0504 18:19:51.676779 2188 hierarchical.cpp:1853] Performed allocation for 1 agents in 160374ns I0504 18:19:51.677772 16762 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Identity/Probe call I0504 18:19:51.681839 2198 container_daemon.cpp:171] Waiting for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0504 18:19:51.685081 16762 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Identity/GetPluginCapabilities call I0504 18:19:51.687243 2201 process.cpp:3671] Handling HTTP event for process 'slave(1248)' with path: '/slave(1248)/api/v1' I0504 18:19:51.689080 2193 http.cpp:1436] HTTP POST for /slave(1248)/api/v1 from 172.17.0.2:38806 I0504 18:19:51.689903 2193 http.cpp:3513] Processing WAIT_CONTAINER call for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0504 18:19:51.690932 16762 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Identity/GetPluginInfo call I0504 18:19:51.691458 16762 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Identity/GetPluginInfo call I0504 18:19:51.693887 2197 v0_volume_manager.cpp:628] NODE_SERVICE loaded: {} I0504 18:19:51.694593 2197 v0_volume_manager.cpp:628] CONTROLLER_SERVICE loaded: {} I0504 18:19:51.697860 16762 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/ControllerGetCapabilities call I0504 18:19:51.703038 16762 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Node/NodeGetCapabilities call I0504 18:19:51.707803 16762 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Node/NodeGetId call I0504 18:19:51.711153 2200 provider.cpp:676] Recovered resources '{}' and 0 operations for resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test' I0504 18:19:51.711434 2190 status_update_manager_process.hpp:379] Pausing operation status update manager I0504 18:19:51.711971 2198 http_connection.hpp:227] New endpoint detected at http://172.17.0.2:40073/slave(1248)/api/v1/resource_provider I0504 18:19:51.716262 2203 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.2:40073/slave(1248)/api/v1/resource_provider I0504 18:19:51.717293 2191 provider.cpp:476] Connected to resource provider manager I0504 18:19:51.718278 2185 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.2:40073/slave(1248)/api/v1/resource_provider I0504 18:19:51.720052 2193 process.cpp:3671] Handling HTTP event for process 'slave(1248)' with path: '/slave(1248)/api/v1/resource_provider' I0504 18:19:51.722714 2200 http.cpp:1436] HTTP POST for /slave(1248)/api/v1/resource_provider from 172.17.0.2:38810 I0504 18:19:51.723867 2199 manager.cpp:779] Subscribing resource provider {"default_reservations":[{"role":"storage","type":"DYNAMIC"}],"name":"test","storage":{"plugin":{"containers":[{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v0","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_SHnEkU","--available_capacity=0B","--volumes=","--forward=unix:///tmp/94iSa6/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"resources":[{"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"}],"services":["CONTROLLER_SERVICE","NODE_SERVICE"]}],"name":"local","type":"org.apache.mesos.csi.test"},"reconciliation_interval_seconds":15.0},"type":"org.apache.mesos.rp.local.storage"} I0504 18:19:51.728936 2187 hierarchical.cpp:1853] Performed allocation for 1 agents in 286816ns I0504 18:19:51.758105 2203 slave.cpp:8714] Handling resource provider message 'SUBSCRIBE: {"default_reservations":[{"role":"storage","type":"DYNAMIC"}],"id":{"value":"f2b7d66f-9373-4ccb-be04-472d95f1d541"},"name":"test","storage":{"plugin":{"containers":[{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v0","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_SHnEkU","--available_capacity=0B","--volumes=","--forward=unix:///tmp/94iSa6/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"resources":[{"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"}],"services":["CONTROLLER_SERVICE","NODE_SERVICE"]}],"name":"local","type":"org.apache.mesos.csi.test"},"reconciliation_interval_seconds":15.0},"type":"org.apache.mesos.rp.local.storage"}' I0504 18:19:51.760344 2193 provider.cpp:498] Received SUBSCRIBED event I0504 18:19:51.760407 2193 provider.cpp:1309] Subscribed with ID f2b7d66f-9373-4ccb-be04-472d95f1d541 I0504 18:19:51.761330 2186 status_update_manager_process.hpp:314] Recovering operation status update manager I0504 18:19:51.780592 2199 hierarchical.cpp:1853] Performed allocation for 1 agents in 202718ns I0504 18:19:51.815898 2190 provider.cpp:790] Reconciling storage pools and volumes I0504 18:19:51.819016 16762 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/ListVolumes call I0504 18:19:51.823168 2205 provider.cpp:2217] Sending UPDATE_STATE call with resources '{}' and 0 operations to agent 3cc96e9c-0407-4b39-9aaf-2a45b8121214-S0 I0504 18:19:51.823599 2204 http_connection.hpp:131] Sending UPDATE_STATE call to http://172.17.0.2:40073/slave(1248)/api/v1/resource_provider I0504 18:19:51.823665 2205 provider.cpp:748] Resource provider f2b7d66f-9373-4ccb-be04-472d95f1d541 is in READY state I0504 18:19:51.823715 2193 status_update_manager_process.hpp:385] Resuming operation status update manager I0504 18:19:51.824486 2199 provider.cpp:1235] Updating profiles { test } for resource provider f2b7d66f-9373-4ccb-be04-472d95f1d541 I0504 18:19:51.825143 2207 process.cpp:3671] Handling HTTP event for process 'slave(1248)' with path: '/slave(1248)/api/v1/resource_provider' I0504 18:19:51.826185 2195 provider.cpp:790] Reconciling storage pools and volumes I0504 18:19:51.826961 2184 http.cpp:1436] HTTP POST for /slave(1248)/api/v1/resource_provider from 172.17.0.2:38808 I0504 18:19:51.827571 2193 manager.cpp:1011] Received UPDATE_STATE call with resources '[]' and 0 operations from resource provider f2b7d66f-9373-4ccb-be04-472d95f1d541 I0504 18:19:51.827828 2199 slave.cpp:8714] Handling resource provider message 'UPDATE_STATE: f2b7d66f-9373-4ccb-be04-472d95f1d541 {}' I0504 18:19:51.827973 2199 slave.cpp:8834] Forwarding new total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0504 18:19:51.828737 16762 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/ListVolumes call I0504 18:19:51.829203 16762 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/GetCapacity call I0504 18:19:51.830101 2207 hierarchical.cpp:1110] Grew agent 3cc96e9c-0407-4b39-9aaf-2a45b8121214-S0 by {} (total), { } (used) I0504 18:19:51.830677 2207 hierarchical.cpp:1067] Agent 3cc96e9c-0407-4b39-9aaf-2a45b8121214-S0 (e72e52c70698) updated with total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0504 18:19:51.836791 2200 hierarchical.cpp:1853] Performed allocation for 1 agents in 163939ns I0504 18:19:51.837651 2206 provider.cpp:790] Reconciling storage pools and volumes I0504 18:19:51.839972 16762 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/ListVolumes call I0504 18:19:51.840430 16762 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/GetCapacity call I0504 18:19:51.850466 2191 slave.cpp:1000] Agent terminating I0504 18:19:51.851539 2191 manager.cpp:127] Terminating resource provider f2b7d66f-9373-4ccb-be04-472d95f1d541 I0504 18:19:51.852075 2198 master.cpp:1292] Agent 3cc96e9c-0407-4b39-9aaf-2a45b8121214-S0 at slave(1248)@172.17.0.2:40073 (e72e52c70698) disconnected I0504 18:19:51.852124 2198 master.cpp:3361] Disconnecting agent 3cc96e9c-0407-4b39-9aaf-2a45b8121214-S0 at slave(1248)@172.17.0.2:40073 (e72e52c70698) I0504 18:19:51.852221 2198 master.cpp:3380] Deactivating agent 3cc96e9c-0407-4b39-9aaf-2a45b8121214-S0 at slave(1248)@172.17.0.2:40073 (e72e52c70698) I0504 18:19:51.852403 2197 hierarchical.cpp:1156] Agent 3cc96e9c-0407-4b39-9aaf-2a45b8121214-S0 deactivated E0504 18:19:51.852792 2187 http_connection.hpp:449] End-Of-File received I0504 18:19:51.853422 2187 http_connection.hpp:217] Re-detecting endpoint I0504 18:19:51.853965 2187 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0504 18:19:51.854072 2187 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0504 18:19:51.854122 2189 provider.cpp:488] Disconnected from resource provider manager I0504 18:19:51.854192 2187 http_connection.hpp:227] New endpoint detected at http://172.17.0.2:40073/slave(1248)/api/v1/resource_provider I0504 18:19:51.854295 2206 status_update_manager_process.hpp:379] Pausing operation status update manager I0504 18:19:51.856047 2186 containerizer.cpp:2623] Destroying container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE in RUNNING state I0504 18:19:51.856127 2186 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from RUNNING to DESTROYING after 15.614962176secs I0504 18:19:51.856689 2186 launcher.cpp:161] Asked to destroy container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0504 18:19:51.858637 2199 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.2:40073/slave(1248)/api/v1/resource_provider I0504 18:19:51.859468 2202 provider.cpp:476] Connected to resource provider manager I0504 18:19:51.860257 2189 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.2:40073/slave(1248)/api/v1/resource_provider I0504 18:19:51.861369 2208 process.cpp:2781] Returning '404 Not Found' for '/slave(1248)/api/v1/resource_provider' E0504 18:19:51.863451 2187 provider.cpp:721] Failed to subscribe resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test': Received '404 Not Found' () I0504 18:19:51.881266 2193 hierarchical.cpp:1853] Performed allocation for 1 agents in 150250ns I0504 18:19:51.933197 2203 hierarchical.cpp:1853] Performed allocation for 1 agents in 157770ns I0504 18:19:51.933287 2198 containerizer.cpp:3159] Container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE has exited I0504 18:19:51.935865 2201 provisioner.cpp:652] Ignoring destroy request for unknown container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0504 18:19:51.939671 2207 container_daemon.cpp:189] Invoking post-stop hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0504 18:19:51.940093 2195 service_manager.cpp:723] Disconnected from endpoint 'unix:///tmp/mesos-csi-duMX8y/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0504 18:19:51.940431 2192 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0504 18:19:51.943817 2208 process.cpp:2781] Returning '404 Not Found' for '/slave(1248)/api/v1' I0504 18:19:51.956864 2183 master.cpp:1140] Master terminating I0504 18:19:51.957212 2196 hierarchical.cpp:1132] Removed all filters for agent 3cc96e9c-0407-4b39-9aaf-2a45b8121214-S0 I0504 18:19:51.957242 2196 hierarchical.cpp:1008] Removed agent 3cc96e9c-0407-4b39-9aaf-2a45b8121214-S0 [ OK ] CSIVersion/StorageLocalResourceProviderTest.Update/v0 (846 ms) [ RUN ] CSIVersion/StorageLocalResourceProviderTest.Update/v1 I0504 18:19:51.974093 2183 cluster.cpp:186] Creating default 'local' authorizer I0504 18:19:51.979683 2201 master.cpp:443] Master f797e8a2-1395-4eb8-aa3b-697910672397 (e72e52c70698) started on 172.17.0.2:40073 I0504 18:19:51.979737 2201 master.cpp:446] Flags at startup: --acls="" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins" --allocation_interval="50ms" --allocator="hierarchical" --authenticate_agents="true" --authenticate_frameworks="true" --authenticate_http_frameworks="true" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authentication_v0_timeout="15secs" --authenticators="crammd5" --authorizers="local" --credentials="/tmp/ylZUpu/credentials" --filter_gpu_resources="true" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_framework_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_operator_event_stream_subscribers="1000" --max_unreachable_tasks_per_framework="1000" --memory_profiling="false" --min_alloca table_resources="cpus:0.01|mem:32" --port="5050" --publish_per_framework_metrics="true" --quiet="false" --recovery_agent_removal_limit="100%" --registry="in_memory" --registry_fetch_timeout="1mins" --registry_gc_interval="15mins" --registry_max_agent_age="2weeks" --registry_max_agent_count="102400" --registry_store_timeout="100secs" --registry_strict="false" --require_agent_domain="false" --role_sorter="drf" --root_submissions="true" --version="false" --webui_dir="/tmp/SRC/build/mesos-1.10.0/_inst/share/mesos/webui" --work_dir="/tmp/ylZUpu/master" --zk_session_timeout="10secs" I0504 18:19:51.980507 2201 master.cpp:495] Master only allowing authenticated frameworks to register I0504 18:19:51.980538 2201 master.cpp:501] Master only allowing authenticated agents to register I0504 18:19:51.980557 2201 master.cpp:507] Master only allowing authenticated HTTP frameworks to register I0504 18:19:51.980588 2201 credentials.hpp:37] Loading credentials for authentication from '/tmp/ylZUpu/credentials' I0504 18:19:51.981104 2201 master.cpp:551] Using default 'crammd5' authenticator I0504 18:19:51.981503 2201 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readonly' I0504 18:19:51.981920 2201 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readwrite' I0504 18:19:51.982277 2201 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-master-scheduler' I0504 18:19:51.982620 2201 master.cpp:632] Authorization enabled I0504 18:19:51.983242 2197 hierarchical.cpp:567] Initialized hierarchical allocator process I0504 18:19:51.983310 2206 whitelist_watcher.cpp:77] No whitelist given I0504 18:19:51.987838 2192 master.cpp:2165] Elected as the leading master! I0504 18:19:51.987876 2192 master.cpp:1661] Recovering from registrar I0504 18:19:51.988075 2189 registrar.cpp:339] Recovering registrar I0504 18:19:51.988929 2189 registrar.cpp:383] Successfully fetched the registry (0B) in 0ns I0504 18:19:51.989094 2189 registrar.cpp:487] Applied 1 operations in 58329ns; attempting to update the registry I0504 18:19:51.989943 2189 registrar.cpp:544] Successfully updated the registry in 0ns I0504 18:19:51.990100 2189 registrar.cpp:416] Successfully recovered registrar I0504 18:19:51.990571 2205 master.cpp:1814] Recovered 0 agents from the registry (144B); allowing 10mins for agents to reregister I0504 18:19:51.990605 2199 hierarchical.cpp:606] Skipping recovery of hierarchical allocator: nothing to recover W0504 18:19:51.997443 2183 process.cpp:2877] Attempted to spawn already running process [email protected]:40073 I0504 18:19:51.999020 2183 containerizer.cpp:317] Using isolation { environment_secret, posix/cpu, posix/mem, filesystem/posix, network/cni } W0504 18:19:51.999758 2183 backend.cpp:76] Failed to create 'overlay' backend: OverlayBackend requires root privileges W0504 18:19:51.999802 2183 backend.cpp:76] Failed to create 'aufs' backend: AufsBackend requires root privileges W0504 18:19:51.999837 2183 backend.cpp:76] Failed to create 'bind' backend: BindBackend requires root privileges I0504 18:19:51.999893 2183 provisioner.cpp:294] Using default backend 'copy' I0504 18:19:52.002923 2183 cluster.cpp:533] Creating default 'local' authorizer I0504 18:19:52.005652 2206 slave.cpp:279] Mesos agent started on (1249)@172.17.0.2:40073 I0504 18:19:52.005682 2206 slave.cpp:280] Flags at startup: --acls="" --appc_simple_discovery_uri_prefix="http://" --appc_store_dir="/tmp/ylZUpu/O9i4XQ/store/appc" --authenticate_http_readonly="true" --authenticate_http_readwrite="false" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authentication_timeout_max="1mins" --authentication_timeout_min="5secs" --authorizer="local" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_destroy_timeout="1mins" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="mesos" --credential="/tmp/ylZUpu/O9i4XQ/credential" --default_role="*" --disallow_sharing_agent_ipc_namespace="false" --disallow_sharing_agent_pid_namespace="false" --disk_profile_adaptor="org_apache_mesos_UriDiskProfileAdaptor" --disk_watch_interval="1mins" --docker="docker" --docker_ignore_runtime="false" --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io" --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/ylZUpu/O9i4XQ/store/docker" --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume" --docker_volume_chown="false" --enforce_container_disk_quota="false" --executor_registration_timeout="1mins" --executor_reregistration_timeout="2secs" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/ylZUpu/O9i4XQ/fetch" --fetcher_cache_size="2GB" --fetcher_stall_timeout="1mins" --frameworks_home="/tmp/ylZUpu/O9i4XQ/frameworks" --gc_delay="1weeks" --gc_disk_headroom="0.1" --gc_non_executor_container_sandboxes="false" --help="false" --hostname_lookup="true" --http_command_executor="false" --http_credentials="/tmp/ylZUpu/O9i4XQ/http_credentials" --http_executor_domain_sockets="false" --http_heartbeat_interval="30secs" --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem" --launcher="posi x" --launcher_dir="/tmp/SRC/build/mesos-1.10.0/_build/sub/src" --logbufsecs="0" --logging_level="INFO" --max_completed_executors_per_framework="150" --memory_profiling="false" --network_cni_metrics="true" --network_cni_root_dir_persist="false" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns" --quiet="false" --reconfiguration_policy="equal" --recover="reconnect" --recovery_timeout="15mins" --registration_backoff_factor="10ms" --resource_provider_config_dir="/tmp/ylZUpu/resource_provider_configs" --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]" --revocable_cpu_low_priority="true" --runtime_dir="/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_hO2DO0" --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true" --systemd_enable_support="true" --systemd_runtime_directory="/run/systemd/system" --version="false" --work_dir="/tmp/CSIVersion_StorageLoca lResourceProviderTest_Update_v1_gJleFa" --zk_session_timeout="10secs" I0504 18:19:52.006251 2206 credentials.hpp:86] Loading credential for authentication from '/tmp/ylZUpu/O9i4XQ/credential' I0504 18:19:52.006448 2206 slave.cpp:312] Agent using credential for: test-principal I0504 18:19:52.006474 2206 credentials.hpp:37] Loading credentials for authentication from '/tmp/ylZUpu/O9i4XQ/http_credentials' I0504 18:19:52.006688 2206 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-agent-readonly' I0504 18:19:52.007092 2206 disk_profile_adaptor.cpp:82] Creating disk profile adaptor module 'org_apache_mesos_UriDiskProfileAdaptor' I0504 18:19:52.008850 2200 uri_disk_profile_adaptor.cpp:305] Updated disk profile mapping to 1 active profiles I0504 18:19:52.008875 2206 slave.cpp:627] Agent resources: [{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}] I0504 18:19:52.009162 2206 slave.cpp:635] Agent attributes: [ ] I0504 18:19:52.009188 2206 slave.cpp:644] Agent hostname: e72e52c70698 I0504 18:19:52.009383 2192 status_update_manager_process.hpp:379] Pausing operation status update manager I0504 18:19:52.009407 2194 task_status_update_manager.cpp:181] Pausing sending task status updates I0504 18:19:52.010188 2202 hierarchical.cpp:1853] Performed allocation for 0 agents in 119272ns I0504 18:19:52.011744 2191 state.cpp:68] Recovering state from '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_gJleFa/meta' I0504 18:19:52.012032 2184 slave.cpp:7723] Finished recovering checkpointed state from '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_gJleFa/meta', beginning agent recovery I0504 18:19:52.012857 2186 task_status_update_manager.cpp:207] Recovering task status update manager I0504 18:19:52.013370 2205 containerizer.cpp:822] Recovering Mesos containers I0504 18:19:52.013828 2205 containerizer.cpp:1162] Recovering isolators I0504 18:19:52.014952 2192 containerizer.cpp:1201] Recovering provisioner I0504 18:19:52.015966 2196 provisioner.cpp:518] Provisioner recovery complete I0504 18:19:52.016896 2198 composing.cpp:343] Finished recovering all containerizers I0504 18:19:52.017302 2195 slave.cpp:8205] Recovering executors I0504 18:19:52.017463 2195 slave.cpp:8358] Finished recovery I0504 18:19:52.018517 2203 task_status_update_manager.cpp:181] Pausing sending task status updates I0504 18:19:52.018563 2207 status_update_manager_process.hpp:379] Pausing operation status update manager I0504 18:19:52.018606 2190 slave.cpp:1471] New master detected at [email protected]:40073 I0504 18:19:52.018707 2190 slave.cpp:1536] Detecting new master I0504 18:19:52.027631 2199 slave.cpp:1563] Authenticating with master [email protected]:40073 I0504 18:19:52.027773 2199 slave.cpp:1572] Using default CRAM-MD5 authenticatee I0504 18:19:52.028237 2202 authenticatee.cpp:121] Creating new client SASL connection I0504 18:19:52.028661 2192 master.cpp:9667] Authenticating slave(1249)@172.17.0.2:40073 I0504 18:19:52.028904 2200 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(2111)@172.17.0.2:40073 I0504 18:19:52.029386 2196 authenticator.cpp:98] Creating new server SASL connection I0504 18:19:52.029775 2187 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 I0504 18:19:52.029826 2187 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' I0504 18:19:52.030021 2188 authenticator.cpp:204] Received SASL authentication start I0504 18:19:52.030120 2188 authenticator.cpp:326] Authentication requires more steps I0504 18:19:52.030277 2188 authenticatee.cpp:259] Received SASL authentication step I0504 18:19:52.030463 2191 authenticator.cpp:232] Received SASL authentication step I0504 18:19:52.030534 2191 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'e72e52c70698' server FQDN: 'e72e52c70698' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false I0504 18:19:52.030565 2191 auxprop.cpp:181] Looking up auxiliary property '*userPassword' I0504 18:19:52.030633 2191 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' I0504 18:19:52.030679 2191 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'e72e52c70698' server FQDN: 'e72e52c70698' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true I0504 18:19:52.030714 2191 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true I0504 18:19:52.030731 2191 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true I0504 18:19:52.030758 2191 authenticator.cpp:318] Authentication success I0504 18:19:52.030942 2204 authenticatee.cpp:299] Authentication success I0504 18:19:52.031054 2184 master.cpp:9699] Successfully authenticated principal 'test-principal' at slave(1249)@172.17.0.2:40073 I0504 18:19:52.031121 2189 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(2111)@172.17.0.2:40073 I0504 18:19:52.031620 2191 slave.cpp:1663] Successfully authenticated with master [email protected]:40073 I0504 18:19:52.032248 2191 slave.cpp:2113] Will retry registration in 6.698483ms if necessary I0504 18:19:52.032516 2193 master.cpp:6162] Received register agent message from slave(1249)@172.17.0.2:40073 (e72e52c70698) I0504 18:19:52.033068 2193 master.cpp:3693] Authorizing principal 'test-principal' to perform action REGISTER_AGENT on ANY object I0504 18:19:52.033901 2201 master.cpp:6229] Authorized registration of agent at slave(1249)@172.17.0.2:40073 (e72e52c70698) I0504 18:19:52.034060 2201 master.cpp:6341] Registering agent at slave(1249)@172.17.0.2:40073 (e72e52c70698) with id f797e8a2-1395-4eb8-aa3b-697910672397-S0 I0504 18:19:52.035152 2194 registrar.cpp:487] Applied 1 operations in 429651ns; attempting to update the registry I0504 18:19:52.036197 2194 registrar.cpp:544] Successfully updated the registry in 948736ns I0504 18:19:52.036501 2196 master.cpp:6389] Admitted agent f797e8a2-1395-4eb8-aa3b-697910672397-S0 at slave(1249)@172.17.0.2:40073 (e72e52c70698) I0504 18:19:52.037694 2196 master.cpp:6434] Registered agent f797e8a2-1395-4eb8-aa3b-697910672397-S0 at slave(1249)@172.17.0.2:40073 (e72e52c70698) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0504 18:19:52.037802 2206 slave.cpp:1696] Registered with master [email protected]:40073; given agent ID f797e8a2-1395-4eb8-aa3b-697910672397-S0 I0504 18:19:52.038050 2185 task_status_update_manager.cpp:188] Resuming sending task status updates I0504 18:19:52.038017 2187 hierarchical.cpp:959] Added agent f797e8a2-1395-4eb8-aa3b-697910672397-S0 (e72e52c70698) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] (offered or allocated: {}) I0504 18:19:52.038662 2206 slave.cpp:1731] Checkpointing SlaveInfo to '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_gJleFa/meta/slaves/f797e8a2-1395-4eb8-aa3b-697910672397-S0/slave.info' I0504 18:19:52.038671 2187 hierarchical.cpp:1853] Performed allocation for 1 agents in 292773ns I0504 18:19:52.038756 2198 status_update_manager_process.hpp:385] Resuming operation status update manager I0504 18:19:52.040483 2206 slave.cpp:1783] Forwarding agent update {"operations":{},"resource_providers":{},"resource_version_uuid":{"value":"wnWFJGAFRVOT66tdiYLQgQ=="},"slave_id":{"value":"f797e8a2-1395-4eb8-aa3b-697910672397-S0"},"update_oversubscribed_resources":false} I0504 18:19:52.041939 2207 master.cpp:7575] Ignoring update on agent f797e8a2-1395-4eb8-aa3b-697910672397-S0 at slave(1249)@172.17.0.2:40073 (e72e52c70698) as it reports no changes I0504 18:19:52.046325 2200 process.cpp:3671] Handling HTTP event for process 'slave(1249)' with path: '/slave(1249)/api/v1' I0504 18:19:52.048025 2187 http.cpp:1436] HTTP POST for /slave(1249)/api/v1 from 172.17.0.2:38818 I0504 18:19:52.048619 2187 http.cpp:2828] Processing GET_CONTAINERS call I0504 18:19:52.056862 2194 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0504 18:19:52.060197 2200 process.cpp:3671] Handling HTTP event for process 'slave(1249)' with path: '/slave(1249)/api/v1' I0504 18:19:52.061647 2187 http.cpp:1436] HTTP POST for /slave(1249)/api/v1 from 172.17.0.2:38820 I0504 18:19:52.062439 2189 hierarchical.cpp:1853] Performed allocation for 1 agents in 204240ns I0504 18:19:52.062635 2187 http.cpp:3289] Processing LAUNCH_CONTAINER call for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0504 18:19:52.064019 2204 http.cpp:3399] Creating sandbox '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_gJleFa/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0504 18:19:52.065032 2207 containerizer.cpp:1397] Starting container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0504 18:19:52.065959 2207 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from STARTING to PROVISIONING after 384us I0504 18:19:52.067170 2207 containerizer.cpp:1575] Checkpointed ContainerConfig at '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_hO2DO0/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE/config' I0504 18:19:52.067250 2207 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from PROVISIONING to PREPARING after 1.295104ms I0504 18:19:52.071960 2192 containerizer.cpp:2101] Launching 'mesos-containerizer' with flags '--help="false" --launch_info="{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v1","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_t1xPvk","--available_capacity=0B","--volumes=","--forward=unix:///tmp/ylZUpu/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"environment":{"variables":[{"name":"MESOS_SANDBOX","type":"VALUE","value":"/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_gJleFa/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE"},{"name":"CSI_ENDPOINT","type":"VALUE","value":"unix:///tmp/mesos-csi-a7f20d/endpoint.sock"}]},"task_environment":{},"working_directory":"/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_gJleFa/containers/o rg-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE"}" --pipe_read="110" --pipe_write="111" --runtime_directory="/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_hO2DO0/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE" --unshare_namespace_mnt="false"' I0504 18:19:52.086928 2192 launcher.cpp:145] Forked child with pid '16771' for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0504 18:19:52.088548 2192 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from PREPARING to ISOLATING after 21.295872ms I0504 18:19:52.090078 2192 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from ISOLATING to FETCHING after 1.533184ms I0504 18:19:52.090436 2187 fetcher.cpp:369] Starting to fetch URIs for container: org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE, directory: /tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_gJleFa/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0504 18:19:52.092046 2189 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from FETCHING to RUNNING after 1.819648ms I0504 18:19:52.096144 2191 container_daemon.cpp:140] Invoking post-start hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0504 18:19:52.096333 2191 service_manager.cpp:703] Connecting to endpoint 'unix:///tmp/mesos-csi-a7f20d/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0504 18:19:52.114156 2188 hierarchical.cpp:1853] Performed allocation for 1 agents in 256132ns I0504 18:19:52.165964 2196 hierarchical.cpp:1853] Performed allocation for 1 agents in 165618ns I0504 18:19:52.217643 2203 hierarchical.cpp:1853] Performed allocation for 1 agents in 268937ns I0504 18:19:52.269510 2194 hierarchical.cpp:1853] Performed allocation for 1 agents in 235183ns I0504 18:19:52.320399 2195 hierarchical.cpp:1853] Performed allocation for 1 agents in 169997ns I0504 18:19:52.371771 2204 hierarchical.cpp:1853] Performed allocation for 1 agents in 213533ns I0504 18:19:52.423158 2202 hierarchical.cpp:1853] Performed allocation for 1 agents in 248388ns I0504 18:19:52.474663 2188 hierarchical.cpp:1853] Performed allocation for 1 agents in 247860ns I0504 18:19:52.519759 2198 service_manager.cpp:545] Probing endpoint 'unix:///tmp/mesos-csi-a7f20d/endpoint.sock' with CSI v1 I0504 18:19:52.522418 16775 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Identity/Probe call I0504 18:19:52.526255 2187 hierarchical.cpp:1853] Performed allocation for 1 agents in 206071ns I0504 18:19:52.526770 2189 container_daemon.cpp:171] Waiting for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0504 18:19:52.530282 16775 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Identity/GetPluginCapabilities call I0504 18:19:52.531136 2194 process.cpp:3671] Handling HTTP event for process 'slave(1249)' with path: '/slave(1249)/api/v1' I0504 18:19:52.532785 2196 http.cpp:1436] HTTP POST for /slave(1249)/api/v1 from 172.17.0.2:38822 I0504 18:19:52.533470 2196 http.cpp:3513] Processing WAIT_CONTAINER call for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0504 18:19:52.535418 16775 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Identity/GetPluginInfo call I0504 18:19:52.535866 16775 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Identity/GetPluginInfo call I0504 18:19:52.538125 2202 v1_volume_manager.cpp:649] NODE_SERVICE loaded: {} I0504 18:19:52.538878 2202 v1_volume_manager.cpp:649] CONTROLLER_SERVICE loaded: {} I0504 18:19:52.541739 16775 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/ControllerGetCapabilities call I0504 18:19:52.546890 16775 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Node/NodeGetCapabilities call I0504 18:19:52.551743 16775 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Node/NodeGetInfo call I0504 18:19:52.555224 2190 provider.cpp:676] Recovered resources '{}' and 0 operations for resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test' I0504 18:19:52.555469 2189 status_update_manager_process.hpp:379] Pausing operation status update manager I0504 18:19:52.556075 2204 http_connection.hpp:227] New endpoint detected at http://172.17.0.2:40073/slave(1249)/api/v1/resource_provider I0504 18:19:52.560737 2205 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.2:40073/slave(1249)/api/v1/resource_provider I0504 18:19:52.561767 2186 provider.cpp:476] Connected to resource provider manager I0504 18:19:52.562796 2195 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.2:40073/slave(1249)/api/v1/resource_provider I0504 18:19:52.564472 2197 process.cpp:3671] Handling HTTP event for process 'slave(1249)' with path: '/slave(1249)/api/v1/resource_provider' I0504 18:19:52.566944 2189 http.cpp:1436] HTTP POST for /slave(1249)/api/v1/resource_provider from 172.17.0.2:38826 I0504 18:19:52.568126 2190 manager.cpp:779] Subscribing resource provider {"default_reservations":[{"role":"storage","type":"DYNAMIC"}],"name":"test","storage":{"plugin":{"containers":[{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v1","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_t1xPvk","--available_capacity=0B","--volumes=","--forward=unix:///tmp/ylZUpu/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"resources":[{"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"}],"services":["CONTROLLER_SERVICE","NODE_SERVICE"]}],"name":"local","type":"org.apache.mesos.csi.test"},"reconciliation_interval_seconds":15.0},"type":"org.apache.mesos.rp.local.storage"} I0504 18:19:52.577857 2191 hierarchical.cpp:1853] Performed allocation for 1 agents in 262248ns I0504 18:19:52.619587 2200 slave.cpp:8714] Handling resource provider message 'SUBSCRIBE: {"default_reservations":[{"role":"storage","type":"DYNAMIC"}],"id":{"value":"2ca78ac5-e8b8-49a3-9234-a18b2a1fce4b"},"name":"test","storage":{"plugin":{"containers":[{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v1","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_t1xPvk","--available_capacity=0B","--volumes=","--forward=unix:///tmp/ylZUpu/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"resources":[{"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"}],"services":["CONTROLLER_SERVICE","NODE_SERVICE"]}],"name":"local","type":"org.apache.mesos.csi.test"},"reconciliation_interval_seconds":15.0},"type":"org.apache.mesos.rp.local.storage"}' I0504 18:19:52.621618 2203 provider.cpp:498] Received SUBSCRIBED event I0504 18:19:52.621660 2203 provider.cpp:1309] Subscribed with ID 2ca78ac5-e8b8-49a3-9234-a18b2a1fce4b I0504 18:19:52.622412 2206 status_update_manager_process.hpp:314] Recovering operation status update manager I0504 18:19:52.629101 2184 hierarchical.cpp:1853] Performed allocation for 1 agents in 191045ns I0504 18:19:52.669209 2189 provider.cpp:790] Reconciling storage pools and volumes I0504 18:19:52.672538 16775 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/ListVolumes call I0504 18:19:52.676252 2192 provider.cpp:2217] Sending UPDATE_STATE call with resources '{}' and 0 operations to agent f797e8a2-1395-4eb8-aa3b-697910672397-S0 I0504 18:19:52.676524 2187 http_connection.hpp:131] Sending UPDATE_STATE call to http://172.17.0.2:40073/slave(1249)/api/v1/resource_provider I0504 18:19:52.676576 2192 provider.cpp:748] Resource provider 2ca78ac5-e8b8-49a3-9234-a18b2a1fce4b is in READY state I0504 18:19:52.676789 2185 status_update_manager_process.hpp:385] Resuming operation status update manager I0504 18:19:52.677433 2190 provider.cpp:1235] Updating profiles { test } for resource provider 2ca78ac5-e8b8-49a3-9234-a18b2a1fce4b I0504 18:19:52.677736 2189 process.cpp:3671] Handling HTTP event for process 'slave(1249)' with path: '/slave(1249)/api/v1/resource_provider' I0504 18:19:52.679004 2186 provider.cpp:790] Reconciling storage pools and volumes I0504 18:19:52.679883 2196 http.cpp:1436] HTTP POST for /slave(1249)/api/v1/resource_provider from 172.17.0.2:38824 I0504 18:19:52.680739 2184 hierarchical.cpp:1853] Performed allocation for 1 agents in 199400ns I0504 18:19:52.681118 2185 manager.cpp:1011] Received UPDATE_STATE call with resources '[]' and 0 operations from resource provider 2ca78ac5-e8b8-49a3-9234-a18b2a1fce4b I0504 18:19:52.681496 2207 slave.cpp:8714] Handling resource provider message 'UPDATE_STATE: 2ca78ac5-e8b8-49a3-9234-a18b2a1fce4b {}' I0504 18:19:52.681641 2207 slave.cpp:8834] Forwarding new total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0504 18:19:52.682008 16775 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/ListVolumes call I0504 18:19:52.683167 16775 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/GetCapacity call I0504 18:19:52.683873 2202 hierarchical.cpp:1110] Grew agent f797e8a2-1395-4eb8-aa3b-697910672397-S0 by {} (total), { } (used) I0504 18:19:52.684382 2202 hierarchical.cpp:1067] Agent f797e8a2-1395-4eb8-aa3b-697910672397-S0 (e72e52c70698) updated with total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0504 18:19:52.690302 2193 hierarchical.cpp:1853] Performed allocation for 1 agents in 221805ns I0504 18:19:52.690567 2201 provider.cpp:790] Reconciling storage pools and volumes I0504 18:19:52.693112 16775 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/ListVolumes call I0504 18:19:52.693626 16775 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/GetCapacity call I0504 18:19:52.704560 2183 slave.cpp:1000] Agent terminating I0504 18:19:52.705507 2183 manager.cpp:127] Terminating resource provider 2ca78ac5-e8b8-49a3-9234-a18b2a1fce4b I0504 18:19:52.706141 2185 master.cpp:1292] Agent f797e8a2-1395-4eb8-aa3b-697910672397-S0 at slave(1249)@172.17.0.2:40073 (e72e52c70698) disconnected I0504 18:19:52.706207 2185 master.cpp:3361] Disconnecting agent f797e8a2-1395-4eb8-aa3b-697910672397-S0 at slave(1249)@172.17.0.2:40073 (e72e52c70698) I0504 18:19:52.706341 2185 master.cpp:3380] Deactivating agent f797e8a2-1395-4eb8-aa3b-697910672397-S0 at slave(1249)@172.17.0.2:40073 (e72e52c70698) I0504 18:19:52.706583 2194 hierarchical.cpp:1156] Agent f797e8a2-1395-4eb8-aa3b-697910672397-S0 deactivated E0504 18:19:52.706720 2207 http_connection.hpp:449] End-Of-File received I0504 18:19:52.707341 2207 http_connection.hpp:217] Re-detecting endpoint I0504 18:19:52.707887 2207 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0504 18:19:52.707988 2188 provider.cpp:488] Disconnected from resource provider manager I0504 18:19:52.708024 2207 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0504 18:19:52.708123 2207 http_connection.hpp:227] New endpoint detected at http://172.17.0.2:40073/slave(1249)/api/v1/resource_provider I0504 18:19:52.708204 2188 status_update_manager_process.hpp:379] Pausing operation status update manager I0504 18:19:52.710129 2189 containerizer.cpp:2623] Destroying container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE in RUNNING state I0504 18:19:52.710206 2189 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from RUNNING to DESTROYING after 15.618311168secs I0504 18:19:52.710741 2189 launcher.cpp:161] Asked to destroy container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0504 18:19:52.711992 2204 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.2:40073/slave(1249)/api/v1/resource_provider I0504 18:19:52.712811 2202 provider.cpp:476] Connected to resource provider manager I0504 18:19:52.713587 2201 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.2:40073/slave(1249)/api/v1/resource_provider I0504 18:19:52.714630 2208 process.cpp:2781] Returning '404 Not Found' for '/slave(1249)/api/v1/resource_provider' E0504 18:19:52.715989 2192 provider.cpp:721] Failed to subscribe resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test': Received '404 Not Found' () I0504 18:19:52.736011 2207 hierarchical.cpp:1853] Performed allocation for 1 agents in 155699ns I0504 18:19:52.786768 2194 containerizer.cpp:3159] Container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE has exited I0504 18:19:52.788101 2205 hierarchical.cpp:1853] Performed allocation for 1 agents in 161064ns I0504 18:19:52.789324 2195 provisioner.cpp:652] Ignoring destroy request for unknown container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0504 18:19:52.793227 2186 container_daemon.cpp:189] Invoking post-stop hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0504 18:19:52.793555 2203 service_manager.cpp:723] Disconnected from endpoint 'unix:///tmp/mesos-csi-a7f20d/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0504 18:19:52.793893 2185 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0504 18:19:52.798125 2208 process.cpp:2781] Returning '404 Not Found' for '/slave(1249)/api/v1' I0504 18:19:52.809298 2191 master.cpp:1140] Master terminating I0504 18:19:52.809625 2200 hierarchical.cpp:1132] Removed all filters for agent f797e8a2-1395-4eb8-aa3b-697910672397-S0 I0504 18:19:52.809653 2200 hierarchical.cpp:1008] Removed agent f797e8a2-1395-4eb8-aa3b-697910672397-S0 [ OK ] CSIVersion/StorageLocalResourceProviderTest.Update/v1 (853 ms) [----------] 54 tests from CSIVersion/StorageLocalResourceProviderTest (108478 ms total) [----------] Global test environment tear-down [==========] 2322 tests from 223 test cases ran. (1446609 ms total) [ PASSED ] 2321 tests. [ FAILED ] 1 test, listed below: [ FAILED ] SlaveTest.DrainInfoInAPIOutputs 1 FAILED TEST YOU HAVE 34 DISABLED TESTS I0504 18:19:52.927341 2208 process.cpp:935] Stopped the socket accept loop Makefile:15957: recipe for target 'check-local' failed make[4]: *** [check-local] Error 1 make[4]: Leaving directory '/tmp/SRC/build/mesos-1.10.0/_build/sub/src' Makefile:15073: recipe for target 'check-am' failed make[3]: *** [check-am] Error 2 make[3]: Leaving directory '/tmp/SRC/build/mesos-1.10.0/_build/sub/src' Makefile:15077: recipe for target 'check' failed make[2]: *** [check] Error 2 make[2]: Leaving directory '/tmp/SRC/build/mesos-1.10.0/_build/sub/src' Makefile:785: recipe for target 'check-recursive' failed make[1]: *** [check-recursive] Error 1 make[1]: Leaving directory '/tmp/SRC/build/mesos-1.10.0/_build/sub' Makefile:991: recipe for target 'distcheck' failed make: *** [distcheck] Error 1 Untagged: mesos/mesos-build:ubuntu-16.04 Untagged: mesos/mesos-build@sha256:fa967cbcfb44f55708a3cbc87f245c6d29dd891464db558af56a03ee321526bb Deleted: sha256:e895c0531b9a9a288fabe479a49f7059aed83645351ac99ec2ea2616822c9f97 Deleted: sha256:09119b0b314a69ba6ec6251f2e89f4199fe1e874c84f9abf07dcbd23dbc3f1c1 Deleted: sha256:562fe6af5a3883058be9c784a839392215ed4185a21d21f1d99df0d17f3ae6e7 Deleted: sha256:0dcdfbe322a4f332f73ac70905d557300ec6dae3bd19586758772c750c7b4a19 Deleted: sha256:c66652d605f01094e2db53d62505dbd524e076d5aa69b89d5e620003803eb149 Deleted: sha256:a2cf79bfb9593c05fd7142ddb49afef77ea4ad5d2464e841f09fe62ffee396e0 Deleted: sha256:f7a904214b390f39d98573882f631dc908df8b2b540cf04e1062f8182c1efffd Deleted: sha256:ce1f6fcaa83dfce189d76e08f184085732eab4eeb2562d2399953958405c5bec Deleted: sha256:cce92fda689ab9033f0b8db214bc63edd1ae3e05831a0f3a9418976d7dc7ccdd Deleted: sha256:d22094bbd65447c59a42c580eaa3a44cee9cd855f00905f59409be21bcefc745 Deleted: sha256:b8976847450013f3eb5e9a81a5778f73ed7bef67e6393049712ef17102b4b7b7 Deleted: sha256:b8c891f0ffec910a12757d733b178e3f62d81dbbde2b31d3b754071c416108ed Full log: https://builds.apache.org/job/Mesos-Reviewbot-Linux/9381/console - Mesos Reviewbot On May 4, 2020, 4:12 p.m., Andrei Sekretenko wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/72364/ > ----------------------------------------------------------- > > (Updated May 4, 2020, 4:12 p.m.) > > > Review request for mesos, Benjamin Mahler and Greg Mann. > > > Bugs: MESOS-10116 > https://issues.apache.org/jira/browse/MESOS-10116 > > > Repository: mesos > > > Description > ------- > > Added test for reactivation of a disconnected drained agent. > > > Diffs > ----- > > src/tests/master_draining_tests.cpp > f6b974f5f88f8563bd9cf6cca087b60cb5784e77 > > > Diff: https://reviews.apache.org/r/72364/diff/2/ > > > Testing > ------- > > > Thanks, > > Andrei Sekretenko > >
