----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72402/#review220416 -----------------------------------------------------------
Bad patch! Reviews applied: [72398, 72399, 72401, 72391, 72402] Failed command: ['bash', '-c', "set -o pipefail; export OS='ubuntu:16.04' BUILDTOOL='autotools' COMPILER='gcc' CONFIGURATION='--verbose --disable-libtool-wrappers --disable-parallel-test-execution' ENVIRONMENT='GLOG_v=1 MESOS_VERBOSE=1'; ./support/jenkins/buildbot.sh 2>&1 | tee build_72402"] Error: ...<truncated>... 69-47db-805f-03f11a6c4547) for operation UUID 6b51fd87-f41b-43b9-97e0-caeabd58ea91 on agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 I0422 09:56:05.163906 3084 http_connection.hpp:131] Sending UPDATE_OPERATION_STATUS call to http://172.17.0.2:43435/slave(1243)/api/v1/resource_provider I0422 09:56:05.164996 3086 process.cpp:3671] Handling HTTP event for process 'slave(1243)' with path: '/slave(1243)/api/v1/resource_provider' I0422 09:56:05.167958 3091 hierarchical.cpp:1853] Performed allocation for 1 agents in 1.015319ms I0422 09:56:05.168737 3088 master.cpp:9485] Sending offers [ e8e24b72-c44c-4d6c-922c-b5791b26c835-O3 ] to framework e8e24b72-c44c-4d6c-922c-b5791b26c835-0000 (default) at [email protected]:43435 I0422 09:56:05.169420 3088 sched.cpp:934] Scheduler::resourceOffers took 91699ns I0422 09:56:05.172495 3085 process.cpp:3671] Handling HTTP event for process 'master' with path: '/master/api/v1' I0422 09:56:05.174480 3095 http.cpp:1436] HTTP POST for /master/api/v1 from 172.17.0.2:59734 I0422 09:56:05.174779 3095 http.cpp:277] Processing call CREATE_VOLUMES I0422 09:56:05.175732 3095 master.cpp:3705] Authorizing principal 'test-principal' to perform action CREATE_VOLUME on object {"value":"storage/default-role","resource":{"provider_id":{"value":"526fa287-44a4-4553-b81b-ac6a54daba0f"},"name":"disk","type":"SCALAR","scalar":{"value":2048.0},"reservations":[{"type":"DYNAMIC","role":"storage"},{"type":"DYNAMIC","role":"storage/default-role","principal":"test-principal"}],"disk":{"persistence":{"id":"aeb87db2-6550-468f-ae78-7641df27b2b7","principal":"test-principal"},"volume":{"mode":"RW","container_path":"volume"},"source":{"type":"MOUNT","mount":{"root":"./csi/org.apache.mesos.csi.test/local/mounts"},"vendor":"org.apache.mesos.csi.test.local","id":"/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_4Lsosc/2GB-42a3bc6d-8581-45b5-9fcb-8ec7afce2c09","profile":"test"}}}} I0422 09:56:05.177361 3091 sched.cpp:960] Rescinded offer e8e24b72-c44c-4d6c-922c-b5791b26c835-O3 I0422 09:56:05.177450 3091 sched.cpp:971] Scheduler::offerRescinded took 25418ns I0422 09:56:05.177851 3097 hierarchical.cpp:1576] Recovered ports(allocated: storage/default-role):[31000-32000]; disk(allocated: storage/default-role)(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_4Lsosc/2GB-42a3bc6d-8581-45b5-9fcb-8ec7afce2c09,test)]:2048; cpus(allocated: storage/default-role):2; mem(allocated: storage/default-role):1024; disk(allocated: storage/default-role):1024 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_4Lsosc/2GB-42a3bc6d-8581-45b5-9fcb-8ec7afce2c09,test)]:2048, offered or allocated: {}) on agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 from framework e8e24 b72-c44c-4d6c-922c-b5791b26c835-0000 I0422 09:56:05.177999 3087 master.cpp:11784] Removing offer e8e24b72-c44c-4d6c-922c-b5791b26c835-O3 I0422 09:56:05.179555 3097 hierarchical.cpp:1625] Framework e8e24b72-c44c-4d6c-922c-b5791b26c835-0000 filtered agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 for 5secs I0422 09:56:05.182458 3090 master.cpp:11649] Sending operation '' (uuid: 2b2a4f85-d2dd-4bc5-84e5-736437c172dc) to agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 at slave(1243)@172.17.0.2:43435 (82e6e8f010ed) I0422 09:56:05.183130 3090 slave.cpp:4545] Ignoring new checkpointed resources and operations identical to the current version I0422 09:56:05.186406 3093 provider.cpp:498] Received APPLY_OPERATION event I0422 09:56:05.186453 3093 provider.cpp:1351] Received CREATE operation '' (uuid: 2b2a4f85-d2dd-4bc5-84e5-736437c172dc) I0422 09:56:05.190909 3082 master.cpp:5533] Processing REVIVE call for framework e8e24b72-c44c-4d6c-922c-b5791b26c835-0000 (default) at [email protected]:43435 I0422 09:56:05.191416 3089 hierarchical.cpp:1721] Unsuppressed offers and cleared filters for roles { storage/default-role } of framework e8e24b72-c44c-4d6c-922c-b5791b26c835-0000 I0422 09:56:05.193650 3089 hierarchical.cpp:1853] Performed allocation for 1 agents in 2.027852ms I0422 09:56:05.194172 3089 hierarchical.cpp:1853] Performed allocation for 1 agents in 240945ns I0422 09:56:05.194453 3092 master.cpp:9485] Sending offers [ e8e24b72-c44c-4d6c-922c-b5791b26c835-O4 ] to framework e8e24b72-c44c-4d6c-922c-b5791b26c835-0000 (default) at [email protected]:43435 I0422 09:56:05.195204 3090 sched.cpp:934] Scheduler::resourceOffers took 103270ns I0422 09:56:05.209581 3087 http.cpp:1436] HTTP POST for /slave(1243)/api/v1/resource_provider from 172.17.0.2:59726 I0422 09:56:05.210574 3088 slave.cpp:8702] Handling resource provider message 'UPDATE_OPERATION_STATUS: (uuid: 6b51fd87-f41b-43b9-97e0-caeabd58ea91) for framework (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED)' I0422 09:56:05.210794 3088 slave.cpp:9155] Updating the state of operation with no ID (uuid: 6b51fd87-f41b-43b9-97e0-caeabd58ea91) for an operation API call (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED) I0422 09:56:05.210856 3088 slave.cpp:8909] Forwarding status update of operation with no ID (operation_uuid: 6b51fd87-f41b-43b9-97e0-caeabd58ea91) for an operator API call I0422 09:56:05.211300 3085 master.cpp:11301] Updating the state of operation '' (uuid: 6b51fd87-f41b-43b9-97e0-caeabd58ea91) for an operator API call (latest state: OPERATION_PENDING, status update state: OPERATION_FINISHED) I0422 09:56:05.211992 3083 slave.cpp:4545] Ignoring new checkpointed resources and operations identical to the current version I0422 09:56:05.295145 3087 status_update_manager_process.hpp:152] Received operation status update OPERATION_FINISHED (Status UUID: 477643d6-38ec-44fe-8f7f-1ed8aab1901f) for operation UUID 2b2a4f85-d2dd-4bc5-84e5-736437c172dc on agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 I0422 09:56:05.295205 3087 status_update_manager_process.hpp:414] Creating operation status update stream 2b2a4f85-d2dd-4bc5-84e5-736437c172dc checkpoint=true I0422 09:56:05.295245 3093 provider.cpp:498] Received ACKNOWLEDGE_OPERATION_STATUS event I0422 09:56:05.295459 3087 status_update_manager_process.hpp:929] Checkpointing UPDATE for operation status update OPERATION_FINISHED (Status UUID: 477643d6-38ec-44fe-8f7f-1ed8aab1901f) for operation UUID 2b2a4f85-d2dd-4bc5-84e5-736437c172dc on agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 I0422 09:56:05.370234 3087 status_update_manager_process.hpp:528] Forwarding operation status update OPERATION_FINISHED (Status UUID: 477643d6-38ec-44fe-8f7f-1ed8aab1901f) for operation UUID 2b2a4f85-d2dd-4bc5-84e5-736437c172dc on agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 I0422 09:56:05.370553 3087 status_update_manager_process.hpp:252] Received operation status update acknowledgement (UUID: 4b9502e5-c569-47db-805f-03f11a6c4547) for stream 6b51fd87-f41b-43b9-97e0-caeabd58ea91 I0422 09:56:05.370617 3087 status_update_manager_process.hpp:929] Checkpointing ACK for operation status update OPERATION_FINISHED (Status UUID: 4b9502e5-c569-47db-805f-03f11a6c4547) for operation UUID 6b51fd87-f41b-43b9-97e0-caeabd58ea91 on agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 I0422 09:56:05.371135 3097 http_connection.hpp:131] Sending UPDATE_OPERATION_STATUS call to http://172.17.0.2:43435/slave(1243)/api/v1/resource_provider I0422 09:56:05.372130 3082 process.cpp:3671] Handling HTTP event for process 'slave(1243)' with path: '/slave(1243)/api/v1/resource_provider' I0422 09:56:05.413816 3096 http.cpp:1436] HTTP POST for /slave(1243)/api/v1/resource_provider from 172.17.0.2:59726 I0422 09:56:05.415148 3091 slave.cpp:8702] Handling resource provider message 'UPDATE_OPERATION_STATUS: (uuid: 2b2a4f85-d2dd-4bc5-84e5-736437c172dc) for framework (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED)' I0422 09:56:05.415410 3091 slave.cpp:9155] Updating the state of operation with no ID (uuid: 2b2a4f85-d2dd-4bc5-84e5-736437c172dc) for an operation API call (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED) I0422 09:56:05.415472 3091 slave.cpp:8909] Forwarding status update of operation with no ID (operation_uuid: 2b2a4f85-d2dd-4bc5-84e5-736437c172dc) for an operator API call I0422 09:56:05.415935 3093 master.cpp:11301] Updating the state of operation '' (uuid: 2b2a4f85-d2dd-4bc5-84e5-736437c172dc) for an operator API call (latest state: OPERATION_PENDING, status update state: OPERATION_FINISHED) I0422 09:56:05.416579 3097 slave.cpp:4545] Ignoring new checkpointed resources and operations identical to the current version I0422 09:56:05.418218 3096 provider.cpp:498] Received ACKNOWLEDGE_OPERATION_STATUS event I0422 09:56:05.424401 3087 status_update_manager_process.hpp:490] Cleaning up operation status update stream 6b51fd87-f41b-43b9-97e0-caeabd58ea91 I0422 09:56:05.424594 3087 status_update_manager_process.hpp:252] Received operation status update acknowledgement (UUID: 477643d6-38ec-44fe-8f7f-1ed8aab1901f) for stream 2b2a4f85-d2dd-4bc5-84e5-736437c172dc I0422 09:56:05.424661 3087 status_update_manager_process.hpp:929] Checkpointing ACK for operation status update OPERATION_FINISHED (Status UUID: 477643d6-38ec-44fe-8f7f-1ed8aab1901f) for operation UUID 2b2a4f85-d2dd-4bc5-84e5-736437c172dc on agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 I0422 09:56:05.483875 3087 status_update_manager_process.hpp:490] Cleaning up operation status update stream 2b2a4f85-d2dd-4bc5-84e5-736437c172dc I0422 09:56:05.542227 3093 process.cpp:3671] Handling HTTP event for process 'master' with path: '/master/api/v1' I0422 09:56:05.544100 3097 http.cpp:1436] HTTP POST for /master/api/v1 from 172.17.0.2:59736 I0422 09:56:05.544358 3097 http.cpp:277] Processing call DESTROY_VOLUMES I0422 09:56:05.545323 3097 master.cpp:3705] Authorizing principal 'test-principal' to perform action DESTROY_VOLUME on object {"value":"test-principal","resource":{"provider_id":{"value":"526fa287-44a4-4553-b81b-ac6a54daba0f"},"name":"disk","type":"SCALAR","scalar":{"value":2048.0},"reservations":[{"type":"DYNAMIC","role":"storage"},{"type":"DYNAMIC","role":"storage/default-role","principal":"test-principal"}],"disk":{"persistence":{"id":"aeb87db2-6550-468f-ae78-7641df27b2b7","principal":"test-principal"},"volume":{"mode":"RW","container_path":"volume"},"source":{"type":"MOUNT","mount":{"root":"./csi/org.apache.mesos.csi.test/local/mounts"},"vendor":"org.apache.mesos.csi.test.local","id":"/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_4Lsosc/2GB-42a3bc6d-8581-45b5-9fcb-8ec7afce2c09","profile":"test"}}}} I0422 09:56:05.547047 3096 sched.cpp:960] Rescinded offer e8e24b72-c44c-4d6c-922c-b5791b26c835-O4 I0422 09:56:05.547156 3096 sched.cpp:971] Scheduler::offerRescinded took 36769ns I0422 09:56:05.547946 3087 hierarchical.cpp:1576] Recovered ports(allocated: storage/default-role):[31000-32000]; disk(allocated: storage/default-role)(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_4Lsosc/2GB-42a3bc6d-8581-45b5-9fcb-8ec7afce2c09,test),aeb87db2-6550-468f-ae78-7641df27b2b7:volume]:2048; cpus(allocated: storage/default-role):2; mem(allocated: storage/default-role):1024; disk(allocated: storage/default-role):1024 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_4Lsosc/2GB-42a3bc6d-8581-45b5-9fcb-8ec7afce2c09,test),aeb87db2-6550-468f-ae78-7641df27b2b7:volume]:2048, offered or allocated: {}) on agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 from framework e8e24b72-c44c-4d6c-922c-b5791b26c835-0000 I0422 09:56:05.548097 3095 master.cpp:11784] Removing offer e8e24b72-c44c-4d6c-922c-b5791b26c835-O4 I0422 09:56:05.550230 3087 hierarchical.cpp:1625] Framework e8e24b72-c44c-4d6c-922c-b5791b26c835-0000 filtered agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 for 5secs I0422 09:56:05.553731 3085 master.cpp:11649] Sending operation '' (uuid: afab7bf5-2e9e-4348-a523-d841aa8e399b) to agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 at slave(1243)@172.17.0.2:43435 (82e6e8f010ed) I0422 09:56:05.554388 3092 slave.cpp:4545] Ignoring new checkpointed resources and operations identical to the current version I0422 09:56:05.557731 3089 provider.cpp:498] Received APPLY_OPERATION event I0422 09:56:05.557780 3089 provider.cpp:1351] Received DESTROY operation '' (uuid: afab7bf5-2e9e-4348-a523-d841aa8e399b) I0422 09:56:05.562762 3093 hierarchical.cpp:1853] Performed allocation for 1 agents in 1.205621ms I0422 09:56:05.563735 3082 master.cpp:9485] Sending offers [ e8e24b72-c44c-4d6c-922c-b5791b26c835-O5 ] to framework e8e24b72-c44c-4d6c-922c-b5791b26c835-0000 (default) at [email protected]:43435 I0422 09:56:05.564502 3085 sched.cpp:934] Scheduler::resourceOffers took 92438ns I0422 09:56:05.662562 3088 status_update_manager_process.hpp:152] Received operation status update OPERATION_FINISHED (Status UUID: cc8eb241-62e5-4d97-8527-f5f08b4a24f2) for operation UUID afab7bf5-2e9e-4348-a523-d841aa8e399b on agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 I0422 09:56:05.662624 3088 status_update_manager_process.hpp:414] Creating operation status update stream afab7bf5-2e9e-4348-a523-d841aa8e399b checkpoint=true I0422 09:56:05.662931 3088 status_update_manager_process.hpp:929] Checkpointing UPDATE for operation status update OPERATION_FINISHED (Status UUID: cc8eb241-62e5-4d97-8527-f5f08b4a24f2) for operation UUID afab7bf5-2e9e-4348-a523-d841aa8e399b on agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 I0422 09:56:05.742626 3088 status_update_manager_process.hpp:528] Forwarding operation status update OPERATION_FINISHED (Status UUID: cc8eb241-62e5-4d97-8527-f5f08b4a24f2) for operation UUID afab7bf5-2e9e-4348-a523-d841aa8e399b on agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 I0422 09:56:05.743657 3084 http_connection.hpp:131] Sending UPDATE_OPERATION_STATUS call to http://172.17.0.2:43435/slave(1243)/api/v1/resource_provider I0422 09:56:05.744835 3090 process.cpp:3671] Handling HTTP event for process 'slave(1243)' with path: '/slave(1243)/api/v1/resource_provider' I0422 09:56:05.748245 3094 process.cpp:3671] Handling HTTP event for process 'master' with path: '/master/api/v1' I0422 09:56:05.749963 3085 http.cpp:1436] HTTP POST for /master/api/v1 from 172.17.0.2:59738 I0422 09:56:05.750175 3085 http.cpp:277] Processing call UNRESERVE_RESOURCES I0422 09:56:05.750835 3085 master.cpp:3705] Authorizing principal 'test-principal' to perform action UNRESERVE_RESOURCES on object {"value":"test-principal","resource":{"provider_id":{"value":"526fa287-44a4-4553-b81b-ac6a54daba0f"},"name":"disk","type":"SCALAR","scalar":{"value":2048.0},"reservations":[{"type":"DYNAMIC","role":"storage"},{"type":"DYNAMIC","role":"storage/default-role","principal":"test-principal"}],"disk":{"source":{"type":"MOUNT","mount":{"root":"./csi/org.apache.mesos.csi.test/local/mounts"},"vendor":"org.apache.mesos.csi.test.local","id":"/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_4Lsosc/2GB-42a3bc6d-8581-45b5-9fcb-8ec7afce2c09","profile":"test"}}}} I0422 09:56:05.752192 3090 sched.cpp:960] Rescinded offer e8e24b72-c44c-4d6c-922c-b5791b26c835-O5 I0422 09:56:05.752313 3090 sched.cpp:971] Scheduler::offerRescinded took 62241ns I0422 09:56:05.752705 3096 hierarchical.cpp:1576] Recovered ports(allocated: storage/default-role):[31000-32000]; disk(allocated: storage/default-role)(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_4Lsosc/2GB-42a3bc6d-8581-45b5-9fcb-8ec7afce2c09,test)]:2048; cpus(allocated: storage/default-role):2; mem(allocated: storage/default-role):1024; disk(allocated: storage/default-role):1024 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_4Lsosc/2GB-42a3bc6d-8581-45b5-9fcb-8ec7afce2c09,test)]:2048, offered or allocated: {}) on agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 from framework e8e24 b72-c44c-4d6c-922c-b5791b26c835-0000 I0422 09:56:05.752828 3097 master.cpp:11784] Removing offer e8e24b72-c44c-4d6c-922c-b5791b26c835-O5 I0422 09:56:05.754225 3096 hierarchical.cpp:1625] Framework e8e24b72-c44c-4d6c-922c-b5791b26c835-0000 filtered agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 for 5secs I0422 09:56:05.756947 3087 master.cpp:11649] Sending operation '' (uuid: dd248574-90c8-4e13-98e0-b59ff2f79c75) to agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 at slave(1243)@172.17.0.2:43435 (82e6e8f010ed) I0422 09:56:05.757438 3089 slave.cpp:4545] Ignoring new checkpointed resources and operations identical to the current version I0422 09:56:05.760236 3093 provider.cpp:498] Received APPLY_OPERATION event I0422 09:56:05.760272 3093 provider.cpp:1351] Received UNRESERVE operation '' (uuid: dd248574-90c8-4e13-98e0-b59ff2f79c75) I0422 09:56:05.768875 3086 hierarchical.cpp:1853] Performed allocation for 1 agents in 1.128626ms I0422 09:56:05.769716 3082 master.cpp:9485] Sending offers [ e8e24b72-c44c-4d6c-922c-b5791b26c835-O6 ] to framework e8e24b72-c44c-4d6c-922c-b5791b26c835-0000 (default) at [email protected]:43435 I0422 09:56:05.770491 3082 sched.cpp:934] Scheduler::resourceOffers took 100517ns I0422 09:56:05.789753 3085 http.cpp:1436] HTTP POST for /slave(1243)/api/v1/resource_provider from 172.17.0.2:59726 I0422 09:56:05.790719 3095 slave.cpp:8702] Handling resource provider message 'UPDATE_OPERATION_STATUS: (uuid: afab7bf5-2e9e-4348-a523-d841aa8e399b) for framework (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED)' I0422 09:56:05.790961 3095 slave.cpp:9155] Updating the state of operation with no ID (uuid: afab7bf5-2e9e-4348-a523-d841aa8e399b) for an operation API call (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED) I0422 09:56:05.791024 3095 slave.cpp:8909] Forwarding status update of operation with no ID (operation_uuid: afab7bf5-2e9e-4348-a523-d841aa8e399b) for an operator API call I0422 09:56:05.791544 3096 master.cpp:11301] Updating the state of operation '' (uuid: afab7bf5-2e9e-4348-a523-d841aa8e399b) for an operator API call (latest state: OPERATION_PENDING, status update state: OPERATION_FINISHED) I0422 09:56:05.792238 3087 slave.cpp:4545] Ignoring new checkpointed resources and operations identical to the current version I0422 09:56:05.868964 3095 status_update_manager_process.hpp:152] Received operation status update OPERATION_FINISHED (Status UUID: ecfe2516-33d5-4334-a32c-ee9306ee09c1) for operation UUID dd248574-90c8-4e13-98e0-b59ff2f79c75 on agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 I0422 09:56:05.869014 3093 provider.cpp:498] Received ACKNOWLEDGE_OPERATION_STATUS event I0422 09:56:05.869040 3095 status_update_manager_process.hpp:414] Creating operation status update stream dd248574-90c8-4e13-98e0-b59ff2f79c75 checkpoint=true I0422 09:56:05.869462 3095 status_update_manager_process.hpp:929] Checkpointing UPDATE for operation status update OPERATION_FINISHED (Status UUID: ecfe2516-33d5-4334-a32c-ee9306ee09c1) for operation UUID dd248574-90c8-4e13-98e0-b59ff2f79c75 on agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 I0422 09:56:05.940356 3095 status_update_manager_process.hpp:528] Forwarding operation status update OPERATION_FINISHED (Status UUID: ecfe2516-33d5-4334-a32c-ee9306ee09c1) for operation UUID dd248574-90c8-4e13-98e0-b59ff2f79c75 on agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 I0422 09:56:05.940764 3095 status_update_manager_process.hpp:252] Received operation status update acknowledgement (UUID: cc8eb241-62e5-4d97-8527-f5f08b4a24f2) for stream afab7bf5-2e9e-4348-a523-d841aa8e399b I0422 09:56:05.940868 3095 status_update_manager_process.hpp:929] Checkpointing ACK for operation status update OPERATION_FINISHED (Status UUID: cc8eb241-62e5-4d97-8527-f5f08b4a24f2) for operation UUID afab7bf5-2e9e-4348-a523-d841aa8e399b on agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 I0422 09:56:05.941344 3096 http_connection.hpp:131] Sending UPDATE_OPERATION_STATUS call to http://172.17.0.2:43435/slave(1243)/api/v1/resource_provider I0422 09:56:05.942502 3086 process.cpp:3671] Handling HTTP event for process 'slave(1243)' with path: '/slave(1243)/api/v1/resource_provider' I0422 09:56:05.985517 3088 http.cpp:1436] HTTP POST for /slave(1243)/api/v1/resource_provider from 172.17.0.2:59726 I0422 09:56:05.986536 3097 slave.cpp:8702] Handling resource provider message 'UPDATE_OPERATION_STATUS: (uuid: dd248574-90c8-4e13-98e0-b59ff2f79c75) for framework (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED)' I0422 09:56:05.986753 3097 slave.cpp:9155] Updating the state of operation with no ID (uuid: dd248574-90c8-4e13-98e0-b59ff2f79c75) for an operation API call (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED) I0422 09:56:05.986810 3097 slave.cpp:8909] Forwarding status update of operation with no ID (operation_uuid: dd248574-90c8-4e13-98e0-b59ff2f79c75) for an operator API call I0422 09:56:05.987146 3093 master.cpp:11301] Updating the state of operation '' (uuid: dd248574-90c8-4e13-98e0-b59ff2f79c75) for an operator API call (latest state: OPERATION_PENDING, status update state: OPERATION_FINISHED) I0422 09:56:05.987648 3096 slave.cpp:4545] Ignoring new checkpointed resources and operations identical to the current version I0422 09:56:05.989208 3088 provider.cpp:498] Received ACKNOWLEDGE_OPERATION_STATUS event I0422 09:56:05.994388 3095 status_update_manager_process.hpp:490] Cleaning up operation status update stream afab7bf5-2e9e-4348-a523-d841aa8e399b I0422 09:56:05.994632 3095 status_update_manager_process.hpp:252] Received operation status update acknowledgement (UUID: ecfe2516-33d5-4334-a32c-ee9306ee09c1) for stream dd248574-90c8-4e13-98e0-b59ff2f79c75 I0422 09:56:05.994729 3095 status_update_manager_process.hpp:929] Checkpointing ACK for operation status update OPERATION_FINISHED (Status UUID: ecfe2516-33d5-4334-a32c-ee9306ee09c1) for operation UUID dd248574-90c8-4e13-98e0-b59ff2f79c75 on agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 I0422 09:56:06.070096 3095 status_update_manager_process.hpp:490] Cleaning up operation status update stream dd248574-90c8-4e13-98e0-b59ff2f79c75 I0422 09:56:06.127786 3096 master.cpp:1407] Framework e8e24b72-c44c-4d6c-922c-b5791b26c835-0000 (default) at [email protected]:43435 disconnected I0422 09:56:06.127900 3096 master.cpp:3326] Deactivating framework e8e24b72-c44c-4d6c-922c-b5791b26c835-0000 (default) at [email protected]:43435 I0422 09:56:06.128262 3089 hierarchical.cpp:813] Deactivated framework e8e24b72-c44c-4d6c-922c-b5791b26c835-0000 I0422 09:56:06.128677 3081 slave.cpp:1000] Agent terminating I0422 09:56:06.128796 3089 hierarchical.cpp:1576] Recovered ports(allocated: storage/default-role):[31000-32000]; disk(allocated: storage/default-role)(reservations: [(DYNAMIC,storage)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_4Lsosc/2GB-42a3bc6d-8581-45b5-9fcb-8ec7afce2c09,test)]:2048; cpus(allocated: storage/default-role):2; mem(allocated: storage/default-role):1024; disk(allocated: storage/default-role):1024 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk(reservations: [(DYNAMIC,storage)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_4Lsosc/2GB-42a3bc6d-8581-45b5-9fcb-8ec7afce2c09,test)]:2048, offered or allocated: {}) on agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 from framework e8e24b72-c44c-4d6c-922c-b5791b26c835-0000 I0422 09:56:06.128960 3096 master.cpp:11784] Removing offer e8e24b72-c44c-4d6c-922c-b5791b26c835-O6 I0422 09:56:06.129050 3096 master.cpp:3310] Disconnecting framework e8e24b72-c44c-4d6c-922c-b5791b26c835-0000 (default) at [email protected]:43435 I0422 09:56:06.129211 3096 master.cpp:1422] Giving framework e8e24b72-c44c-4d6c-922c-b5791b26c835-0000 (default) at [email protected]:43435 0ns to failover I0422 09:56:06.129623 3081 manager.cpp:127] Terminating resource provider 526fa287-44a4-4553-b81b-ac6a54daba0f I0422 09:56:06.130115 3083 master.cpp:1292] Agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 at slave(1243)@172.17.0.2:43435 (82e6e8f010ed) disconnected I0422 09:56:06.130151 3083 master.cpp:3361] Disconnecting agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 at slave(1243)@172.17.0.2:43435 (82e6e8f010ed) I0422 09:56:06.130230 3083 master.cpp:3380] Deactivating agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 at slave(1243)@172.17.0.2:43435 (82e6e8f010ed) I0422 09:56:06.130367 3089 hierarchical.cpp:1156] Agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 deactivated I0422 09:56:06.130470 3083 master.cpp:9269] Framework failover timeout, removing framework e8e24b72-c44c-4d6c-922c-b5791b26c835-0000 (default) at [email protected]:43435 I0422 09:56:06.130509 3083 master.cpp:10285] Removing framework e8e24b72-c44c-4d6c-922c-b5791b26c835-0000 (default) at [email protected]:43435 E0422 09:56:06.130558 3094 http_connection.hpp:449] End-Of-File received I0422 09:56:06.130875 3085 hierarchical.cpp:1777] Allocation paused I0422 09:56:06.131001 3094 http_connection.hpp:217] Re-detecting endpoint I0422 09:56:06.131414 3094 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0422 09:56:06.131585 3094 http_connection.hpp:227] New endpoint detected at http://172.17.0.2:43435/slave(1243)/api/v1/resource_provider I0422 09:56:06.131597 3089 provider.cpp:488] Disconnected from resource provider manager I0422 09:56:06.131613 3085 hierarchical.cpp:757] Removed framework e8e24b72-c44c-4d6c-922c-b5791b26c835-0000 I0422 09:56:06.131760 3096 status_update_manager_process.hpp:379] Pausing operation status update manager I0422 09:56:06.131825 3085 hierarchical.cpp:1787] Allocation resumed I0422 09:56:06.131888 3094 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0422 09:56:06.133119 3092 containerizer.cpp:2679] Destroying container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE in RUNNING state I0422 09:56:06.133180 3092 containerizer.cpp:3377] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from RUNNING to DESTROYING after 2.480686976secs I0422 09:56:06.133666 3092 launcher.cpp:161] Asked to destroy container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0422 09:56:06.134173 3096 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.2:43435/slave(1243)/api/v1/resource_provider I0422 09:56:06.134722 3082 provider.cpp:476] Connected to resource provider manager I0422 09:56:06.135193 3094 hierarchical.cpp:1853] Performed allocation for 1 agents in 134383ns I0422 09:56:06.135465 3093 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.2:43435/slave(1243)/api/v1/resource_provider E0422 09:56:06.136116 3093 provider.cpp:721] Failed to subscribe resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test': Cannot process 'SUBSCRIBE' call as the driver is in state SUBSCRIBING I0422 09:56:06.136404 3098 process.cpp:2781] Returning '404 Not Found' for '/slave(1243)/api/v1/resource_provider' E0422 09:56:06.137655 3085 provider.cpp:721] Failed to subscribe resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test': Received '404 Not Found' () I0422 09:56:06.186836 3083 hierarchical.cpp:1853] Performed allocation for 1 agents in 181091ns I0422 09:56:06.237141 3095 containerizer.cpp:3215] Container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE has exited I0422 09:56:06.238752 3086 hierarchical.cpp:1853] Performed allocation for 1 agents in 197284ns I0422 09:56:06.239181 3084 provisioner.cpp:652] Ignoring destroy request for unknown container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0422 09:56:06.242230 3091 container_daemon.cpp:189] Invoking post-stop hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0422 09:56:06.242465 3091 service_manager.cpp:723] Disconnected from endpoint 'unix:///tmp/mesos-csi-Pldw6B/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0422 09:56:06.242789 3086 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0422 09:56:06.245934 3098 process.cpp:2781] Returning '404 Not Found' for '/slave(1243)/api/v1' I0422 09:56:06.257623 3081 master.cpp:1140] Master terminating I0422 09:56:06.258716 3083 hierarchical.cpp:1132] Removed all filters for agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 I0422 09:56:06.258749 3083 hierarchical.cpp:1008] Removed agent e8e24b72-c44c-4d6c-922c-b5791b26c835-S0 [ OK ] CSIVersion/StorageLocalResourceProviderTest.OperatorOperationsWithResourceProviderResources/v1 (2365 ms) [ RUN ] CSIVersion/StorageLocalResourceProviderTest.Update/v0 I0422 09:56:06.275919 3081 cluster.cpp:186] Creating default 'local' authorizer I0422 09:56:06.281169 3096 master.cpp:443] Master c61978a4-63c5-4e28-af9f-6f252c061e52 (82e6e8f010ed) started on 172.17.0.2:43435 I0422 09:56:06.281199 3096 master.cpp:446] Flags at startup: --acls="" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins" --allocation_interval="50ms" --allocator="hierarchical" --authenticate_agents="true" --authenticate_frameworks="true" --authenticate_http_frameworks="true" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authentication_v0_timeout="15secs" --authenticators="crammd5" --authorizers="local" --credentials="/tmp/QirDIc/credentials" --filter_gpu_resources="true" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_framework_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_operator_event_stream_subscribers="1000" --max_unreachable_tasks_per_framework="1000" --memory_profiling="false" --min_alloca table_resources="cpus:0.01|mem:32" --port="5050" --publish_per_framework_metrics="true" --quiet="false" --recovery_agent_removal_limit="100%" --registry="in_memory" --registry_fetch_timeout="1mins" --registry_gc_interval="15mins" --registry_max_agent_age="2weeks" --registry_max_agent_count="102400" --registry_store_timeout="100secs" --registry_strict="false" --require_agent_domain="false" --role_sorter="drf" --root_submissions="true" --version="false" --webui_dir="/tmp/SRC/build/mesos-1.10.0/_inst/share/mesos/webui" --work_dir="/tmp/QirDIc/master" --zk_session_timeout="10secs" I0422 09:56:06.281519 3096 master.cpp:495] Master only allowing authenticated frameworks to register I0422 09:56:06.281533 3096 master.cpp:501] Master only allowing authenticated agents to register I0422 09:56:06.281541 3096 master.cpp:507] Master only allowing authenticated HTTP frameworks to register I0422 09:56:06.281551 3096 credentials.hpp:37] Loading credentials for authentication from '/tmp/QirDIc/credentials' I0422 09:56:06.281786 3096 master.cpp:551] Using default 'crammd5' authenticator I0422 09:56:06.281997 3096 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readonly' I0422 09:56:06.282232 3096 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readwrite' I0422 09:56:06.282418 3096 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-master-scheduler' I0422 09:56:06.282593 3096 master.cpp:632] Authorization enabled I0422 09:56:06.282956 3082 hierarchical.cpp:567] Initialized hierarchical allocator process I0422 09:56:06.282958 3086 whitelist_watcher.cpp:77] No whitelist given I0422 09:56:06.286495 3094 master.cpp:2165] Elected as the leading master! I0422 09:56:06.286535 3094 master.cpp:1661] Recovering from registrar I0422 09:56:06.286751 3083 registrar.cpp:339] Recovering registrar I0422 09:56:06.287528 3083 registrar.cpp:383] Successfully fetched the registry (0B) in 0ns I0422 09:56:06.287660 3083 registrar.cpp:487] Applied 1 operations in 42997ns; attempting to update the registry I0422 09:56:06.288326 3083 registrar.cpp:544] Successfully updated the registry in 0ns I0422 09:56:06.288460 3083 registrar.cpp:416] Successfully recovered registrar I0422 09:56:06.288938 3082 master.cpp:1814] Recovered 0 agents from the registry (144B); allowing 10mins for agents to reregister I0422 09:56:06.288990 3096 hierarchical.cpp:606] Skipping recovery of hierarchical allocator: nothing to recover W0422 09:56:06.295027 3081 process.cpp:2877] Attempted to spawn already running process [email protected]:43435 I0422 09:56:06.296443 3081 containerizer.cpp:317] Using isolation { environment_secret, posix/cpu, posix/mem, filesystem/posix, network/cni } W0422 09:56:06.297044 3081 backend.cpp:76] Failed to create 'overlay' backend: OverlayBackend requires root privileges W0422 09:56:06.297070 3081 backend.cpp:76] Failed to create 'aufs' backend: AufsBackend requires root privileges W0422 09:56:06.297086 3081 backend.cpp:76] Failed to create 'bind' backend: BindBackend requires root privileges I0422 09:56:06.297117 3081 provisioner.cpp:294] Using default backend 'copy' I0422 09:56:06.299638 3081 cluster.cpp:533] Creating default 'local' authorizer I0422 09:56:06.302031 3090 slave.cpp:279] Mesos agent started on (1244)@172.17.0.2:43435 I0422 09:56:06.302067 3090 slave.cpp:280] Flags at startup: --acls="" --appc_simple_discovery_uri_prefix="http://"; --appc_store_dir="/tmp/QirDIc/6uZ6A7/store/appc" --authenticate_http_readonly="true" --authenticate_http_readwrite="false" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authentication_timeout_max="1mins" --authentication_timeout_min="5secs" --authorizer="local" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_destroy_timeout="1mins" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="mesos" --credential="/tmp/QirDIc/6uZ6A7/credential" --default_role="*" --disallow_sharing_agent_ipc_namespace="false" --disallow_sharing_agent_pid_namespace="false" --disk_profile_adaptor="org_apache_mesos_UriDiskProfileAdaptor" --disk_watch_interval="1mins" --docker="docker" --docker_ignore_runtime="false" --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io"; --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/QirDIc/6uZ6A7/store/docker" --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume" --docker_volume_chown="false" --enforce_container_disk_quota="false" --executor_registration_timeout="1mins" --executor_reregistration_timeout="2secs" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/QirDIc/6uZ6A7/fetch" --fetcher_cache_size="2GB" --fetcher_stall_timeout="1mins" --frameworks_home="/tmp/QirDIc/6uZ6A7/frameworks" --gc_delay="1weeks" --gc_disk_headroom="0.1" --gc_non_executor_container_sandboxes="false" --help="false" --hostname_lookup="true" --http_command_executor="false" --http_credentials="/tmp/QirDIc/6uZ6A7/http_credentials" --http_executor_domain_sockets="false" --http_heartbeat_interval="30secs" --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem" --launcher="posi x" --launcher_dir="/tmp/SRC/build/mesos-1.10.0/_build/sub/src" --logbufsecs="0" --logging_level="INFO" --max_completed_executors_per_framework="150" --memory_profiling="false" --network_cni_metrics="true" --network_cni_root_dir_persist="false" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns" --quiet="false" --reconfiguration_policy="equal" --recover="reconnect" --recovery_timeout="15mins" --registration_backoff_factor="10ms" --resource_provider_config_dir="/tmp/QirDIc/resource_provider_configs" --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]" --revocable_cpu_low_priority="true" --runtime_dir="/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_bhWAmo" --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true" --systemd_enable_support="true" --systemd_runtime_directory="/run/systemd/system" --version="false" --work_dir="/tmp/CSIVersion_StorageLoca lResourceProviderTest_Update_v0_s7t57E" --zk_session_timeout="10secs" I0422 09:56:06.302781 3090 credentials.hpp:86] Loading credential for authentication from '/tmp/QirDIc/6uZ6A7/credential' I0422 09:56:06.302999 3090 slave.cpp:312] Agent using credential for: test-principal I0422 09:56:06.303037 3090 credentials.hpp:37] Loading credentials for authentication from '/tmp/QirDIc/6uZ6A7/http_credentials' I0422 09:56:06.303369 3090 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-agent-readonly' I0422 09:56:06.303882 3090 disk_profile_adaptor.cpp:82] Creating disk profile adaptor module 'org_apache_mesos_UriDiskProfileAdaptor' I0422 09:56:06.305861 3096 uri_disk_profile_adaptor.cpp:305] Updated disk profile mapping to 1 active profiles I0422 09:56:06.305755 3090 slave.cpp:627] Agent resources: [{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}] I0422 09:56:06.306107 3090 slave.cpp:635] Agent attributes: [ ] I0422 09:56:06.306138 3090 slave.cpp:644] Agent hostname: 82e6e8f010ed I0422 09:56:06.306349 3087 status_update_manager_process.hpp:379] Pausing operation status update manager I0422 09:56:06.306385 3092 task_status_update_manager.cpp:181] Pausing sending task status updates I0422 09:56:06.308182 3088 state.cpp:68] Recovering state from '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_s7t57E/meta' I0422 09:56:06.308540 3097 slave.cpp:7711] Finished recovering checkpointed state from '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_s7t57E/meta', beginning agent recovery I0422 09:56:06.309214 3095 task_status_update_manager.cpp:207] Recovering task status update manager I0422 09:56:06.309823 3083 containerizer.cpp:822] Recovering Mesos containers I0422 09:56:06.310286 3083 containerizer.cpp:1162] Recovering isolators I0422 09:56:06.311483 3084 hierarchical.cpp:1853] Performed allocation for 0 agents in 107137ns I0422 09:56:06.311522 3097 containerizer.cpp:1201] Recovering provisioner I0422 09:56:06.312309 3086 provisioner.cpp:518] Provisioner recovery complete I0422 09:56:06.313269 3089 composing.cpp:343] Finished recovering all containerizers I0422 09:56:06.313696 3083 slave.cpp:8193] Recovering executors I0422 09:56:06.313833 3083 slave.cpp:8346] Finished recovery I0422 09:56:06.314775 3090 task_status_update_manager.cpp:181] Pausing sending task status updates I0422 09:56:06.314811 3091 status_update_manager_process.hpp:379] Pausing operation status update manager I0422 09:56:06.314824 3093 slave.cpp:1459] New master detected at [email protected]:43435 I0422 09:56:06.314970 3093 slave.cpp:1524] Detecting new master I0422 09:56:06.320453 3082 slave.cpp:1551] Authenticating with master [email protected]:43435 I0422 09:56:06.320590 3082 slave.cpp:1560] Using default CRAM-MD5 authenticatee I0422 09:56:06.320972 3086 authenticatee.cpp:121] Creating new client SASL connection I0422 09:56:06.321348 3085 master.cpp:9676] Authenticating slave(1244)@172.17.0.2:43435 I0422 09:56:06.321586 3088 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(2109)@172.17.0.2:43435 I0422 09:56:06.321936 3092 authenticator.cpp:98] Creating new server SASL connection I0422 09:56:06.322261 3094 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 I0422 09:56:06.322302 3094 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' I0422 09:56:06.322443 3094 authenticator.cpp:204] Received SASL authentication start I0422 09:56:06.322518 3094 authenticator.cpp:326] Authentication requires more steps I0422 09:56:06.322646 3094 authenticatee.cpp:259] Received SASL authentication step I0422 09:56:06.322789 3094 authenticator.cpp:232] Received SASL authentication step I0422 09:56:06.322834 3094 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '82e6e8f010ed' server FQDN: '82e6e8f010ed' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false I0422 09:56:06.322854 3094 auxprop.cpp:181] Looking up auxiliary property '*userPassword' I0422 09:56:06.322906 3094 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' I0422 09:56:06.322939 3094 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '82e6e8f010ed' server FQDN: '82e6e8f010ed' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true I0422 09:56:06.322957 3094 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true I0422 09:56:06.322969 3094 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true I0422 09:56:06.322998 3094 authenticator.cpp:318] Authentication success I0422 09:56:06.323127 3095 authenticatee.cpp:299] Authentication success I0422 09:56:06.323241 3097 master.cpp:9708] Successfully authenticated principal 'test-principal' at slave(1244)@172.17.0.2:43435 I0422 09:56:06.323256 3090 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(2109)@172.17.0.2:43435 I0422 09:56:06.323668 3091 slave.cpp:1651] Successfully authenticated with master [email protected]:43435 I0422 09:56:06.324142 3091 slave.cpp:2101] Will retry registration in 14.604951ms if necessary I0422 09:56:06.324465 3082 master.cpp:6174] Received register agent message from slave(1244)@172.17.0.2:43435 (82e6e8f010ed) I0422 09:56:06.324998 3082 master.cpp:3705] Authorizing principal 'test-principal' to perform action REGISTER_AGENT on ANY object I0422 09:56:06.325748 3088 master.cpp:6241] Authorized registration of agent at slave(1244)@172.17.0.2:43435 (82e6e8f010ed) I0422 09:56:06.325857 3088 master.cpp:6353] Registering agent at slave(1244)@172.17.0.2:43435 (82e6e8f010ed) with id c61978a4-63c5-4e28-af9f-6f252c061e52-S0 I0422 09:56:06.326598 3089 registrar.cpp:487] Applied 1 operations in 261251ns; attempting to update the registry I0422 09:56:06.327411 3096 registrar.cpp:544] Successfully updated the registry in 739840ns I0422 09:56:06.327667 3093 master.cpp:6401] Admitted agent c61978a4-63c5-4e28-af9f-6f252c061e52-S0 at slave(1244)@172.17.0.2:43435 (82e6e8f010ed) I0422 09:56:06.328524 3093 master.cpp:6446] Registered agent c61978a4-63c5-4e28-af9f-6f252c061e52-S0 at slave(1244)@172.17.0.2:43435 (82e6e8f010ed) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0422 09:56:06.328649 3090 slave.cpp:1684] Registered with master [email protected]:43435; given agent ID c61978a4-63c5-4e28-af9f-6f252c061e52-S0 I0422 09:56:06.328748 3095 hierarchical.cpp:959] Added agent c61978a4-63c5-4e28-af9f-6f252c061e52-S0 (82e6e8f010ed) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] (offered or allocated: {}) I0422 09:56:06.328881 3082 task_status_update_manager.cpp:188] Resuming sending task status updates I0422 09:56:06.329210 3095 hierarchical.cpp:1853] Performed allocation for 1 agents in 169829ns I0422 09:56:06.329237 3090 slave.cpp:1719] Checkpointing SlaveInfo to '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_s7t57E/meta/slaves/c61978a4-63c5-4e28-af9f-6f252c061e52-S0/slave.info' I0422 09:56:06.329325 3085 status_update_manager_process.hpp:385] Resuming operation status update manager I0422 09:56:06.330544 3090 slave.cpp:1771] Forwarding agent update {"operations":{},"resource_providers":{},"resource_version_uuid":{"value":"f3UY+rngShe9NZ71FK9xpA=="},"slave_id":{"value":"c61978a4-63c5-4e28-af9f-6f252c061e52-S0"},"update_oversubscribed_resources":false} I0422 09:56:06.331352 3090 master.cpp:7584] Ignoring update on agent c61978a4-63c5-4e28-af9f-6f252c061e52-S0 at slave(1244)@172.17.0.2:43435 (82e6e8f010ed) as it reports no changes I0422 09:56:06.336072 3089 process.cpp:3671] Handling HTTP event for process 'slave(1244)' with path: '/slave(1244)/api/v1' I0422 09:56:06.337596 3091 http.cpp:1436] HTTP POST for /slave(1244)/api/v1 from 172.17.0.2:59748 I0422 09:56:06.338179 3091 http.cpp:2828] Processing GET_CONTAINERS call I0422 09:56:06.344544 3091 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0422 09:56:06.347133 3082 process.cpp:3671] Handling HTTP event for process 'slave(1244)' with path: '/slave(1244)/api/v1' I0422 09:56:06.348392 3094 http.cpp:1436] HTTP POST for /slave(1244)/api/v1 from 172.17.0.2:59750 I0422 09:56:06.349164 3094 http.cpp:3289] Processing LAUNCH_CONTAINER call for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0422 09:56:06.350258 3096 http.cpp:3399] Creating sandbox '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_s7t57E/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0422 09:56:06.362274 3090 hierarchical.cpp:1853] Performed allocation for 1 agents in 145124ns I0422 09:56:06.365836 3091 containerizer.cpp:1397] Starting container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0422 09:56:06.366633 3091 containerizer.cpp:3377] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from STARTING to PROVISIONING after 327168ns I0422 09:56:06.367583 3091 containerizer.cpp:1576] Checkpointed ContainerConfig at '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_bhWAmo/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE/config' I0422 09:56:06.367650 3091 containerizer.cpp:3377] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from PROVISIONING to PREPARING after 1.019136ms I0422 09:56:06.370746 3088 containerizer.cpp:2102] Launching 'mesos-containerizer' with flags '--help="false" --launch_info="{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v0","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_BR1ATV","--available_capacity=0B","--volumes=","--forward=unix:///tmp/QirDIc/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"environment":{"variables":[{"name":"MESOS_SANDBOX","type":"VALUE","value":"/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_s7t57E/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE"},{"name":"CSI_ENDPOINT","type":"VALUE","value":"unix:///tmp/mesos-csi-kEgNX2/endpoint.sock"}]},"task_environment":{},"working_directory":"/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_s7t57E/containers/o rg-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE"}" --pipe_read="110" --pipe_write="111" --runtime_directory="/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_bhWAmo/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE" --unshare_namespace_mnt="false"' I0422 09:56:06.380069 3088 launcher.cpp:145] Forked child with pid '14695' for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0422 09:56:06.381057 3088 containerizer.cpp:3377] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from PREPARING to ISOLATING after 13.39776ms I0422 09:56:06.382880 3091 containerizer.cpp:3377] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from ISOLATING to FETCHING after 1.693952ms I0422 09:56:06.383352 3086 fetcher.cpp:369] Starting to fetch URIs for container: org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE, directory: /tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_s7t57E/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0422 09:56:06.399636 3084 containerizer.cpp:3377] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from FETCHING to RUNNING after 16.835328ms I0422 09:56:06.401980 3090 container_daemon.cpp:140] Invoking post-start hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0422 09:56:06.402158 3096 service_manager.cpp:703] Connecting to endpoint 'unix:///tmp/mesos-csi-kEgNX2/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0422 09:56:06.413957 3083 hierarchical.cpp:1853] Performed allocation for 1 agents in 249314ns I0422 09:56:06.465050 3084 hierarchical.cpp:1853] Performed allocation for 1 agents in 139506ns I0422 09:56:06.516410 3091 hierarchical.cpp:1853] Performed allocation for 1 agents in 161439ns I0422 09:56:06.567956 3084 hierarchical.cpp:1853] Performed allocation for 1 agents in 247520ns I0422 09:56:06.619706 3085 hierarchical.cpp:1853] Performed allocation for 1 agents in 192781ns I0422 09:56:06.671078 3095 hierarchical.cpp:1853] Performed allocation for 1 agents in 203454ns I0422 09:56:06.713783 3090 service_manager.cpp:545] Probing endpoint 'unix:///tmp/mesos-csi-kEgNX2/endpoint.sock' with CSI v1 I0422 09:56:06.716611 3085 service_manager.cpp:532] Probing endpoint 'unix:///tmp/mesos-csi-kEgNX2/endpoint.sock' with CSI v0 I0422 09:56:06.717988 14699 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Identity/Probe call I0422 09:56:06.721030 3083 container_daemon.cpp:171] Waiting for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0422 09:56:06.722040 3086 hierarchical.cpp:1853] Performed allocation for 1 agents in 146264ns I0422 09:56:06.723799 14699 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Identity/GetPluginCapabilities call I0422 09:56:06.724896 3090 process.cpp:3671] Handling HTTP event for process 'slave(1244)' with path: '/slave(1244)/api/v1' I0422 09:56:06.726428 3083 http.cpp:1436] HTTP POST for /slave(1244)/api/v1 from 172.17.0.2:59752 I0422 09:56:06.727001 3083 http.cpp:3513] Processing WAIT_CONTAINER call for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0422 09:56:06.728174 14699 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Identity/GetPluginInfo call I0422 09:56:06.728561 14699 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Identity/GetPluginInfo call I0422 09:56:06.730435 3088 v0_volume_manager.cpp:628] NODE_SERVICE loaded: {} I0422 09:56:06.730962 3088 v0_volume_manager.cpp:628] CONTROLLER_SERVICE loaded: {} I0422 09:56:06.733153 14699 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/ControllerGetCapabilities call I0422 09:56:06.736865 14699 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Node/NodeGetCapabilities call I0422 09:56:06.740341 14699 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Node/NodeGetId call I0422 09:56:06.742799 3094 provider.cpp:676] Recovered resources '{}' and 0 operations for resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test' I0422 09:56:06.743019 3089 status_update_manager_process.hpp:379] Pausing operation status update manager I0422 09:56:06.743283 3089 http_connection.hpp:227] New endpoint detected at http://172.17.0.2:43435/slave(1244)/api/v1/resource_provider I0422 09:56:06.746511 3087 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.2:43435/slave(1244)/api/v1/resource_provider I0422 09:56:06.747277 3088 provider.cpp:476] Connected to resource provider manager I0422 09:56:06.748006 3093 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.2:43435/slave(1244)/api/v1/resource_provider I0422 09:56:06.749194 3094 process.cpp:3671] Handling HTTP event for process 'slave(1244)' with path: '/slave(1244)/api/v1/resource_provider' I0422 09:56:06.750867 3085 http.cpp:1436] HTTP POST for /slave(1244)/api/v1/resource_provider from 172.17.0.2:59756 I0422 09:56:06.751726 3097 manager.cpp:779] Subscribing resource provider {"default_reservations":[{"role":"storage","type":"DYNAMIC"}],"name":"test","storage":{"plugin":{"containers":[{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v0","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_BR1ATV","--available_capacity=0B","--volumes=","--forward=unix:///tmp/QirDIc/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"resources":[{"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"}],"services":["CONTROLLER_SERVICE","NODE_SERVICE"]}],"name":"local","type":"org.apache.mesos.csi.test"},"reconciliation_interval_seconds":15.0},"type":"org.apache.mesos.rp.local.storage"} I0422 09:56:06.773785 3089 hierarchical.cpp:1853] Performed allocation for 1 agents in 210501ns I0422 09:56:06.786541 3092 slave.cpp:8702] Handling resource provider message 'SUBSCRIBE: {"default_reservations":[{"role":"storage","type":"DYNAMIC"}],"id":{"value":"8cd3e548-a726-43dd-8aca-b21d822753bc"},"name":"test","storage":{"plugin":{"containers":[{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v0","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_BR1ATV","--available_capacity=0B","--volumes=","--forward=unix:///tmp/QirDIc/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"resources":[{"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"}],"services":["CONTROLLER_SERVICE","NODE_SERVICE"]}],"name":"local","type":"org.apache.mesos.csi.test"},"reconciliation_interval_seconds":15.0},"type":"org.apache.mesos.rp.local.storage"}' I0422 09:56:06.788338 3095 provider.cpp:498] Received SUBSCRIBED event I0422 09:56:06.788381 3095 provider.cpp:1309] Subscribed with ID 8cd3e548-a726-43dd-8aca-b21d822753bc I0422 09:56:06.789122 3093 status_update_manager_process.hpp:314] Recovering operation status update manager I0422 09:56:06.825306 3089 hierarchical.cpp:1853] Performed allocation for 1 agents in 94965ns I0422 09:56:06.836402 3088 provider.cpp:790] Reconciling storage pools and volumes I0422 09:56:06.838719 14699 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/ListVolumes call I0422 09:56:06.841845 3082 provider.cpp:2217] Sending UPDATE_STATE call with resources '{}' and 0 operations to agent c61978a4-63c5-4e28-af9f-6f252c061e52-S0 I0422 09:56:06.842270 3082 provider.cpp:748] Resource provider 8cd3e548-a726-43dd-8aca-b21d822753bc is in READY state I0422 09:56:06.842262 3088 http_connection.hpp:131] Sending UPDATE_STATE call to http://172.17.0.2:43435/slave(1244)/api/v1/resource_provider I0422 09:56:06.842386 3096 status_update_manager_process.hpp:385] Resuming operation status update manager I0422 09:56:06.843200 3097 provider.cpp:1235] Updating profiles { test } for resource provider 8cd3e548-a726-43dd-8aca-b21d822753bc I0422 09:56:06.843523 3097 process.cpp:3671] Handling HTTP event for process 'slave(1244)' with path: '/slave(1244)/api/v1/resource_provider' I0422 09:56:06.844424 3086 provider.cpp:790] Reconciling storage pools and volumes I0422 09:56:06.845324 3096 http.cpp:1436] HTTP POST for /slave(1244)/api/v1/resource_provider from 172.17.0.2:59754 I0422 09:56:06.845892 3089 manager.cpp:1011] Received UPDATE_STATE call with resources '[]' and 0 operations from resource provider 8cd3e548-a726-43dd-8aca-b21d822753bc I0422 09:56:06.846120 3092 slave.cpp:8702] Handling resource provider message 'UPDATE_STATE: 8cd3e548-a726-43dd-8aca-b21d822753bc {}' I0422 09:56:06.846218 3092 slave.cpp:8822] Forwarding new total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0422 09:56:06.846827 14699 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/ListVolumes call I0422 09:56:06.847313 14699 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/GetCapacity call I0422 09:56:06.847990 3090 hierarchical.cpp:1110] Grew agent c61978a4-63c5-4e28-af9f-6f252c061e52-S0 by {} (total), { } (used) I0422 09:56:06.848711 3090 hierarchical.cpp:1067] Agent c61978a4-63c5-4e28-af9f-6f252c061e52-S0 (82e6e8f010ed) updated with total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0422 09:56:06.854141 3083 hierarchical.cpp:1853] Performed allocation for 1 agents in 163493ns I0422 09:56:06.854674 3093 provider.cpp:790] Reconciling storage pools and volumes I0422 09:56:06.857110 14699 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/ListVolumes call I0422 09:56:06.857517 14699 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/GetCapacity call I0422 09:56:06.868052 3088 slave.cpp:1000] Agent terminating I0422 09:56:06.869045 3088 manager.cpp:127] Terminating resource provider 8cd3e548-a726-43dd-8aca-b21d822753bc I0422 09:56:06.869607 3088 master.cpp:1292] Agent c61978a4-63c5-4e28-af9f-6f252c061e52-S0 at slave(1244)@172.17.0.2:43435 (82e6e8f010ed) disconnected I0422 09:56:06.869643 3088 master.cpp:3361] Disconnecting agent c61978a4-63c5-4e28-af9f-6f252c061e52-S0 at slave(1244)@172.17.0.2:43435 (82e6e8f010ed) I0422 09:56:06.869726 3088 master.cpp:3380] Deactivating agent c61978a4-63c5-4e28-af9f-6f252c061e52-S0 at slave(1244)@172.17.0.2:43435 (82e6e8f010ed) I0422 09:56:06.869951 3086 hierarchical.cpp:1156] Agent c61978a4-63c5-4e28-af9f-6f252c061e52-S0 deactivated E0422 09:56:06.870226 3083 http_connection.hpp:449] End-Of-File received I0422 09:56:06.870642 3083 http_connection.hpp:217] Re-detecting endpoint I0422 09:56:06.871166 3083 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0422 09:56:06.871237 3083 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0422 09:56:06.871264 3093 provider.cpp:488] Disconnected from resource provider manager I0422 09:56:06.871310 3083 http_connection.hpp:227] New endpoint detected at http://172.17.0.2:43435/slave(1244)/api/v1/resource_provider I0422 09:56:06.871392 3097 status_update_manager_process.hpp:379] Pausing operation status update manager I0422 09:56:06.872841 3084 containerizer.cpp:2679] Destroying container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE in RUNNING state I0422 09:56:06.872908 3084 containerizer.cpp:3377] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from RUNNING to DESTROYING after 15.473331968secs I0422 09:56:06.873392 3084 launcher.cpp:161] Asked to destroy container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0422 09:56:06.874367 3093 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.2:43435/slave(1244)/api/v1/resource_provider I0422 09:56:06.875088 3085 provider.cpp:476] Connected to resource provider manager I0422 09:56:06.875736 3083 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.2:43435/slave(1244)/api/v1/resource_provider I0422 09:56:06.876703 3098 process.cpp:2781] Returning '404 Not Found' for '/slave(1244)/api/v1/resource_provider' E0422 09:56:06.878046 3096 provider.cpp:721] Failed to subscribe resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test': Received '404 Not Found' () I0422 09:56:06.900168 3097 hierarchical.cpp:1853] Performed allocation for 1 agents in 198338ns I0422 09:56:06.950373 3095 containerizer.cpp:3215] Container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE has exited I0422 09:56:06.951745 3082 hierarchical.cpp:1853] Performed allocation for 1 agents in 117279ns I0422 09:56:06.952383 3088 provisioner.cpp:652] Ignoring destroy request for unknown container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0422 09:56:06.955307 3090 container_daemon.cpp:189] Invoking post-stop hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0422 09:56:06.955543 3096 service_manager.cpp:723] Disconnected from endpoint 'unix:///tmp/mesos-csi-kEgNX2/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0422 09:56:06.955865 3091 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0422 09:56:06.958540 3098 process.cpp:2781] Returning '404 Not Found' for '/slave(1244)/api/v1' I0422 09:56:06.970674 3081 master.cpp:1140] Master terminating I0422 09:56:06.971006 3087 hierarchical.cpp:1132] Removed all filters for agent c61978a4-63c5-4e28-af9f-6f252c061e52-S0 I0422 09:56:06.971033 3087 hierarchical.cpp:1008] Removed agent c61978a4-63c5-4e28-af9f-6f252c061e52-S0 [ OK ] CSIVersion/StorageLocalResourceProviderTest.Update/v0 (711 ms) [ RUN ] CSIVersion/StorageLocalResourceProviderTest.Update/v1 I0422 09:56:06.986824 3081 cluster.cpp:186] Creating default 'local' authorizer I0422 09:56:06.991477 3092 master.cpp:443] Master d0f9d580-b3e0-46bf-a0e3-e28a9def9daf (82e6e8f010ed) started on 172.17.0.2:43435 I0422 09:56:06.991513 3092 master.cpp:446] Flags at startup: --acls="" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins" --allocation_interval="50ms" --allocator="hierarchical" --authenticate_agents="true" --authenticate_frameworks="true" --authenticate_http_frameworks="true" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authentication_v0_timeout="15secs" --authenticators="crammd5" --authorizers="local" --credentials="/tmp/bFTkju/credentials" --filter_gpu_resources="true" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_framework_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_operator_event_stream_subscribers="1000" --max_unreachable_tasks_per_framework="1000" --memory_profiling="false" --min_alloca table_resources="cpus:0.01|mem:32" --port="5050" --publish_per_framework_metrics="true" --quiet="false" --recovery_agent_removal_limit="100%" --registry="in_memory" --registry_fetch_timeout="1mins" --registry_gc_interval="15mins" --registry_max_agent_age="2weeks" --registry_max_agent_count="102400" --registry_store_timeout="100secs" --registry_strict="false" --require_agent_domain="false" --role_sorter="drf" --root_submissions="true" --version="false" --webui_dir="/tmp/SRC/build/mesos-1.10.0/_inst/share/mesos/webui" --work_dir="/tmp/bFTkju/master" --zk_session_timeout="10secs" I0422 09:56:06.991995 3092 master.cpp:495] Master only allowing authenticated frameworks to register I0422 09:56:06.992015 3092 master.cpp:501] Master only allowing authenticated agents to register I0422 09:56:06.992027 3092 master.cpp:507] Master only allowing authenticated HTTP frameworks to register I0422 09:56:06.992041 3092 credentials.hpp:37] Loading credentials for authentication from '/tmp/bFTkju/credentials' I0422 09:56:06.992341 3092 master.cpp:551] Using default 'crammd5' authenticator I0422 09:56:06.992591 3092 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readonly' I0422 09:56:06.992866 3092 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readwrite' I0422 09:56:06.993135 3092 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-master-scheduler' I0422 09:56:06.993345 3092 master.cpp:632] Authorization enabled I0422 09:56:06.993726 3089 whitelist_watcher.cpp:77] No whitelist given I0422 09:56:06.993743 3088 hierarchical.cpp:567] Initialized hierarchical allocator process I0422 09:56:06.997100 3087 master.cpp:2165] Elected as the leading master! I0422 09:56:06.997138 3087 master.cpp:1661] Recovering from registrar I0422 09:56:06.997475 3095 registrar.cpp:339] Recovering registrar I0422 09:56:06.998306 3095 registrar.cpp:383] Successfully fetched the registry (0B) in 0ns I0422 09:56:06.998450 3095 registrar.cpp:487] Applied 1 operations in 50418ns; attempting to update the registry I0422 09:56:06.999189 3095 registrar.cpp:544] Successfully updated the registry in 0ns I0422 09:56:06.999356 3095 registrar.cpp:416] Successfully recovered registrar I0422 09:56:06.999974 3088 master.cpp:1814] Recovered 0 agents from the registry (144B); allowing 10mins for agents to reregister I0422 09:56:07.000000 3092 hierarchical.cpp:606] Skipping recovery of hierarchical allocator: nothing to recover W0422 09:56:07.005578 3081 process.cpp:2877] Attempted to spawn already running process [email protected]:43435 I0422 09:56:07.006932 3081 containerizer.cpp:317] Using isolation { environment_secret, posix/cpu, posix/mem, filesystem/posix, network/cni } W0422 09:56:07.007541 3081 backend.cpp:76] Failed to create 'overlay' backend: OverlayBackend requires root privileges W0422 09:56:07.007568 3081 backend.cpp:76] Failed to create 'aufs' backend: AufsBackend requires root privileges W0422 09:56:07.007584 3081 backend.cpp:76] Failed to create 'bind' backend: BindBackend requires root privileges I0422 09:56:07.007614 3081 provisioner.cpp:294] Using default backend 'copy' I0422 09:56:07.010316 3081 cluster.cpp:533] Creating default 'local' authorizer I0422 09:56:07.012761 3091 slave.cpp:279] Mesos agent started on (1245)@172.17.0.2:43435 I0422 09:56:07.012789 3091 slave.cpp:280] Flags at startup: --acls="" --appc_simple_discovery_uri_prefix="http://"; --appc_store_dir="/tmp/bFTkju/72PXDw/store/appc" --authenticate_http_readonly="true" --authenticate_http_readwrite="false" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authentication_timeout_max="1mins" --authentication_timeout_min="5secs" --authorizer="local" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_destroy_timeout="1mins" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="mesos" --credential="/tmp/bFTkju/72PXDw/credential" --default_role="*" --disallow_sharing_agent_ipc_namespace="false" --disallow_sharing_agent_pid_namespace="false" --disk_profile_adaptor="org_apache_mesos_UriDiskProfileAdaptor" --disk_watch_interval="1mins" --docker="docker" --docker_ignore_runtime="false" --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io"; --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/bFTkju/72PXDw/store/docker" --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume" --docker_volume_chown="false" --enforce_container_disk_quota="false" --executor_registration_timeout="1mins" --executor_reregistration_timeout="2secs" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/bFTkju/72PXDw/fetch" --fetcher_cache_size="2GB" --fetcher_stall_timeout="1mins" --frameworks_home="/tmp/bFTkju/72PXDw/frameworks" --gc_delay="1weeks" --gc_disk_headroom="0.1" --gc_non_executor_container_sandboxes="false" --help="false" --hostname_lookup="true" --http_command_executor="false" --http_credentials="/tmp/bFTkju/72PXDw/http_credentials" --http_executor_domain_sockets="false" --http_heartbeat_interval="30secs" --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem" --launcher="posi x" --launcher_dir="/tmp/SRC/build/mesos-1.10.0/_build/sub/src" --logbufsecs="0" --logging_level="INFO" --max_completed_executors_per_framework="150" --memory_profiling="false" --network_cni_metrics="true" --network_cni_root_dir_persist="false" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns" --quiet="false" --reconfiguration_policy="equal" --recover="reconnect" --recovery_timeout="15mins" --registration_backoff_factor="10ms" --resource_provider_config_dir="/tmp/bFTkju/resource_provider_configs" --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]" --revocable_cpu_low_priority="true" --runtime_dir="/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_6V1XxL" --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true" --systemd_enable_support="true" --systemd_runtime_directory="/run/systemd/system" --version="false" --work_dir="/tmp/CSIVersion_StorageLoca lResourceProviderTest_Update_v1_5GVYr0" --zk_session_timeout="10secs" I0422 09:56:07.013207 3091 credentials.hpp:86] Loading credential for authentication from '/tmp/bFTkju/72PXDw/credential' I0422 09:56:07.013366 3091 slave.cpp:312] Agent using credential for: test-principal I0422 09:56:07.013391 3091 credentials.hpp:37] Loading credentials for authentication from '/tmp/bFTkju/72PXDw/http_credentials' I0422 09:56:07.013622 3091 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-agent-readonly' I0422 09:56:07.013974 3091 disk_profile_adaptor.cpp:82] Creating disk profile adaptor module 'org_apache_mesos_UriDiskProfileAdaptor' I0422 09:56:07.015453 3091 slave.cpp:627] Agent resources: [{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}] I0422 09:56:07.015671 3091 slave.cpp:635] Agent attributes: [ ] I0422 09:56:07.015699 3091 slave.cpp:644] Agent hostname: 82e6e8f010ed I0422 09:56:07.015830 3094 uri_disk_profile_adaptor.cpp:305] Updated disk profile mapping to 1 active profiles I0422 09:56:07.015947 3090 status_update_manager_process.hpp:379] Pausing operation status update manager I0422 09:56:07.015985 3084 task_status_update_manager.cpp:181] Pausing sending task status updates I0422 09:56:07.017498 3093 state.cpp:68] Recovering state from '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_5GVYr0/meta' I0422 09:56:07.017756 3087 slave.cpp:7711] Finished recovering checkpointed state from '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_5GVYr0/meta', beginning agent recovery I0422 09:56:07.018424 3082 task_status_update_manager.cpp:207] Recovering task status update manager I0422 09:56:07.018924 3089 containerizer.cpp:822] Recovering Mesos containers I0422 09:56:07.019372 3089 containerizer.cpp:1162] Recovering isolators I0422 09:56:07.020551 3096 containerizer.cpp:1201] Recovering provisioner I0422 09:56:07.021507 3085 provisioner.cpp:518] Provisioner recovery complete I0422 09:56:07.022482 3086 composing.cpp:343] Finished recovering all containerizers I0422 09:56:07.022797 3083 slave.cpp:8193] Recovering executors I0422 09:56:07.022941 3083 slave.cpp:8346] Finished recovery I0422 09:56:07.023125 3093 hierarchical.cpp:1853] Performed allocation for 0 agents in 97852ns I0422 09:56:07.023756 3088 task_status_update_manager.cpp:181] Pausing sending task status updates I0422 09:56:07.023782 3085 status_update_manager_process.hpp:379] Pausing operation status update manager I0422 09:56:07.023772 3083 slave.cpp:1459] New master detected at [email protected]:43435 I0422 09:56:07.023967 3083 slave.cpp:1524] Detecting new master I0422 09:56:07.033473 3082 slave.cpp:1551] Authenticating with master [email protected]:43435 I0422 09:56:07.033582 3082 slave.cpp:1560] Using default CRAM-MD5 authenticatee I0422 09:56:07.033978 3090 authenticatee.cpp:121] Creating new client SASL connection I0422 09:56:07.034375 3084 master.cpp:9676] Authenticating slave(1245)@172.17.0.2:43435 I0422 09:56:07.034641 3094 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(2110)@172.17.0.2:43435 I0422 09:56:07.035006 3089 authenticator.cpp:98] Creating new server SASL connection I0422 09:56:07.035308 3086 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 I0422 09:56:07.035353 3086 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' I0422 09:56:07.035513 3093 authenticator.cpp:204] Received SASL authentication start I0422 09:56:07.035600 3093 authenticator.cpp:326] Authentication requires more steps I0422 09:56:07.035753 3093 authenticatee.cpp:259] Received SASL authentication step I0422 09:56:07.035965 3087 authenticator.cpp:232] Received SASL authentication step I0422 09:56:07.036021 3087 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '82e6e8f010ed' server FQDN: '82e6e8f010ed' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false I0422 09:56:07.036059 3087 auxprop.cpp:181] Looking up auxiliary property '*userPassword' I0422 09:56:07.036137 3087 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' I0422 09:56:07.036178 3087 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '82e6e8f010ed' server FQDN: '82e6e8f010ed' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true I0422 09:56:07.036198 3087 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true I0422 09:56:07.036211 3087 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true I0422 09:56:07.036242 3087 authenticator.cpp:318] Authentication success I0422 09:56:07.036402 3096 authenticatee.cpp:299] Authentication success I0422 09:56:07.036514 3092 master.cpp:9708] Successfully authenticated principal 'test-principal' at slave(1245)@172.17.0.2:43435 I0422 09:56:07.036576 3088 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(2110)@172.17.0.2:43435 I0422 09:56:07.036983 3085 slave.cpp:1651] Successfully authenticated with master [email protected]:43435 I0422 09:56:07.037446 3085 slave.cpp:2101] Will retry registration in 12.904646ms if necessary I0422 09:56:07.037667 3090 master.cpp:6174] Received register agent message from slave(1245)@172.17.0.2:43435 (82e6e8f010ed) I0422 09:56:07.038130 3090 master.cpp:3705] Authorizing principal 'test-principal' to perform action REGISTER_AGENT on ANY object I0422 09:56:07.038808 3086 master.cpp:6241] Authorized registration of agent at slave(1245)@172.17.0.2:43435 (82e6e8f010ed) I0422 09:56:07.038926 3086 master.cpp:6353] Registering agent at slave(1245)@172.17.0.2:43435 (82e6e8f010ed) with id d0f9d580-b3e0-46bf-a0e3-e28a9def9daf-S0 I0422 09:56:07.039674 3093 registrar.cpp:487] Applied 1 operations in 260682ns; attempting to update the registry I0422 09:56:07.040421 3091 registrar.cpp:544] Successfully updated the registry in 652800ns I0422 09:56:07.040695 3082 master.cpp:6401] Admitted agent d0f9d580-b3e0-46bf-a0e3-e28a9def9daf-S0 at slave(1245)@172.17.0.2:43435 (82e6e8f010ed) I0422 09:56:07.041602 3082 master.cpp:6446] Registered agent d0f9d580-b3e0-46bf-a0e3-e28a9def9daf-S0 at slave(1245)@172.17.0.2:43435 (82e6e8f010ed) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0422 09:56:07.041685 3085 slave.cpp:1684] Registered with master [email protected]:43435; given agent ID d0f9d580-b3e0-46bf-a0e3-e28a9def9daf-S0 I0422 09:56:07.041812 3094 hierarchical.cpp:959] Added agent d0f9d580-b3e0-46bf-a0e3-e28a9def9daf-S0 (82e6e8f010ed) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] (offered or allocated: {}) I0422 09:56:07.041846 3084 task_status_update_manager.cpp:188] Resuming sending task status updates I0422 09:56:07.042228 3085 slave.cpp:1719] Checkpointing SlaveInfo to '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_5GVYr0/meta/slaves/d0f9d580-b3e0-46bf-a0e3-e28a9def9daf-S0/slave.info' I0422 09:56:07.042299 3089 status_update_manager_process.hpp:385] Resuming operation status update manager I0422 09:56:07.042297 3094 hierarchical.cpp:1853] Performed allocation for 1 agents in 181168ns I0422 09:56:07.043539 3085 slave.cpp:1771] Forwarding agent update {"operations":{},"resource_providers":{},"resource_version_uuid":{"value":"LbUGhMA3Toyy53cd60MZ/A=="},"slave_id":{"value":"d0f9d580-b3e0-46bf-a0e3-e28a9def9daf-S0"},"update_oversubscribed_resources":false} I0422 09:56:07.044443 3087 master.cpp:7584] Ignoring update on agent d0f9d580-b3e0-46bf-a0e3-e28a9def9daf-S0 at slave(1245)@172.17.0.2:43435 (82e6e8f010ed) as it reports no changes I0422 09:56:07.048939 3086 process.cpp:3671] Handling HTTP event for process 'slave(1245)' with path: '/slave(1245)/api/v1' I0422 09:56:07.050504 3091 http.cpp:1436] HTTP POST for /slave(1245)/api/v1 from 172.17.0.2:59766 I0422 09:56:07.051026 3091 http.cpp:2828] Processing GET_CONTAINERS call I0422 09:56:07.057682 3091 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0422 09:56:07.060482 3082 process.cpp:3671] Handling HTTP event for process 'slave(1245)' with path: '/slave(1245)/api/v1' I0422 09:56:07.061836 3094 http.cpp:1436] HTTP POST for /slave(1245)/api/v1 from 172.17.0.2:59768 I0422 09:56:07.062721 3094 http.cpp:3289] Processing LAUNCH_CONTAINER call for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0422 09:56:07.064018 3092 http.cpp:3399] Creating sandbox '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_5GVYr0/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0422 09:56:07.074649 3087 hierarchical.cpp:1853] Performed allocation for 1 agents in 174692ns I0422 09:56:07.084272 3090 containerizer.cpp:1397] Starting container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0422 09:56:07.085021 3090 containerizer.cpp:3377] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from STARTING to PROVISIONING after 316672ns I0422 09:56:07.085935 3090 containerizer.cpp:1576] Checkpointed ContainerConfig at '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_6V1XxL/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE/config' I0422 09:56:07.086000 3090 containerizer.cpp:3377] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from PROVISIONING to PREPARING after 983040ns I0422 09:56:07.089360 3086 containerizer.cpp:2102] Launching 'mesos-containerizer' with flags '--help="false" --launch_info="{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v1","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_waK0lf","--available_capacity=0B","--volumes=","--forward=unix:///tmp/bFTkju/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"environment":{"variables":[{"name":"MESOS_SANDBOX","type":"VALUE","value":"/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_5GVYr0/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE"},{"name":"CSI_ENDPOINT","type":"VALUE","value":"unix:///tmp/mesos-csi-AHFitz/endpoint.sock"}]},"task_environment":{},"working_directory":"/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_5GVYr0/containers/o rg-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE"}" --pipe_read="110" --pipe_write="111" --runtime_directory="/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_6V1XxL/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE" --unshare_namespace_mnt="false"' I0422 09:56:07.101548 3086 launcher.cpp:145] Forked child with pid '14708' for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0422 09:56:07.102645 3086 containerizer.cpp:3377] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from PREPARING to ISOLATING after 16.63616ms I0422 09:56:07.104223 3086 containerizer.cpp:3377] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from ISOLATING to FETCHING after 1.583872ms I0422 09:56:07.104739 3095 fetcher.cpp:369] Starting to fetch URIs for container: org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE, directory: /tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_5GVYr0/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0422 09:56:07.123008 3093 containerizer.cpp:3377] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from FETCHING to RUNNING after 18.726144ms I0422 09:56:07.125170 3092 container_daemon.cpp:140] Invoking post-start hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0422 09:56:07.125411 3087 service_manager.cpp:703] Connecting to endpoint 'unix:///tmp/mesos-csi-AHFitz/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0422 09:56:07.125723 3091 hierarchical.cpp:1853] Performed allocation for 1 agents in 161071ns I0422 09:56:07.177192 3090 hierarchical.cpp:1853] Performed allocation for 1 agents in 130892ns I0422 09:56:07.228665 3082 hierarchical.cpp:1853] Performed allocation for 1 agents in 138102ns I0422 09:56:07.280243 3090 hierarchical.cpp:1853] Performed allocation for 1 agents in 206532ns I0422 09:56:07.331945 3082 hierarchical.cpp:1853] Performed allocation for 1 agents in 296670ns I0422 09:56:07.383524 3093 hierarchical.cpp:1853] Performed allocation for 1 agents in 193964ns I0422 09:56:07.434796 3096 hierarchical.cpp:1853] Performed allocation for 1 agents in 227294ns I0422 09:56:07.437002 3088 service_manager.cpp:545] Probing endpoint 'unix:///tmp/mesos-csi-AHFitz/endpoint.sock' with CSI v1 I0422 09:56:07.438927 14712 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Identity/Probe call I0422 09:56:07.442085 3091 container_daemon.cpp:171] Waiting for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0422 09:56:07.445073 14712 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Identity/GetPluginCapabilities call I0422 09:56:07.445812 3092 process.cpp:3671] Handling HTTP event for process 'slave(1245)' with path: '/slave(1245)/api/v1' I0422 09:56:07.447338 3091 http.cpp:1436] HTTP POST for /slave(1245)/api/v1 from 172.17.0.2:59770 I0422 09:56:07.447943 3091 http.cpp:3513] Processing WAIT_CONTAINER call for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0422 09:56:07.449771 14712 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Identity/GetPluginInfo call I0422 09:56:07.450107 14712 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Identity/GetPluginInfo call I0422 09:56:07.451961 3082 v1_volume_manager.cpp:649] NODE_SERVICE loaded: {} I0422 09:56:07.452478 3082 v1_volume_manager.cpp:649] CONTROLLER_SERVICE loaded: {} I0422 09:56:07.454773 14712 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/ControllerGetCapabilities call I0422 09:56:07.458623 14712 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Node/NodeGetCapabilities call I0422 09:56:07.462301 14712 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Node/NodeGetInfo call I0422 09:56:07.464838 3095 provider.cpp:676] Recovered resources '{}' and 0 operations for resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test' I0422 09:56:07.465039 3093 status_update_manager_process.hpp:379] Pausing operation status update manager I0422 09:56:07.465437 3091 http_connection.hpp:227] New endpoint detected at http://172.17.0.2:43435/slave(1245)/api/v1/resource_provider I0422 09:56:07.468533 3090 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.2:43435/slave(1245)/api/v1/resource_provider I0422 09:56:07.469259 3086 provider.cpp:476] Connected to resource provider manager I0422 09:56:07.470022 3093 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.2:43435/slave(1245)/api/v1/resource_provider I0422 09:56:07.471278 3097 process.cpp:3671] Handling HTTP event for process 'slave(1245)' with path: '/slave(1245)/api/v1/resource_provider' I0422 09:56:07.473351 3087 http.cpp:1436] HTTP POST for /slave(1245)/api/v1/resource_provider from 172.17.0.2:59774 I0422 09:56:07.474112 3087 manager.cpp:779] Subscribing resource provider {"default_reservations":[{"role":"storage","type":"DYNAMIC"}],"name":"test","storage":{"plugin":{"containers":[{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v1","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_waK0lf","--available_capacity=0B","--volumes=","--forward=unix:///tmp/bFTkju/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"resources":[{"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"}],"services":["CONTROLLER_SERVICE","NODE_SERVICE"]}],"name":"local","type":"org.apache.mesos.csi.test"},"reconciliation_interval_seconds":15.0},"type":"org.apache.mesos.rp.local.storage"} I0422 09:56:07.486090 3095 hierarchical.cpp:1853] Performed allocation for 1 agents in 186355ns I0422 09:56:07.509339 3085 slave.cpp:8702] Handling resource provider message 'SUBSCRIBE: {"default_reservations":[{"role":"storage","type":"DYNAMIC"}],"id":{"value":"105cc351-a4d1-4d1b-9179-df342d4c3085"},"name":"test","storage":{"plugin":{"containers":[{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v1","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_waK0lf","--available_capacity=0B","--volumes=","--forward=unix:///tmp/bFTkju/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"resources":[{"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"}],"services":["CONTROLLER_SERVICE","NODE_SERVICE"]}],"name":"local","type":"org.apache.mesos.csi.test"},"reconciliation_interval_seconds":15.0},"type":"org.apache.mesos.rp.local.storage"}' I0422 09:56:07.511240 3086 provider.cpp:498] Received SUBSCRIBED event I0422 09:56:07.511292 3086 provider.cpp:1309] Subscribed with ID 105cc351-a4d1-4d1b-9179-df342d4c3085 I0422 09:56:07.512286 3093 status_update_manager_process.hpp:314] Recovering operation status update manager I0422 09:56:07.537176 3082 hierarchical.cpp:1853] Performed allocation for 1 agents in 108390ns I0422 09:56:07.564615 3095 provider.cpp:790] Reconciling storage pools and volumes I0422 09:56:07.566963 14712 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/ListVolumes call I0422 09:56:07.569957 3096 provider.cpp:2217] Sending UPDATE_STATE call with resources '{}' and 0 operations to agent d0f9d580-b3e0-46bf-a0e3-e28a9def9daf-S0 I0422 09:56:07.570320 3096 provider.cpp:748] Resource provider 105cc351-a4d1-4d1b-9179-df342d4c3085 is in READY state I0422 09:56:07.570312 3087 http_connection.hpp:131] Sending UPDATE_STATE call to http://172.17.0.2:43435/slave(1245)/api/v1/resource_provider I0422 09:56:07.570430 3083 status_update_manager_process.hpp:385] Resuming operation status update manager I0422 09:56:07.571238 3088 provider.cpp:1235] Updating profiles { test } for resource provider 105cc351-a4d1-4d1b-9179-df342d4c3085 I0422 09:56:07.571661 3086 process.cpp:3671] Handling HTTP event for process 'slave(1245)' with path: '/slave(1245)/api/v1/resource_provider' I0422 09:56:07.572582 3083 provider.cpp:790] Reconciling storage pools and volumes I0422 09:56:07.573354 3095 http.cpp:1436] HTTP POST for /slave(1245)/api/v1/resource_provider from 172.17.0.2:59772 I0422 09:56:07.573876 3095 manager.cpp:1011] Received UPDATE_STATE call with resources '[]' and 0 operations from resource provider 105cc351-a4d1-4d1b-9179-df342d4c3085 I0422 09:56:07.574051 3086 slave.cpp:8702] Handling resource provider message 'UPDATE_STATE: 105cc351-a4d1-4d1b-9179-df342d4c3085 {}' I0422 09:56:07.574141 3086 slave.cpp:8822] Forwarding new total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0422 09:56:07.574573 14712 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/ListVolumes call I0422 09:56:07.575001 14712 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/GetCapacity call I0422 09:56:07.575593 3088 hierarchical.cpp:1110] Grew agent d0f9d580-b3e0-46bf-a0e3-e28a9def9daf-S0 by {} (total), { } (used) I0422 09:56:07.576272 3088 hierarchical.cpp:1067] Agent d0f9d580-b3e0-46bf-a0e3-e28a9def9daf-S0 (82e6e8f010ed) updated with total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0422 09:56:07.581290 3094 hierarchical.cpp:1853] Performed allocation for 1 agents in 225119ns I0422 09:56:07.581439 3097 provider.cpp:790] Reconciling storage pools and volumes I0422 09:56:07.583416 14712 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/ListVolumes call I0422 09:56:07.584118 14712 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/GetCapacity call I0422 09:56:07.594439 3090 slave.cpp:1000] Agent terminating I0422 09:56:07.595257 3090 manager.cpp:127] Terminating resource provider 105cc351-a4d1-4d1b-9179-df342d4c3085 I0422 09:56:07.595741 3089 master.cpp:1292] Agent d0f9d580-b3e0-46bf-a0e3-e28a9def9daf-S0 at slave(1245)@172.17.0.2:43435 (82e6e8f010ed) disconnected I0422 09:56:07.595784 3089 master.cpp:3361] Disconnecting agent d0f9d580-b3e0-46bf-a0e3-e28a9def9daf-S0 at slave(1245)@172.17.0.2:43435 (82e6e8f010ed) I0422 09:56:07.595960 3089 master.cpp:3380] Deactivating agent d0f9d580-b3e0-46bf-a0e3-e28a9def9daf-S0 at slave(1245)@172.17.0.2:43435 (82e6e8f010ed) I0422 09:56:07.596195 3093 hierarchical.cpp:1156] Agent d0f9d580-b3e0-46bf-a0e3-e28a9def9daf-S0 deactivated E0422 09:56:07.596673 3094 http_connection.hpp:449] End-Of-File received I0422 09:56:07.597200 3094 http_connection.hpp:217] Re-detecting endpoint I0422 09:56:07.597779 3094 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0422 09:56:07.597859 3094 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0422 09:56:07.597929 3090 provider.cpp:488] Disconnected from resource provider manager I0422 09:56:07.597996 3094 http_connection.hpp:227] New endpoint detected at http://172.17.0.2:43435/slave(1245)/api/v1/resource_provider I0422 09:56:07.598078 3092 status_update_manager_process.hpp:379] Pausing operation status update manager I0422 09:56:07.599560 3087 containerizer.cpp:2679] Destroying container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE in RUNNING state I0422 09:56:07.599625 3087 containerizer.cpp:3377] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from RUNNING to DESTROYING after 15.47668096secs I0422 09:56:07.600143 3087 launcher.cpp:161] Asked to destroy container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0422 09:56:07.601047 3085 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.2:43435/slave(1245)/api/v1/resource_provider I0422 09:56:07.601742 3095 provider.cpp:476] Connected to resource provider manager I0422 09:56:07.602461 3088 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.2:43435/slave(1245)/api/v1/resource_provider I0422 09:56:07.603478 3098 process.cpp:2781] Returning '404 Not Found' for '/slave(1245)/api/v1/resource_provider' E0422 09:56:07.604954 3082 provider.cpp:721] Failed to subscribe resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test': Received '404 Not Found' () I0422 09:56:07.627940 3092 hierarchical.cpp:1853] Performed allocation for 1 agents in 199968ns I0422 09:56:07.678421 3083 containerizer.cpp:3215] Container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE has exited I0422 09:56:07.678740 3093 hierarchical.cpp:1853] Performed allocation for 1 agents in 115725ns I0422 09:56:07.680279 3082 provisioner.cpp:652] Ignoring destroy request for unknown container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0422 09:56:07.683043 3094 container_daemon.cpp:189] Invoking post-stop hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0422 09:56:07.683338 3084 service_manager.cpp:723] Disconnected from endpoint 'unix:///tmp/mesos-csi-AHFitz/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0422 09:56:07.683691 3084 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0422 09:56:07.686671 3098 process.cpp:2781] Returning '404 Not Found' for '/slave(1245)/api/v1' I0422 09:56:07.698905 3081 master.cpp:1140] Master terminating I0422 09:56:07.699208 3096 hierarchical.cpp:1132] Removed all filters for agent d0f9d580-b3e0-46bf-a0e3-e28a9def9daf-S0 I0422 09:56:07.699237 3096 hierarchical.cpp:1008] Removed agent d0f9d580-b3e0-46bf-a0e3-e28a9def9daf-S0 [ OK ] CSIVersion/StorageLocalResourceProviderTest.Update/v1 (725 ms) [----------] 54 tests from CSIVersion/StorageLocalResourceProviderTest (94078 ms total) [----------] Global test environment tear-down [==========] 2320 tests from 223 test cases ran. (1081755 ms total) [ PASSED ] 2319 tests. [ FAILED ] 1 test, listed below: [ FAILED ] SlaveTest.StatisticsEndpointRunningExecutor 1 FAILED TEST YOU HAVE 34 DISABLED TESTS I0422 09:56:07.786168 3098 process.cpp:935] Stopped the socket accept loop Makefile:15957: recipe for target 'check-local' failed make[4]: *** [check-local] Error 1 make[4]: Leaving directory '/tmp/SRC/build/mesos-1.10.0/_build/sub/src' Makefile:15073: recipe for target 'check-am' failed make[3]: *** [check-am] Error 2 make[3]: Leaving directory '/tmp/SRC/build/mesos-1.10.0/_build/sub/src' Makefile:15077: recipe for target 'check' failed make[2]: *** [check] Error 2 make[2]: Leaving directory '/tmp/SRC/build/mesos-1.10.0/_build/sub/src' Makefile:785: recipe for target 'check-recursive' failed make[1]: *** [check-recursive] Error 1 make[1]: Leaving directory '/tmp/SRC/build/mesos-1.10.0/_build/sub' Makefile:991: recipe for target 'distcheck' failed make: *** [distcheck] Error 1 Untagged: mesos/mesos-build:ubuntu-16.04 Untagged: mesos/mesos-build@sha256:fa967cbcfb44f55708a3cbc87f245c6d29dd891464db558af56a03ee321526bb Deleted: sha256:e895c0531b9a9a288fabe479a49f7059aed83645351ac99ec2ea2616822c9f97 Deleted: sha256:09119b0b314a69ba6ec6251f2e89f4199fe1e874c84f9abf07dcbd23dbc3f1c1 Deleted: sha256:562fe6af5a3883058be9c784a839392215ed4185a21d21f1d99df0d17f3ae6e7 Deleted: sha256:0dcdfbe322a4f332f73ac70905d557300ec6dae3bd19586758772c750c7b4a19 Deleted: sha256:c66652d605f01094e2db53d62505dbd524e076d5aa69b89d5e620003803eb149 Deleted: sha256:a2cf79bfb9593c05fd7142ddb49afef77ea4ad5d2464e841f09fe62ffee396e0 Deleted: sha256:f7a904214b390f39d98573882f631dc908df8b2b540cf04e1062f8182c1efffd Deleted: sha256:ce1f6fcaa83dfce189d76e08f184085732eab4eeb2562d2399953958405c5bec Deleted: sha256:cce92fda689ab9033f0b8db214bc63edd1ae3e05831a0f3a9418976d7dc7ccdd Deleted: sha256:d22094bbd65447c59a42c580eaa3a44cee9cd855f00905f59409be21bcefc745 Deleted: sha256:b8976847450013f3eb5e9a81a5778f73ed7bef67e6393049712ef17102b4b7b7 Deleted: sha256:b8c891f0ffec910a12757d733b178e3f62d81dbbde2b31d3b754071c416108ed Full log: https://builds.apache.org/job/Mesos-Reviewbot-Linux/9032/console - Mesos Reviewbot On April 22, 2020, 8:13 a.m., Qian Zhang wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/72402/ > ----------------------------------------------------------- > > (Updated April 22, 2020, 8:13 a.m.) > > > Review request for mesos, Andrei Budnik and Greg Mann. > > > Bugs: MESOS-10117 > https://issues.apache.org/jira/browse/MESOS-10117 > > > Repository: mesos > > > Description > ------- > > Updated Docker containerizer's `usage()` to support resource limits. > > > Diffs > ----- > > src/slave/containerizer/docker.cpp 492ac273fafb55d3e4c90d70fbf9c8c0c4fe7e70 > src/tests/containerizer/docker_containerizer_tests.cpp > b069f518d51225c39f0cd5126c02fa08674566ab > > > Diff: https://reviews.apache.org/r/72402/diff/3/ > > > Testing > ------- > > sudo make check > > > Thanks, > > Qian Zhang > >
