----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72297/#review220197 -----------------------------------------------------------
Bad patch! Reviews applied: [72297] Failed command: ['bash', '-c', "set -o pipefail; export OS='ubuntu:16.04' BUILDTOOL='autotools' COMPILER='gcc' CONFIGURATION='--verbose --disable-libtool-wrappers --disable-parallel-test-execution' ENVIRONMENT='GLOG_v=1 MESOS_VERBOSE=1'; ./support/jenkins/buildbot.sh 2>&1 | tee build_72297"] Error: ...<truncated>... a2f-24fe46d71d56 on agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 I0402 21:36:34.157235 3096 http_connection.hpp:131] Sending UPDATE_OPERATION_STATUS call to http://172.17.0.2:42083/slave(1243)/api/v1/resource_provider I0402 21:36:34.158685 3085 process.cpp:3671] Handling HTTP event for process 'slave(1243)' with path: '/slave(1243)/api/v1/resource_provider' I0402 21:36:34.161903 3086 hierarchical.cpp:1853] Performed allocation for 1 agents in 1.005154ms I0402 21:36:34.162596 3093 master.cpp:9485] Sending offers [ c90eadc3-8aff-4278-b165-9344f77bff54-O3 ] to framework c90eadc3-8aff-4278-b165-9344f77bff54-0000 (default) at scheduler-bc50a73c-8d92-4d0f-8414-9391331ec295@172.17.0.2:42083 I0402 21:36:34.163306 3087 sched.cpp:934] Scheduler::resourceOffers took 77226ns I0402 21:36:34.167003 3084 process.cpp:3671] Handling HTTP event for process 'master' with path: '/master/api/v1' I0402 21:36:34.169174 3096 http.cpp:1436] HTTP POST for /master/api/v1 from 172.17.0.2:34424 I0402 21:36:34.169454 3096 http.cpp:277] Processing call CREATE_VOLUMES I0402 21:36:34.170433 3096 master.cpp:3705] Authorizing principal 'test-principal' to perform action CREATE_VOLUME on object {"value":"storage/default-role","resource":{"provider_id":{"value":"962920b7-45cb-4c93-a73f-e6fd0d579746"},"name":"disk","type":"SCALAR","scalar":{"value":2048.0},"reservations":[{"type":"DYNAMIC","role":"storage"},{"type":"DYNAMIC","role":"storage/default-role","principal":"test-principal"}],"disk":{"persistence":{"id":"453549c9-7151-4fd8-9a7e-d6bae9dbef10","principal":"test-principal"},"volume":{"mode":"RW","container_path":"volume"},"source":{"type":"MOUNT","mount":{"root":"./csi/org.apache.mesos.csi.test/local/mounts"},"vendor":"org.apache.mesos.csi.test.local","id":"/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_cDvwVu/2GB-a29eb5c4-3b9b-4384-9829-e12b2fd34aec","profile":"test"}}}} I0402 21:36:34.172253 3093 sched.cpp:960] Rescinded offer c90eadc3-8aff-4278-b165-9344f77bff54-O3 I0402 21:36:34.172341 3093 sched.cpp:971] Scheduler::offerRescinded took 24680ns I0402 21:36:34.172837 3087 hierarchical.cpp:1576] Recovered ports(allocated: storage/default-role):[31000-32000]; disk(allocated: storage/default-role)(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_cDvwVu/2GB-a29eb5c4-3b9b-4384-9829-e12b2fd34aec,test)]:2048; cpus(allocated: storage/default-role):2; mem(allocated: storage/default-role):1024; disk(allocated: storage/default-role):1024 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_cDvwVu/2GB-a29eb5c4-3b9b-4384-9829-e12b2fd34aec,test)]:2048, offered or allocated: {}) on agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 from framework c90ea dc3-8aff-4278-b165-9344f77bff54-0000 I0402 21:36:34.173022 3085 master.cpp:11784] Removing offer c90eadc3-8aff-4278-b165-9344f77bff54-O3 I0402 21:36:34.174608 3087 hierarchical.cpp:1625] Framework c90eadc3-8aff-4278-b165-9344f77bff54-0000 filtered agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 for 5secs I0402 21:36:34.177644 3084 master.cpp:11649] Sending operation '' (uuid: 99416a36-6b41-4cee-9778-a551ac8e592c) to agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 at slave(1243)@172.17.0.2:42083 (602ba2965ad8) I0402 21:36:34.178365 3084 slave.cpp:4545] Ignoring new checkpointed resources and operations identical to the current version I0402 21:36:34.181802 3098 provider.cpp:498] Received APPLY_OPERATION event I0402 21:36:34.181849 3098 provider.cpp:1351] Received CREATE operation '' (uuid: 99416a36-6b41-4cee-9778-a551ac8e592c) I0402 21:36:34.184878 3090 master.cpp:5533] Processing REVIVE call for framework c90eadc3-8aff-4278-b165-9344f77bff54-0000 (default) at scheduler-bc50a73c-8d92-4d0f-8414-9391331ec295@172.17.0.2:42083 I0402 21:36:34.185312 3090 hierarchical.cpp:1721] Unsuppressed offers and cleared filters for roles { storage/default-role } of framework c90eadc3-8aff-4278-b165-9344f77bff54-0000 I0402 21:36:34.186635 3090 hierarchical.cpp:1853] Performed allocation for 1 agents in 1.135568ms I0402 21:36:34.187021 3090 hierarchical.cpp:1853] Performed allocation for 1 agents in 162475ns I0402 21:36:34.187407 3094 master.cpp:9485] Sending offers [ c90eadc3-8aff-4278-b165-9344f77bff54-O4 ] to framework c90eadc3-8aff-4278-b165-9344f77bff54-0000 (default) at scheduler-bc50a73c-8d92-4d0f-8414-9391331ec295@172.17.0.2:42083 I0402 21:36:34.188182 3089 sched.cpp:934] Scheduler::resourceOffers took 97135ns I0402 21:36:34.202054 3085 http.cpp:1436] HTTP POST for /slave(1243)/api/v1/resource_provider from 172.17.0.2:34418 I0402 21:36:34.203279 3097 slave.cpp:8702] Handling resource provider message 'UPDATE_OPERATION_STATUS: (uuid: 8af10c21-1e26-48fe-ba2f-24fe46d71d56) for framework (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED)' I0402 21:36:34.203575 3097 slave.cpp:9155] Updating the state of operation with no ID (uuid: 8af10c21-1e26-48fe-ba2f-24fe46d71d56) for an operation API call (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED) I0402 21:36:34.203634 3097 slave.cpp:8909] Forwarding status update of operation with no ID (operation_uuid: 8af10c21-1e26-48fe-ba2f-24fe46d71d56) for an operator API call I0402 21:36:34.204150 3088 master.cpp:11301] Updating the state of operation '' (uuid: 8af10c21-1e26-48fe-ba2f-24fe46d71d56) for an operator API call (latest state: OPERATION_PENDING, status update state: OPERATION_FINISHED) I0402 21:36:34.204743 3090 slave.cpp:4545] Ignoring new checkpointed resources and operations identical to the current version I0402 21:36:34.317663 3097 status_update_manager_process.hpp:152] Received operation status update OPERATION_FINISHED (Status UUID: 6b9558d8-224b-4880-a0ca-98c1477c52a0) for operation UUID 99416a36-6b41-4cee-9778-a551ac8e592c on agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 I0402 21:36:34.317750 3097 status_update_manager_process.hpp:414] Creating operation status update stream 99416a36-6b41-4cee-9778-a551ac8e592c checkpoint=true I0402 21:36:34.317798 3098 provider.cpp:498] Received ACKNOWLEDGE_OPERATION_STATUS event I0402 21:36:34.317997 3097 status_update_manager_process.hpp:929] Checkpointing UPDATE for operation status update OPERATION_FINISHED (Status UUID: 6b9558d8-224b-4880-a0ca-98c1477c52a0) for operation UUID 99416a36-6b41-4cee-9778-a551ac8e592c on agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 I0402 21:36:34.393467 3097 status_update_manager_process.hpp:528] Forwarding operation status update OPERATION_FINISHED (Status UUID: 6b9558d8-224b-4880-a0ca-98c1477c52a0) for operation UUID 99416a36-6b41-4cee-9778-a551ac8e592c on agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 I0402 21:36:34.393990 3097 status_update_manager_process.hpp:252] Received operation status update acknowledgement (UUID: 2ef8e9ed-d59d-4582-99fa-c1ea1c4e6d07) for stream 8af10c21-1e26-48fe-ba2f-24fe46d71d56 I0402 21:36:34.394071 3097 status_update_manager_process.hpp:929] Checkpointing ACK for operation status update OPERATION_FINISHED (Status UUID: 2ef8e9ed-d59d-4582-99fa-c1ea1c4e6d07) for operation UUID 8af10c21-1e26-48fe-ba2f-24fe46d71d56 on agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 I0402 21:36:34.394639 3087 http_connection.hpp:131] Sending UPDATE_OPERATION_STATUS call to http://172.17.0.2:42083/slave(1243)/api/v1/resource_provider I0402 21:36:34.395695 3094 process.cpp:3671] Handling HTTP event for process 'slave(1243)' with path: '/slave(1243)/api/v1/resource_provider' I0402 21:36:34.437813 3095 http.cpp:1436] HTTP POST for /slave(1243)/api/v1/resource_provider from 172.17.0.2:34418 I0402 21:36:34.439090 3091 slave.cpp:8702] Handling resource provider message 'UPDATE_OPERATION_STATUS: (uuid: 99416a36-6b41-4cee-9778-a551ac8e592c) for framework (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED)' I0402 21:36:34.439342 3091 slave.cpp:9155] Updating the state of operation with no ID (uuid: 99416a36-6b41-4cee-9778-a551ac8e592c) for an operation API call (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED) I0402 21:36:34.439395 3091 slave.cpp:8909] Forwarding status update of operation with no ID (operation_uuid: 99416a36-6b41-4cee-9778-a551ac8e592c) for an operator API call I0402 21:36:34.439793 3098 master.cpp:11301] Updating the state of operation '' (uuid: 99416a36-6b41-4cee-9778-a551ac8e592c) for an operator API call (latest state: OPERATION_PENDING, status update state: OPERATION_FINISHED) I0402 21:36:34.440462 3087 slave.cpp:4545] Ignoring new checkpointed resources and operations identical to the current version I0402 21:36:34.441947 3095 provider.cpp:498] Received ACKNOWLEDGE_OPERATION_STATUS event I0402 21:36:34.475351 3097 status_update_manager_process.hpp:490] Cleaning up operation status update stream 8af10c21-1e26-48fe-ba2f-24fe46d71d56 I0402 21:36:34.475658 3097 status_update_manager_process.hpp:252] Received operation status update acknowledgement (UUID: 6b9558d8-224b-4880-a0ca-98c1477c52a0) for stream 99416a36-6b41-4cee-9778-a551ac8e592c I0402 21:36:34.475775 3097 status_update_manager_process.hpp:929] Checkpointing ACK for operation status update OPERATION_FINISHED (Status UUID: 6b9558d8-224b-4880-a0ca-98c1477c52a0) for operation UUID 99416a36-6b41-4cee-9778-a551ac8e592c on agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 I0402 21:36:34.551937 3097 status_update_manager_process.hpp:490] Cleaning up operation status update stream 99416a36-6b41-4cee-9778-a551ac8e592c I0402 21:36:34.631450 3098 process.cpp:3671] Handling HTTP event for process 'master' with path: '/master/api/v1' I0402 21:36:34.633831 3096 http.cpp:1436] HTTP POST for /master/api/v1 from 172.17.0.2:34426 I0402 21:36:34.634124 3096 http.cpp:277] Processing call DESTROY_VOLUMES I0402 21:36:34.635215 3096 master.cpp:3705] Authorizing principal 'test-principal' to perform action DESTROY_VOLUME on object {"value":"test-principal","resource":{"provider_id":{"value":"962920b7-45cb-4c93-a73f-e6fd0d579746"},"name":"disk","type":"SCALAR","scalar":{"value":2048.0},"reservations":[{"type":"DYNAMIC","role":"storage"},{"type":"DYNAMIC","role":"storage/default-role","principal":"test-principal"}],"disk":{"persistence":{"id":"453549c9-7151-4fd8-9a7e-d6bae9dbef10","principal":"test-principal"},"volume":{"mode":"RW","container_path":"volume"},"source":{"type":"MOUNT","mount":{"root":"./csi/org.apache.mesos.csi.test/local/mounts"},"vendor":"org.apache.mesos.csi.test.local","id":"/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_cDvwVu/2GB-a29eb5c4-3b9b-4384-9829-e12b2fd34aec","profile":"test"}}}} I0402 21:36:34.637089 3097 sched.cpp:960] Rescinded offer c90eadc3-8aff-4278-b165-9344f77bff54-O4 I0402 21:36:34.637195 3097 sched.cpp:971] Scheduler::offerRescinded took 30225ns I0402 21:36:34.637820 3085 hierarchical.cpp:1576] Recovered ports(allocated: storage/default-role):[31000-32000]; disk(allocated: storage/default-role)(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_cDvwVu/2GB-a29eb5c4-3b9b-4384-9829-e12b2fd34aec,test),453549c9-7151-4fd8-9a7e-d6bae9dbef10:volume]:2048; cpus(allocated: storage/default-role):2; mem(allocated: storage/default-role):1024; disk(allocated: storage/default-role):1024 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_cDvwVu/2GB-a29eb5c4-3b9b-4384-9829-e12b2fd34aec,test),453549c9-7151-4fd8-9a7e-d6bae9dbef10:volume]:2048, offered or allocated: {}) on agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 from framework c90eadc3-8aff-4278-b165-9344f77bff54-0000 I0402 21:36:34.637923 3091 master.cpp:11784] Removing offer c90eadc3-8aff-4278-b165-9344f77bff54-O4 I0402 21:36:34.640098 3085 hierarchical.cpp:1625] Framework c90eadc3-8aff-4278-b165-9344f77bff54-0000 filtered agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 for 5secs I0402 21:36:34.643240 3098 master.cpp:11649] Sending operation '' (uuid: 81aedd73-ef89-43ae-8890-03acbf544c9a) to agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 at slave(1243)@172.17.0.2:42083 (602ba2965ad8) I0402 21:36:34.644081 3088 slave.cpp:4545] Ignoring new checkpointed resources and operations identical to the current version I0402 21:36:34.648097 3087 provider.cpp:498] Received APPLY_OPERATION event I0402 21:36:34.648155 3087 provider.cpp:1351] Received DESTROY operation '' (uuid: 81aedd73-ef89-43ae-8890-03acbf544c9a) I0402 21:36:34.650686 3099 hierarchical.cpp:1853] Performed allocation for 1 agents in 1.095914ms I0402 21:36:34.651448 3089 master.cpp:9485] Sending offers [ c90eadc3-8aff-4278-b165-9344f77bff54-O5 ] to framework c90eadc3-8aff-4278-b165-9344f77bff54-0000 (default) at scheduler-bc50a73c-8d92-4d0f-8414-9391331ec295@172.17.0.2:42083 I0402 21:36:34.652148 3089 sched.cpp:934] Scheduler::resourceOffers took 84278ns I0402 21:36:34.838266 3084 status_update_manager_process.hpp:152] Received operation status update OPERATION_FINISHED (Status UUID: 528f95f7-921a-4790-9427-3b9487fd91fc) for operation UUID 81aedd73-ef89-43ae-8890-03acbf544c9a on agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 I0402 21:36:34.838346 3084 status_update_manager_process.hpp:414] Creating operation status update stream 81aedd73-ef89-43ae-8890-03acbf544c9a checkpoint=true I0402 21:36:34.838644 3084 status_update_manager_process.hpp:929] Checkpointing UPDATE for operation status update OPERATION_FINISHED (Status UUID: 528f95f7-921a-4790-9427-3b9487fd91fc) for operation UUID 81aedd73-ef89-43ae-8890-03acbf544c9a on agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 I0402 21:36:34.920907 3084 status_update_manager_process.hpp:528] Forwarding operation status update OPERATION_FINISHED (Status UUID: 528f95f7-921a-4790-9427-3b9487fd91fc) for operation UUID 81aedd73-ef89-43ae-8890-03acbf544c9a on agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 I0402 21:36:34.921775 3093 http_connection.hpp:131] Sending UPDATE_OPERATION_STATUS call to http://172.17.0.2:42083/slave(1243)/api/v1/resource_provider I0402 21:36:34.922863 3088 process.cpp:3671] Handling HTTP event for process 'slave(1243)' with path: '/slave(1243)/api/v1/resource_provider' I0402 21:36:34.925751 3091 process.cpp:3671] Handling HTTP event for process 'master' with path: '/master/api/v1' I0402 21:36:34.927758 3091 http.cpp:1436] HTTP POST for /master/api/v1 from 172.17.0.2:34428 I0402 21:36:34.928087 3091 http.cpp:277] Processing call UNRESERVE_RESOURCES I0402 21:36:34.929054 3091 master.cpp:3705] Authorizing principal 'test-principal' to perform action UNRESERVE_RESOURCES on object {"value":"test-principal","resource":{"provider_id":{"value":"962920b7-45cb-4c93-a73f-e6fd0d579746"},"name":"disk","type":"SCALAR","scalar":{"value":2048.0},"reservations":[{"type":"DYNAMIC","role":"storage"},{"type":"DYNAMIC","role":"storage/default-role","principal":"test-principal"}],"disk":{"source":{"type":"MOUNT","mount":{"root":"./csi/org.apache.mesos.csi.test/local/mounts"},"vendor":"org.apache.mesos.csi.test.local","id":"/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_cDvwVu/2GB-a29eb5c4-3b9b-4384-9829-e12b2fd34aec","profile":"test"}}}} I0402 21:36:34.930605 3096 sched.cpp:960] Rescinded offer c90eadc3-8aff-4278-b165-9344f77bff54-O5 I0402 21:36:34.930707 3096 sched.cpp:971] Scheduler::offerRescinded took 30117ns I0402 21:36:34.931342 3086 hierarchical.cpp:1576] Recovered ports(allocated: storage/default-role):[31000-32000]; disk(allocated: storage/default-role)(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_cDvwVu/2GB-a29eb5c4-3b9b-4384-9829-e12b2fd34aec,test)]:2048; cpus(allocated: storage/default-role):2; mem(allocated: storage/default-role):1024; disk(allocated: storage/default-role):1024 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_cDvwVu/2GB-a29eb5c4-3b9b-4384-9829-e12b2fd34aec,test)]:2048, offered or allocated: {}) on agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 from framework c90ea dc3-8aff-4278-b165-9344f77bff54-0000 I0402 21:36:34.931697 3084 master.cpp:11784] Removing offer c90eadc3-8aff-4278-b165-9344f77bff54-O5 I0402 21:36:34.933208 3086 hierarchical.cpp:1625] Framework c90eadc3-8aff-4278-b165-9344f77bff54-0000 filtered agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 for 5secs I0402 21:36:34.935611 3092 master.cpp:11649] Sending operation '' (uuid: 0fbf8aed-2e61-481b-a096-b0d69c6c87d1) to agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 at slave(1243)@172.17.0.2:42083 (602ba2965ad8) I0402 21:36:34.936199 3085 slave.cpp:4545] Ignoring new checkpointed resources and operations identical to the current version I0402 21:36:34.939168 3097 provider.cpp:498] Received APPLY_OPERATION event I0402 21:36:34.939211 3097 provider.cpp:1351] Received UNRESERVE operation '' (uuid: 0fbf8aed-2e61-481b-a096-b0d69c6c87d1) I0402 21:36:34.946841 3094 hierarchical.cpp:1853] Performed allocation for 1 agents in 1.067807ms I0402 21:36:34.947489 3098 master.cpp:9485] Sending offers [ c90eadc3-8aff-4278-b165-9344f77bff54-O6 ] to framework c90eadc3-8aff-4278-b165-9344f77bff54-0000 (default) at scheduler-bc50a73c-8d92-4d0f-8414-9391331ec295@172.17.0.2:42083 I0402 21:36:34.948180 3098 sched.cpp:934] Scheduler::resourceOffers took 81518ns I0402 21:36:34.965746 3087 http.cpp:1436] HTTP POST for /slave(1243)/api/v1/resource_provider from 172.17.0.2:34418 I0402 21:36:34.966713 3084 slave.cpp:8702] Handling resource provider message 'UPDATE_OPERATION_STATUS: (uuid: 81aedd73-ef89-43ae-8890-03acbf544c9a) for framework (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED)' I0402 21:36:34.966892 3084 slave.cpp:9155] Updating the state of operation with no ID (uuid: 81aedd73-ef89-43ae-8890-03acbf544c9a) for an operation API call (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED) I0402 21:36:34.966944 3084 slave.cpp:8909] Forwarding status update of operation with no ID (operation_uuid: 81aedd73-ef89-43ae-8890-03acbf544c9a) for an operator API call I0402 21:36:34.967242 3093 master.cpp:11301] Updating the state of operation '' (uuid: 81aedd73-ef89-43ae-8890-03acbf544c9a) for an operator API call (latest state: OPERATION_PENDING, status update state: OPERATION_FINISHED) I0402 21:36:34.967770 3092 slave.cpp:4545] Ignoring new checkpointed resources and operations identical to the current version I0402 21:36:35.166378 3084 status_update_manager_process.hpp:152] Received operation status update OPERATION_FINISHED (Status UUID: 05ddee2f-41d3-41ed-9636-638413e0f619) for operation UUID 0fbf8aed-2e61-481b-a096-b0d69c6c87d1 on agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 I0402 21:36:35.166462 3084 status_update_manager_process.hpp:414] Creating operation status update stream 0fbf8aed-2e61-481b-a096-b0d69c6c87d1 checkpoint=true I0402 21:36:35.166553 3097 provider.cpp:498] Received ACKNOWLEDGE_OPERATION_STATUS event I0402 21:36:35.166748 3084 status_update_manager_process.hpp:929] Checkpointing UPDATE for operation status update OPERATION_FINISHED (Status UUID: 05ddee2f-41d3-41ed-9636-638413e0f619) for operation UUID 0fbf8aed-2e61-481b-a096-b0d69c6c87d1 on agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 I0402 21:36:35.239961 3084 status_update_manager_process.hpp:528] Forwarding operation status update OPERATION_FINISHED (Status UUID: 05ddee2f-41d3-41ed-9636-638413e0f619) for operation UUID 0fbf8aed-2e61-481b-a096-b0d69c6c87d1 on agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 I0402 21:36:35.240290 3084 status_update_manager_process.hpp:252] Received operation status update acknowledgement (UUID: 528f95f7-921a-4790-9427-3b9487fd91fc) for stream 81aedd73-ef89-43ae-8890-03acbf544c9a I0402 21:36:35.240357 3084 status_update_manager_process.hpp:929] Checkpointing ACK for operation status update OPERATION_FINISHED (Status UUID: 528f95f7-921a-4790-9427-3b9487fd91fc) for operation UUID 81aedd73-ef89-43ae-8890-03acbf544c9a on agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 I0402 21:36:35.240769 3093 http_connection.hpp:131] Sending UPDATE_OPERATION_STATUS call to http://172.17.0.2:42083/slave(1243)/api/v1/resource_provider I0402 21:36:35.241920 3095 process.cpp:3671] Handling HTTP event for process 'slave(1243)' with path: '/slave(1243)/api/v1/resource_provider' I0402 21:36:35.285888 3091 http.cpp:1436] HTTP POST for /slave(1243)/api/v1/resource_provider from 172.17.0.2:34418 I0402 21:36:35.287246 3096 slave.cpp:8702] Handling resource provider message 'UPDATE_OPERATION_STATUS: (uuid: 0fbf8aed-2e61-481b-a096-b0d69c6c87d1) for framework (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED)' I0402 21:36:35.287482 3096 slave.cpp:9155] Updating the state of operation with no ID (uuid: 0fbf8aed-2e61-481b-a096-b0d69c6c87d1) for an operation API call (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED) I0402 21:36:35.287541 3096 slave.cpp:8909] Forwarding status update of operation with no ID (operation_uuid: 0fbf8aed-2e61-481b-a096-b0d69c6c87d1) for an operator API call I0402 21:36:35.288012 3097 master.cpp:11301] Updating the state of operation '' (uuid: 0fbf8aed-2e61-481b-a096-b0d69c6c87d1) for an operator API call (latest state: OPERATION_PENDING, status update state: OPERATION_FINISHED) I0402 21:36:35.288627 3093 slave.cpp:4545] Ignoring new checkpointed resources and operations identical to the current version I0402 21:36:35.290174 3091 provider.cpp:498] Received ACKNOWLEDGE_OPERATION_STATUS event I0402 21:36:35.324087 3084 status_update_manager_process.hpp:490] Cleaning up operation status update stream 81aedd73-ef89-43ae-8890-03acbf544c9a I0402 21:36:35.324295 3084 status_update_manager_process.hpp:252] Received operation status update acknowledgement (UUID: 05ddee2f-41d3-41ed-9636-638413e0f619) for stream 0fbf8aed-2e61-481b-a096-b0d69c6c87d1 I0402 21:36:35.324368 3084 status_update_manager_process.hpp:929] Checkpointing ACK for operation status update OPERATION_FINISHED (Status UUID: 05ddee2f-41d3-41ed-9636-638413e0f619) for operation UUID 0fbf8aed-2e61-481b-a096-b0d69c6c87d1 on agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 I0402 21:36:35.423746 3084 status_update_manager_process.hpp:490] Cleaning up operation status update stream 0fbf8aed-2e61-481b-a096-b0d69c6c87d1 I0402 21:36:35.475440 3095 master.cpp:1407] Framework c90eadc3-8aff-4278-b165-9344f77bff54-0000 (default) at scheduler-bc50a73c-8d92-4d0f-8414-9391331ec295@172.17.0.2:42083 disconnected I0402 21:36:35.475488 3095 master.cpp:3326] Deactivating framework c90eadc3-8aff-4278-b165-9344f77bff54-0000 (default) at scheduler-bc50a73c-8d92-4d0f-8414-9391331ec295@172.17.0.2:42083 I0402 21:36:35.475934 3088 hierarchical.cpp:813] Deactivated framework c90eadc3-8aff-4278-b165-9344f77bff54-0000 I0402 21:36:35.476459 3095 master.cpp:11784] Removing offer c90eadc3-8aff-4278-b165-9344f77bff54-O6 I0402 21:36:35.476505 3092 slave.cpp:1000] Agent terminating I0402 21:36:35.476541 3095 master.cpp:3310] Disconnecting framework c90eadc3-8aff-4278-b165-9344f77bff54-0000 (default) at scheduler-bc50a73c-8d92-4d0f-8414-9391331ec295@172.17.0.2:42083 I0402 21:36:35.476531 3088 hierarchical.cpp:1576] Recovered ports(allocated: storage/default-role):[31000-32000]; disk(allocated: storage/default-role)(reservations: [(DYNAMIC,storage)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_cDvwVu/2GB-a29eb5c4-3b9b-4384-9829-e12b2fd34aec,test)]:2048; cpus(allocated: storage/default-role):2; mem(allocated: storage/default-role):1024; disk(allocated: storage/default-role):1024 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk(reservations: [(DYNAMIC,storage)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_cDvwVu/2GB-a29eb5c4-3b9b-4384-9829-e12b2fd34aec,test)]:2048, offered or allocated: {}) on agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 from framework c90eadc3-8aff-4278-b165-9344f77bff54-0000 I0402 21:36:35.476707 3095 master.cpp:1422] Giving framework c90eadc3-8aff-4278-b165-9344f77bff54-0000 (default) at scheduler-bc50a73c-8d92-4d0f-8414-9391331ec295@172.17.0.2:42083 0ns to failover I0402 21:36:35.477399 3092 manager.cpp:127] Terminating resource provider 962920b7-45cb-4c93-a73f-e6fd0d579746 I0402 21:36:35.477798 3094 master.cpp:9269] Framework failover timeout, removing framework c90eadc3-8aff-4278-b165-9344f77bff54-0000 (default) at scheduler-bc50a73c-8d92-4d0f-8414-9391331ec295@172.17.0.2:42083 I0402 21:36:35.477836 3094 master.cpp:10285] Removing framework c90eadc3-8aff-4278-b165-9344f77bff54-0000 (default) at scheduler-bc50a73c-8d92-4d0f-8414-9391331ec295@172.17.0.2:42083 E0402 21:36:35.478363 3095 http_connection.hpp:449] End-Of-File received I0402 21:36:35.478381 3096 hierarchical.cpp:1777] Allocation paused I0402 21:36:35.478471 3094 master.cpp:1292] Agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 at slave(1243)@172.17.0.2:42083 (602ba2965ad8) disconnected I0402 21:36:35.478507 3094 master.cpp:3361] Disconnecting agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 at slave(1243)@172.17.0.2:42083 (602ba2965ad8) I0402 21:36:35.478587 3094 master.cpp:3380] Deactivating agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 at slave(1243)@172.17.0.2:42083 (602ba2965ad8) I0402 21:36:35.478876 3095 http_connection.hpp:217] Re-detecting endpoint I0402 21:36:35.479127 3096 hierarchical.cpp:757] Removed framework c90eadc3-8aff-4278-b165-9344f77bff54-0000 I0402 21:36:35.479207 3096 hierarchical.cpp:1787] Allocation resumed I0402 21:36:35.479319 3096 hierarchical.cpp:1156] Agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 deactivated I0402 21:36:35.479374 3095 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0402 21:36:35.479463 3095 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0402 21:36:35.479606 3095 http_connection.hpp:227] New endpoint detected at http://172.17.0.2:42083/slave(1243)/api/v1/resource_provider I0402 21:36:35.479671 3088 provider.cpp:488] Disconnected from resource provider manager I0402 21:36:35.479890 3087 status_update_manager_process.hpp:379] Pausing operation status update manager I0402 21:36:35.481277 3089 containerizer.cpp:2623] Destroying container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE in RUNNING state I0402 21:36:35.481348 3089 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from RUNNING to DESTROYING after 3.073665152secs I0402 21:36:35.481801 3089 launcher.cpp:161] Asked to destroy container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0402 21:36:35.483286 3084 hierarchical.cpp:1853] Performed allocation for 1 agents in 217369ns I0402 21:36:35.483438 3087 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.2:42083/slave(1243)/api/v1/resource_provider I0402 21:36:35.484150 3097 provider.cpp:476] Connected to resource provider manager I0402 21:36:35.484882 3092 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.2:42083/slave(1243)/api/v1/resource_provider I0402 21:36:35.485911 3100 process.cpp:2781] Returning '404 Not Found' for '/slave(1243)/api/v1/resource_provider' E0402 21:36:35.487177 3091 provider.cpp:721] Failed to subscribe resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test': Received '404 Not Found' () I0402 21:36:35.535449 3085 hierarchical.cpp:1853] Performed allocation for 1 agents in 202529ns I0402 21:36:35.585748 3084 containerizer.cpp:3159] Container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE has exited I0402 21:36:35.587157 3096 hierarchical.cpp:1853] Performed allocation for 1 agents in 184707ns I0402 21:36:35.587596 3094 provisioner.cpp:652] Ignoring destroy request for unknown container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0402 21:36:35.590494 3098 container_daemon.cpp:189] Invoking post-stop hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0402 21:36:35.590672 3091 service_manager.cpp:723] Disconnected from endpoint 'unix:///tmp/mesos-csi-rvd7ab/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0402 21:36:35.590950 3096 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0402 21:36:35.594167 3100 process.cpp:2781] Returning '404 Not Found' for '/slave(1243)/api/v1' I0402 21:36:35.606155 3083 master.cpp:1140] Master terminating I0402 21:36:35.607106 3097 hierarchical.cpp:1132] Removed all filters for agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 I0402 21:36:35.607138 3097 hierarchical.cpp:1008] Removed agent c90eadc3-8aff-4278-b165-9344f77bff54-S0 [ OK ] CSIVersion/StorageLocalResourceProviderTest.OperatorOperationsWithResourceProviderResources/v1 (2970 ms) [ RUN ] CSIVersion/StorageLocalResourceProviderTest.Update/v0 I0402 21:36:35.634891 3083 cluster.cpp:186] Creating default 'local' authorizer I0402 21:36:35.639798 3098 master.cpp:443] Master 32dc1034-09a8-4d13-b699-08453f7839c4 (602ba2965ad8) started on 172.17.0.2:42083 I0402 21:36:35.639925 3098 master.cpp:446] Flags at startup: --acls="" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins" --allocation_interval="50ms" --allocator="hierarchical" --authenticate_agents="true" --authenticate_frameworks="true" --authenticate_http_frameworks="true" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authentication_v0_timeout="15secs" --authenticators="crammd5" --authorizers="local" --credentials="/tmp/yDWur1/credentials" --filter_gpu_resources="true" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_framework_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_operator_event_stream_subscribers="1000" --max_unreachable_tasks_per_framework="1000" --memory_profiling="false" --min_alloca table_resources="cpus:0.01|mem:32" --port="5050" --publish_per_framework_metrics="true" --quiet="false" --recovery_agent_removal_limit="100%" --registry="in_memory" --registry_fetch_timeout="1mins" --registry_gc_interval="15mins" --registry_max_agent_age="2weeks" --registry_max_agent_count="102400" --registry_store_timeout="100secs" --registry_strict="false" --require_agent_domain="false" --role_sorter="drf" --root_submissions="true" --version="false" --webui_dir="/tmp/SRC/build/mesos-1.10.0/_inst/share/mesos/webui" --work_dir="/tmp/yDWur1/master" --zk_session_timeout="10secs" I0402 21:36:35.640329 3098 master.cpp:495] Master only allowing authenticated frameworks to register I0402 21:36:35.640347 3098 master.cpp:501] Master only allowing authenticated agents to register I0402 21:36:35.640357 3098 master.cpp:507] Master only allowing authenticated HTTP frameworks to register I0402 21:36:35.640373 3098 credentials.hpp:37] Loading credentials for authentication from '/tmp/yDWur1/credentials' I0402 21:36:35.640743 3098 master.cpp:551] Using default 'crammd5' authenticator I0402 21:36:35.640985 3098 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readonly' I0402 21:36:35.641281 3098 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readwrite' I0402 21:36:35.641528 3098 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-master-scheduler' I0402 21:36:35.641772 3098 master.cpp:632] Authorization enabled I0402 21:36:35.642199 3093 hierarchical.cpp:567] Initialized hierarchical allocator process I0402 21:36:35.642259 3099 whitelist_watcher.cpp:77] No whitelist given I0402 21:36:35.645753 3096 master.cpp:2165] Elected as the leading master! I0402 21:36:35.645787 3096 master.cpp:1661] Recovering from registrar I0402 21:36:35.646034 3091 registrar.cpp:339] Recovering registrar I0402 21:36:35.647025 3095 registrar.cpp:383] Successfully fetched the registry (0B) in 0ns I0402 21:36:35.647168 3095 registrar.cpp:487] Applied 1 operations in 43980ns; attempting to update the registry I0402 21:36:35.647910 3095 registrar.cpp:544] Successfully updated the registry in 0ns I0402 21:36:35.648061 3095 registrar.cpp:416] Successfully recovered registrar I0402 21:36:35.648510 3093 master.cpp:1814] Recovered 0 agents from the registry (144B); allowing 10mins for agents to reregister I0402 21:36:35.648542 3098 hierarchical.cpp:606] Skipping recovery of hierarchical allocator: nothing to recover W0402 21:36:35.654271 3083 process.cpp:2877] Attempted to spawn already running process files@172.17.0.2:42083 I0402 21:36:35.655666 3083 containerizer.cpp:317] Using isolation { environment_secret, posix/cpu, posix/mem, filesystem/posix, network/cni } W0402 21:36:35.661607 3083 backend.cpp:76] Failed to create 'overlay' backend: OverlayBackend requires root privileges W0402 21:36:35.661638 3083 backend.cpp:76] Failed to create 'aufs' backend: AufsBackend requires root privileges W0402 21:36:35.661653 3083 backend.cpp:76] Failed to create 'bind' backend: BindBackend requires root privileges I0402 21:36:35.661684 3083 provisioner.cpp:294] Using default backend 'copy' I0402 21:36:35.664721 3083 cluster.cpp:533] Creating default 'local' authorizer I0402 21:36:35.667690 3084 slave.cpp:279] Mesos agent started on (1244)@172.17.0.2:42083 I0402 21:36:35.667728 3084 slave.cpp:280] Flags at startup: --acls="" --appc_simple_discovery_uri_prefix="http://"; --appc_store_dir="/tmp/yDWur1/AAxfIt/store/appc" --authenticate_http_readonly="true" --authenticate_http_readwrite="false" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authentication_timeout_max="1mins" --authentication_timeout_min="5secs" --authorizer="local" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_destroy_timeout="1mins" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="mesos" --credential="/tmp/yDWur1/AAxfIt/credential" --default_role="*" --disallow_sharing_agent_ipc_namespace="false" --disallow_sharing_agent_pid_namespace="false" --disk_profile_adaptor="org_apache_mesos_UriDiskProfileAdaptor" --disk_watch_interval="1mins" --docker="docker" --docker_ignore_runtime="false" --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io"; --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/yDWur1/AAxfIt/store/docker" --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume" --docker_volume_chown="false" --enforce_container_disk_quota="false" --executor_registration_timeout="1mins" --executor_reregistration_timeout="2secs" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/yDWur1/AAxfIt/fetch" --fetcher_cache_size="2GB" --fetcher_stall_timeout="1mins" --frameworks_home="/tmp/yDWur1/AAxfIt/frameworks" --gc_delay="1weeks" --gc_disk_headroom="0.1" --gc_non_executor_container_sandboxes="false" --help="false" --hostname_lookup="true" --http_command_executor="false" --http_credentials="/tmp/yDWur1/AAxfIt/http_credentials" --http_executor_domain_sockets="false" --http_heartbeat_interval="30secs" --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem" --launcher="posi x" --launcher_dir="/tmp/SRC/build/mesos-1.10.0/_build/sub/src" --logbufsecs="0" --logging_level="INFO" --max_completed_executors_per_framework="150" --memory_profiling="false" --network_cni_metrics="true" --network_cni_root_dir_persist="false" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns" --quiet="false" --reconfiguration_policy="equal" --recover="reconnect" --recovery_timeout="15mins" --registration_backoff_factor="10ms" --resource_provider_config_dir="/tmp/yDWur1/resource_provider_configs" --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]" --revocable_cpu_low_priority="true" --runtime_dir="/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_F8qc86" --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true" --systemd_enable_support="true" --systemd_runtime_directory="/run/systemd/system" --version="false" --work_dir="/tmp/CSIVersion_StorageLoca lResourceProviderTest_Update_v0_mIV9xK" --zk_session_timeout="10secs" I0402 21:36:35.668684 3084 credentials.hpp:86] Loading credential for authentication from '/tmp/yDWur1/AAxfIt/credential' I0402 21:36:35.668912 3084 slave.cpp:312] Agent using credential for: test-principal I0402 21:36:35.668952 3084 credentials.hpp:37] Loading credentials for authentication from '/tmp/yDWur1/AAxfIt/http_credentials' I0402 21:36:35.669286 3084 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-agent-readonly' I0402 21:36:35.669752 3084 disk_profile_adaptor.cpp:82] Creating disk profile adaptor module 'org_apache_mesos_UriDiskProfileAdaptor' I0402 21:36:35.671324 3096 hierarchical.cpp:1853] Performed allocation for 0 agents in 117501ns I0402 21:36:35.671967 3085 uri_disk_profile_adaptor.cpp:305] Updated disk profile mapping to 1 active profiles I0402 21:36:35.672202 3084 slave.cpp:627] Agent resources: [{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}] I0402 21:36:35.672508 3084 slave.cpp:635] Agent attributes: [ ] I0402 21:36:35.672528 3084 slave.cpp:644] Agent hostname: 602ba2965ad8 I0402 21:36:35.672765 3091 status_update_manager_process.hpp:379] Pausing operation status update manager I0402 21:36:35.672863 3097 task_status_update_manager.cpp:181] Pausing sending task status updates I0402 21:36:35.674561 3092 state.cpp:68] Recovering state from '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_mIV9xK/meta' I0402 21:36:35.674842 3088 slave.cpp:7711] Finished recovering checkpointed state from '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_mIV9xK/meta', beginning agent recovery I0402 21:36:35.675613 3090 task_status_update_manager.cpp:207] Recovering task status update manager I0402 21:36:35.676299 3089 containerizer.cpp:822] Recovering Mesos containers I0402 21:36:35.676712 3089 containerizer.cpp:1162] Recovering isolators I0402 21:36:35.677619 3088 containerizer.cpp:1201] Recovering provisioner I0402 21:36:35.678397 3093 provisioner.cpp:518] Provisioner recovery complete I0402 21:36:35.679178 3086 composing.cpp:343] Finished recovering all containerizers I0402 21:36:35.679659 3094 slave.cpp:8193] Recovering executors I0402 21:36:35.679796 3094 slave.cpp:8346] Finished recovery I0402 21:36:35.687463 3095 task_status_update_manager.cpp:181] Pausing sending task status updates I0402 21:36:35.687487 3096 status_update_manager_process.hpp:379] Pausing operation status update manager I0402 21:36:35.687466 3098 slave.cpp:1459] New master detected at master@172.17.0.2:42083 I0402 21:36:35.687646 3098 slave.cpp:1524] Detecting new master I0402 21:36:35.696099 3085 slave.cpp:1551] Authenticating with master master@172.17.0.2:42083 I0402 21:36:35.696223 3085 slave.cpp:1560] Using default CRAM-MD5 authenticatee I0402 21:36:35.696599 3084 authenticatee.cpp:121] Creating new client SASL connection I0402 21:36:35.697031 3087 master.cpp:9676] Authenticating slave(1244)@172.17.0.2:42083 I0402 21:36:35.697312 3090 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(2109)@172.17.0.2:42083 I0402 21:36:35.697713 3092 authenticator.cpp:98] Creating new server SASL connection I0402 21:36:35.698060 3086 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 I0402 21:36:35.698101 3086 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' I0402 21:36:35.698241 3086 authenticator.cpp:204] Received SASL authentication start I0402 21:36:35.698321 3086 authenticator.cpp:326] Authentication requires more steps I0402 21:36:35.698487 3094 authenticatee.cpp:259] Received SASL authentication step I0402 21:36:35.698645 3091 authenticator.cpp:232] Received SASL authentication step I0402 21:36:35.698696 3091 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '602ba2965ad8' server FQDN: '602ba2965ad8' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false I0402 21:36:35.698726 3091 auxprop.cpp:181] Looking up auxiliary property '*userPassword' I0402 21:36:35.698804 3091 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' I0402 21:36:35.698853 3091 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '602ba2965ad8' server FQDN: '602ba2965ad8' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true I0402 21:36:35.698870 3091 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true I0402 21:36:35.698882 3091 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true I0402 21:36:35.698907 3091 authenticator.cpp:318] Authentication success I0402 21:36:35.699043 3088 authenticatee.cpp:299] Authentication success I0402 21:36:35.699172 3089 master.cpp:9708] Successfully authenticated principal 'test-principal' at slave(1244)@172.17.0.2:42083 I0402 21:36:35.699178 3095 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(2109)@172.17.0.2:42083 I0402 21:36:35.699477 3096 slave.cpp:1651] Successfully authenticated with master master@172.17.0.2:42083 I0402 21:36:35.699932 3096 slave.cpp:2101] Will retry registration in 10.17146ms if necessary I0402 21:36:35.700147 3084 master.cpp:6174] Received register agent message from slave(1244)@172.17.0.2:42083 (602ba2965ad8) I0402 21:36:35.700630 3084 master.cpp:3705] Authorizing principal 'test-principal' to perform action REGISTER_AGENT on ANY object I0402 21:36:35.701320 3099 master.cpp:6241] Authorized registration of agent at slave(1244)@172.17.0.2:42083 (602ba2965ad8) I0402 21:36:35.701440 3099 master.cpp:6353] Registering agent at slave(1244)@172.17.0.2:42083 (602ba2965ad8) with id 32dc1034-09a8-4d13-b699-08453f7839c4-S0 I0402 21:36:35.702152 3094 registrar.cpp:487] Applied 1 operations in 228970ns; attempting to update the registry I0402 21:36:35.702831 3094 registrar.cpp:544] Successfully updated the registry in 615936ns I0402 21:36:35.703020 3085 master.cpp:6401] Admitted agent 32dc1034-09a8-4d13-b699-08453f7839c4-S0 at slave(1244)@172.17.0.2:42083 (602ba2965ad8) I0402 21:36:35.703930 3085 master.cpp:6446] Registered agent 32dc1034-09a8-4d13-b699-08453f7839c4-S0 at slave(1244)@172.17.0.2:42083 (602ba2965ad8) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0402 21:36:35.704085 3088 slave.cpp:1684] Registered with master master@172.17.0.2:42083; given agent ID 32dc1034-09a8-4d13-b699-08453f7839c4-S0 I0402 21:36:35.704242 3090 task_status_update_manager.cpp:188] Resuming sending task status updates I0402 21:36:35.704211 3095 hierarchical.cpp:959] Added agent 32dc1034-09a8-4d13-b699-08453f7839c4-S0 (602ba2965ad8) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] (offered or allocated: {}) I0402 21:36:35.704634 3095 hierarchical.cpp:1853] Performed allocation for 1 agents in 151823ns I0402 21:36:35.704639 3088 slave.cpp:1719] Checkpointing SlaveInfo to '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_mIV9xK/meta/slaves/32dc1034-09a8-4d13-b699-08453f7839c4-S0/slave.info' I0402 21:36:35.704752 3092 status_update_manager_process.hpp:385] Resuming operation status update manager I0402 21:36:35.705868 3088 slave.cpp:1771] Forwarding agent update {"operations":{},"resource_providers":{},"resource_version_uuid":{"value":"OrtPEEDRRu+NNiQPZ3UuQg=="},"slave_id":{"value":"32dc1034-09a8-4d13-b699-08453f7839c4-S0"},"update_oversubscribed_resources":false} I0402 21:36:35.706722 3091 master.cpp:7584] Ignoring update on agent 32dc1034-09a8-4d13-b699-08453f7839c4-S0 at slave(1244)@172.17.0.2:42083 (602ba2965ad8) as it reports no changes I0402 21:36:35.711403 3092 process.cpp:3671] Handling HTTP event for process 'slave(1244)' with path: '/slave(1244)/api/v1' I0402 21:36:35.712927 3098 http.cpp:1436] HTTP POST for /slave(1244)/api/v1 from 172.17.0.2:34436 I0402 21:36:35.713505 3098 http.cpp:2828] Processing GET_CONTAINERS call I0402 21:36:35.722911 3098 hierarchical.cpp:1853] Performed allocation for 1 agents in 160963ns I0402 21:36:35.745131 3094 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0402 21:36:35.748483 3096 process.cpp:3671] Handling HTTP event for process 'slave(1244)' with path: '/slave(1244)/api/v1' I0402 21:36:35.749692 3088 http.cpp:1436] HTTP POST for /slave(1244)/api/v1 from 172.17.0.2:34438 I0402 21:36:35.750362 3088 http.cpp:3289] Processing LAUNCH_CONTAINER call for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0402 21:36:35.751467 3097 http.cpp:3399] Creating sandbox '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_mIV9xK/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0402 21:36:35.752161 3094 containerizer.cpp:1397] Starting container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0402 21:36:35.752851 3094 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from STARTING to PROVISIONING after 294144ns I0402 21:36:35.753970 3094 containerizer.cpp:1575] Checkpointed ContainerConfig at '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_F8qc86/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE/config' I0402 21:36:35.754050 3094 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from PROVISIONING to PREPARING after 1.195776ms I0402 21:36:35.757230 3090 containerizer.cpp:2101] Launching 'mesos-containerizer' with flags '--help="false" --launch_info="{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v0","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_dJn8Xn","--available_capacity=0B","--volumes=","--forward=unix:///tmp/yDWur1/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"environment":{"variables":[{"name":"MESOS_SANDBOX","type":"VALUE","value":"/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_mIV9xK/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE"},{"name":"CSI_ENDPOINT","type":"VALUE","value":"unix:///tmp/mesos-csi-KHC9KW/endpoint.sock"}]},"task_environment":{},"working_directory":"/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_mIV9xK/containers/o rg-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE"}" --pipe_read="111" --pipe_write="112" --runtime_directory="/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_F8qc86/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE" --unshare_namespace_mnt="false"' I0402 21:36:35.768157 3090 launcher.cpp:145] Forked child with pid '14705' for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0402 21:36:35.769215 3090 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from PREPARING to ISOLATING after 15.16288ms I0402 21:36:35.770601 3090 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from ISOLATING to FETCHING after 1.383168ms I0402 21:36:35.771020 3096 fetcher.cpp:369] Starting to fetch URIs for container: org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE, directory: /tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_mIV9xK/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0402 21:36:35.772455 3085 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from FETCHING to RUNNING after 1.817856ms I0402 21:36:35.775127 3099 hierarchical.cpp:1853] Performed allocation for 1 agents in 263608ns I0402 21:36:35.776094 3091 container_daemon.cpp:140] Invoking post-start hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0402 21:36:35.776394 3084 service_manager.cpp:703] Connecting to endpoint 'unix:///tmp/mesos-csi-KHC9KW/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0402 21:36:35.826967 3095 hierarchical.cpp:1853] Performed allocation for 1 agents in 178057ns I0402 21:36:35.878504 3097 hierarchical.cpp:1853] Performed allocation for 1 agents in 238326ns I0402 21:36:35.929795 3095 hierarchical.cpp:1853] Performed allocation for 1 agents in 154973ns I0402 21:36:35.980875 3097 hierarchical.cpp:1853] Performed allocation for 1 agents in 165599ns I0402 21:36:36.032883 3096 hierarchical.cpp:1853] Performed allocation for 1 agents in 217485ns I0402 21:36:36.084635 3099 hierarchical.cpp:1853] Performed allocation for 1 agents in 148749ns I0402 21:36:36.098624 3089 service_manager.cpp:545] Probing endpoint 'unix:///tmp/mesos-csi-KHC9KW/endpoint.sock' with CSI v1 I0402 21:36:36.101585 3090 service_manager.cpp:532] Probing endpoint 'unix:///tmp/mesos-csi-KHC9KW/endpoint.sock' with CSI v0 I0402 21:36:36.102995 14709 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Identity/Probe call I0402 21:36:36.105960 3094 container_daemon.cpp:171] Waiting for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0402 21:36:36.109017 14709 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Identity/GetPluginCapabilities call I0402 21:36:36.109437 3099 process.cpp:3671] Handling HTTP event for process 'slave(1244)' with path: '/slave(1244)/api/v1' I0402 21:36:36.110905 3086 http.cpp:1436] HTTP POST for /slave(1244)/api/v1 from 172.17.0.2:34440 I0402 21:36:36.111454 3086 http.cpp:3513] Processing WAIT_CONTAINER call for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0402 21:36:36.113211 14709 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Identity/GetPluginInfo call I0402 21:36:36.113521 14709 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Identity/GetPluginInfo call I0402 21:36:36.115257 3084 v0_volume_manager.cpp:628] NODE_SERVICE loaded: {} I0402 21:36:36.115962 3084 v0_volume_manager.cpp:628] CONTROLLER_SERVICE loaded: {} I0402 21:36:36.118225 14709 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/ControllerGetCapabilities call I0402 21:36:36.121978 14709 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Node/NodeGetCapabilities call I0402 21:36:36.125512 14709 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Node/NodeGetId call I0402 21:36:36.128029 3092 provider.cpp:676] Recovered resources '{}' and 0 operations for resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test' I0402 21:36:36.128242 3085 status_update_manager_process.hpp:379] Pausing operation status update manager I0402 21:36:36.128649 3086 http_connection.hpp:227] New endpoint detected at http://172.17.0.2:42083/slave(1244)/api/v1/resource_provider I0402 21:36:36.132153 3097 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.2:42083/slave(1244)/api/v1/resource_provider I0402 21:36:36.132831 3094 provider.cpp:476] Connected to resource provider manager I0402 21:36:36.133463 3085 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.2:42083/slave(1244)/api/v1/resource_provider I0402 21:36:36.134857 3086 process.cpp:3671] Handling HTTP event for process 'slave(1244)' with path: '/slave(1244)/api/v1/resource_provider' I0402 21:36:36.136796 3091 http.cpp:1436] HTTP POST for /slave(1244)/api/v1/resource_provider from 172.17.0.2:34444 I0402 21:36:36.137030 3099 hierarchical.cpp:1853] Performed allocation for 1 agents in 173208ns I0402 21:36:36.137578 3093 manager.cpp:779] Subscribing resource provider {"default_reservations":[{"role":"storage","type":"DYNAMIC"}],"name":"test","storage":{"plugin":{"containers":[{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v0","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_dJn8Xn","--available_capacity=0B","--volumes=","--forward=unix:///tmp/yDWur1/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"resources":[{"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"}],"services":["CONTROLLER_SERVICE","NODE_SERVICE"]}],"name":"local","type":"org.apache.mesos.csi.test"},"reconciliation_interval_seconds":15.0},"type":"org.apache.mesos.rp.local.storage"} I0402 21:36:36.187975 3092 hierarchical.cpp:1853] Performed allocation for 1 agents in 229029ns I0402 21:36:36.190665 3088 slave.cpp:8702] Handling resource provider message 'SUBSCRIBE: {"default_reservations":[{"role":"storage","type":"DYNAMIC"}],"id":{"value":"0585625d-8f18-4733-8a73-d7eda8f5530e"},"name":"test","storage":{"plugin":{"containers":[{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v0","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_dJn8Xn","--available_capacity=0B","--volumes=","--forward=unix:///tmp/yDWur1/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"resources":[{"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"}],"services":["CONTROLLER_SERVICE","NODE_SERVICE"]}],"name":"local","type":"org.apache.mesos.csi.test"},"reconciliation_interval_seconds":15.0},"type":"org.apache.mesos.rp.local.storage"}' I0402 21:36:36.192510 3096 provider.cpp:498] Received SUBSCRIBED event I0402 21:36:36.192564 3096 provider.cpp:1309] Subscribed with ID 0585625d-8f18-4733-8a73-d7eda8f5530e I0402 21:36:36.193390 3094 status_update_manager_process.hpp:314] Recovering operation status update manager I0402 21:36:36.239584 3092 hierarchical.cpp:1853] Performed allocation for 1 agents in 141440ns I0402 21:36:36.257792 3095 provider.cpp:790] Reconciling storage pools and volumes I0402 21:36:36.260284 14709 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/ListVolumes call I0402 21:36:36.263437 3098 provider.cpp:2217] Sending UPDATE_STATE call with resources '{}' and 0 operations to agent 32dc1034-09a8-4d13-b699-08453f7839c4-S0 I0402 21:36:36.263837 3098 provider.cpp:748] Resource provider 0585625d-8f18-4733-8a73-d7eda8f5530e is in READY state I0402 21:36:36.263759 3095 http_connection.hpp:131] Sending UPDATE_STATE call to http://172.17.0.2:42083/slave(1244)/api/v1/resource_provider I0402 21:36:36.263892 3088 status_update_manager_process.hpp:385] Resuming operation status update manager I0402 21:36:36.264597 3093 provider.cpp:1235] Updating profiles { test } for resource provider 0585625d-8f18-4733-8a73-d7eda8f5530e I0402 21:36:36.264997 3099 process.cpp:3671] Handling HTTP event for process 'slave(1244)' with path: '/slave(1244)/api/v1/resource_provider' I0402 21:36:36.266010 3086 provider.cpp:790] Reconciling storage pools and volumes I0402 21:36:36.266839 3091 http.cpp:1436] HTTP POST for /slave(1244)/api/v1/resource_provider from 172.17.0.2:34442 I0402 21:36:36.267412 3087 manager.cpp:1011] Received UPDATE_STATE call with resources '[]' and 0 operations from resource provider 0585625d-8f18-4733-8a73-d7eda8f5530e I0402 21:36:36.267629 3096 slave.cpp:8702] Handling resource provider message 'UPDATE_STATE: 0585625d-8f18-4733-8a73-d7eda8f5530e {}' I0402 21:36:36.267771 3096 slave.cpp:8822] Forwarding new total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0402 21:36:36.268465 14709 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/ListVolumes call I0402 21:36:36.268815 14709 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/GetCapacity call I0402 21:36:36.269626 3084 hierarchical.cpp:1110] Grew agent 32dc1034-09a8-4d13-b699-08453f7839c4-S0 by {} (total), { } (used) I0402 21:36:36.270120 3084 hierarchical.cpp:1067] Agent 32dc1034-09a8-4d13-b699-08453f7839c4-S0 (602ba2965ad8) updated with total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0402 21:36:36.275555 3087 hierarchical.cpp:1853] Performed allocation for 1 agents in 150711ns I0402 21:36:36.275879 3097 provider.cpp:790] Reconciling storage pools and volumes I0402 21:36:36.278230 14709 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/ListVolumes call I0402 21:36:36.278523 14709 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/GetCapacity call I0402 21:36:36.289346 3083 slave.cpp:1000] Agent terminating I0402 21:36:36.290148 3083 manager.cpp:127] Terminating resource provider 0585625d-8f18-4733-8a73-d7eda8f5530e I0402 21:36:36.290664 3088 master.cpp:1292] Agent 32dc1034-09a8-4d13-b699-08453f7839c4-S0 at slave(1244)@172.17.0.2:42083 (602ba2965ad8) disconnected I0402 21:36:36.290711 3088 master.cpp:3361] Disconnecting agent 32dc1034-09a8-4d13-b699-08453f7839c4-S0 at slave(1244)@172.17.0.2:42083 (602ba2965ad8) I0402 21:36:36.290802 3088 master.cpp:3380] Deactivating agent 32dc1034-09a8-4d13-b699-08453f7839c4-S0 at slave(1244)@172.17.0.2:42083 (602ba2965ad8) I0402 21:36:36.290994 3084 hierarchical.cpp:1156] Agent 32dc1034-09a8-4d13-b699-08453f7839c4-S0 deactivated E0402 21:36:36.291235 3085 http_connection.hpp:449] End-Of-File received I0402 21:36:36.291674 3085 http_connection.hpp:217] Re-detecting endpoint I0402 21:36:36.292146 3085 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0402 21:36:36.292214 3085 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0402 21:36:36.292248 3097 provider.cpp:488] Disconnected from resource provider manager I0402 21:36:36.292282 3085 http_connection.hpp:227] New endpoint detected at http://172.17.0.2:42083/slave(1244)/api/v1/resource_provider I0402 21:36:36.292357 3092 status_update_manager_process.hpp:379] Pausing operation status update manager I0402 21:36:36.293694 3094 containerizer.cpp:2623] Destroying container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE in RUNNING state I0402 21:36:36.293764 3094 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from RUNNING to DESTROYING after 15.521352192secs I0402 21:36:36.294212 3094 launcher.cpp:161] Asked to destroy container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0402 21:36:36.295447 3091 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.2:42083/slave(1244)/api/v1/resource_provider I0402 21:36:36.296169 3090 provider.cpp:476] Connected to resource provider manager I0402 21:36:36.296895 3096 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.2:42083/slave(1244)/api/v1/resource_provider I0402 21:36:36.297804 3100 process.cpp:2781] Returning '404 Not Found' for '/slave(1244)/api/v1/resource_provider' E0402 21:36:36.299273 3087 provider.cpp:721] Failed to subscribe resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test': Received '404 Not Found' () I0402 21:36:36.322463 3092 hierarchical.cpp:1853] Performed allocation for 1 agents in 186669ns I0402 21:36:36.371745 3089 containerizer.cpp:3159] Container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE has exited I0402 21:36:36.373716 3087 provisioner.cpp:652] Ignoring destroy request for unknown container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0402 21:36:36.374097 3084 hierarchical.cpp:1853] Performed allocation for 1 agents in 159072ns I0402 21:36:36.376709 3095 container_daemon.cpp:189] Invoking post-stop hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0402 21:36:36.376950 3099 service_manager.cpp:723] Disconnected from endpoint 'unix:///tmp/mesos-csi-KHC9KW/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0402 21:36:36.377207 3087 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0402 21:36:36.380203 3100 process.cpp:2781] Returning '404 Not Found' for '/slave(1244)/api/v1' I0402 21:36:36.392422 3083 master.cpp:1140] Master terminating I0402 21:36:36.392841 3091 hierarchical.cpp:1132] Removed all filters for agent 32dc1034-09a8-4d13-b699-08453f7839c4-S0 I0402 21:36:36.392865 3091 hierarchical.cpp:1008] Removed agent 32dc1034-09a8-4d13-b699-08453f7839c4-S0 [ OK ] CSIVersion/StorageLocalResourceProviderTest.Update/v0 (775 ms) [ RUN ] CSIVersion/StorageLocalResourceProviderTest.Update/v1 I0402 21:36:36.411164 3083 cluster.cpp:186] Creating default 'local' authorizer I0402 21:36:36.415964 3096 master.cpp:443] Master c8d6d593-6ab7-4da4-abaa-82b3189df132 (602ba2965ad8) started on 172.17.0.2:42083 I0402 21:36:36.416007 3096 master.cpp:446] Flags at startup: --acls="" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins" --allocation_interval="50ms" --allocator="hierarchical" --authenticate_agents="true" --authenticate_frameworks="true" --authenticate_http_frameworks="true" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authentication_v0_timeout="15secs" --authenticators="crammd5" --authorizers="local" --credentials="/tmp/dp7oLc/credentials" --filter_gpu_resources="true" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_framework_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_operator_event_stream_subscribers="1000" --max_unreachable_tasks_per_framework="1000" --memory_profiling="false" --min_alloca table_resources="cpus:0.01|mem:32" --port="5050" --publish_per_framework_metrics="true" --quiet="false" --recovery_agent_removal_limit="100%" --registry="in_memory" --registry_fetch_timeout="1mins" --registry_gc_interval="15mins" --registry_max_agent_age="2weeks" --registry_max_agent_count="102400" --registry_store_timeout="100secs" --registry_strict="false" --require_agent_domain="false" --role_sorter="drf" --root_submissions="true" --version="false" --webui_dir="/tmp/SRC/build/mesos-1.10.0/_inst/share/mesos/webui" --work_dir="/tmp/dp7oLc/master" --zk_session_timeout="10secs" I0402 21:36:36.416498 3096 master.cpp:495] Master only allowing authenticated frameworks to register I0402 21:36:36.416517 3096 master.cpp:501] Master only allowing authenticated agents to register I0402 21:36:36.416527 3096 master.cpp:507] Master only allowing authenticated HTTP frameworks to register I0402 21:36:36.416539 3096 credentials.hpp:37] Loading credentials for authentication from '/tmp/dp7oLc/credentials' I0402 21:36:36.416882 3096 master.cpp:551] Using default 'crammd5' authenticator I0402 21:36:36.417171 3096 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readonly' I0402 21:36:36.417450 3096 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readwrite' I0402 21:36:36.417675 3096 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-master-scheduler' I0402 21:36:36.417892 3096 master.cpp:632] Authorization enabled I0402 21:36:36.418390 3089 whitelist_watcher.cpp:77] No whitelist given I0402 21:36:36.418392 3093 hierarchical.cpp:567] Initialized hierarchical allocator process I0402 21:36:36.421723 3088 master.cpp:2165] Elected as the leading master! I0402 21:36:36.421767 3088 master.cpp:1661] Recovering from registrar I0402 21:36:36.422008 3085 registrar.cpp:339] Recovering registrar I0402 21:36:36.422749 3085 registrar.cpp:383] Successfully fetched the registry (0B) in 0ns I0402 21:36:36.422875 3085 registrar.cpp:487] Applied 1 operations in 38248ns; attempting to update the registry I0402 21:36:36.423512 3085 registrar.cpp:544] Successfully updated the registry in 0ns I0402 21:36:36.423640 3085 registrar.cpp:416] Successfully recovered registrar I0402 21:36:36.424118 3093 master.cpp:1814] Recovered 0 agents from the registry (144B); allowing 10mins for agents to reregister I0402 21:36:36.424204 3096 hierarchical.cpp:606] Skipping recovery of hierarchical allocator: nothing to recover W0402 21:36:36.437018 3083 process.cpp:2877] Attempted to spawn already running process files@172.17.0.2:42083 I0402 21:36:36.438396 3083 containerizer.cpp:317] Using isolation { environment_secret, posix/cpu, posix/mem, filesystem/posix, network/cni } W0402 21:36:36.439000 3083 backend.cpp:76] Failed to create 'overlay' backend: OverlayBackend requires root privileges W0402 21:36:36.439033 3083 backend.cpp:76] Failed to create 'aufs' backend: AufsBackend requires root privileges W0402 21:36:36.439050 3083 backend.cpp:76] Failed to create 'bind' backend: BindBackend requires root privileges I0402 21:36:36.439080 3083 provisioner.cpp:294] Using default backend 'copy' I0402 21:36:36.441752 3083 cluster.cpp:533] Creating default 'local' authorizer I0402 21:36:36.444193 3092 slave.cpp:279] Mesos agent started on (1245)@172.17.0.2:42083 I0402 21:36:36.444229 3092 slave.cpp:280] Flags at startup: --acls="" --appc_simple_discovery_uri_prefix="http://"; --appc_store_dir="/tmp/dp7oLc/3sXvcN/store/appc" --authenticate_http_readonly="true" --authenticate_http_readwrite="false" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authentication_timeout_max="1mins" --authentication_timeout_min="5secs" --authorizer="local" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_destroy_timeout="1mins" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="mesos" --credential="/tmp/dp7oLc/3sXvcN/credential" --default_role="*" --disallow_sharing_agent_ipc_namespace="false" --disallow_sharing_agent_pid_namespace="false" --disk_profile_adaptor="org_apache_mesos_UriDiskProfileAdaptor" --disk_watch_interval="1mins" --docker="docker" --docker_ignore_runtime="false" --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io"; --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/dp7oLc/3sXvcN/store/docker" --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume" --docker_volume_chown="false" --enforce_container_disk_quota="false" --executor_registration_timeout="1mins" --executor_reregistration_timeout="2secs" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/dp7oLc/3sXvcN/fetch" --fetcher_cache_size="2GB" --fetcher_stall_timeout="1mins" --frameworks_home="/tmp/dp7oLc/3sXvcN/frameworks" --gc_delay="1weeks" --gc_disk_headroom="0.1" --gc_non_executor_container_sandboxes="false" --help="false" --hostname_lookup="true" --http_command_executor="false" --http_credentials="/tmp/dp7oLc/3sXvcN/http_credentials" --http_executor_domain_sockets="false" --http_heartbeat_interval="30secs" --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem" --launcher="posi x" --launcher_dir="/tmp/SRC/build/mesos-1.10.0/_build/sub/src" --logbufsecs="0" --logging_level="INFO" --max_completed_executors_per_framework="150" --memory_profiling="false" --network_cni_metrics="true" --network_cni_root_dir_persist="false" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns" --quiet="false" --reconfiguration_policy="equal" --recover="reconnect" --recovery_timeout="15mins" --registration_backoff_factor="10ms" --resource_provider_config_dir="/tmp/dp7oLc/resource_provider_configs" --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]" --revocable_cpu_low_priority="true" --runtime_dir="/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_AXXkzo" --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true" --systemd_enable_support="true" --systemd_runtime_directory="/run/systemd/system" --version="false" --work_dir="/tmp/CSIVersion_StorageLoca lResourceProviderTest_Update_v1_hJTaWZ" --zk_session_timeout="10secs" I0402 21:36:36.444931 3092 credentials.hpp:86] Loading credential for authentication from '/tmp/dp7oLc/3sXvcN/credential' I0402 21:36:36.445120 3092 slave.cpp:312] Agent using credential for: test-principal I0402 21:36:36.445163 3092 credentials.hpp:37] Loading credentials for authentication from '/tmp/dp7oLc/3sXvcN/http_credentials' I0402 21:36:36.445452 3092 http.cpp:1296] Creating default 'basic' HTTP authenticator for realm 'mesos-agent-readonly' I0402 21:36:36.445924 3092 disk_profile_adaptor.cpp:82] Creating disk profile adaptor module 'org_apache_mesos_UriDiskProfileAdaptor' I0402 21:36:36.447568 3095 hierarchical.cpp:1853] Performed allocation for 0 agents in 134019ns I0402 21:36:36.447707 3094 uri_disk_profile_adaptor.cpp:305] Updated disk profile mapping to 1 active profiles I0402 21:36:36.448344 3092 slave.cpp:627] Agent resources: [{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}] I0402 21:36:36.448652 3092 slave.cpp:635] Agent attributes: [ ] I0402 21:36:36.448673 3092 slave.cpp:644] Agent hostname: 602ba2965ad8 I0402 21:36:36.448900 3097 status_update_manager_process.hpp:379] Pausing operation status update manager I0402 21:36:36.448931 3098 task_status_update_manager.cpp:181] Pausing sending task status updates I0402 21:36:36.450932 3084 state.cpp:68] Recovering state from '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_hJTaWZ/meta' I0402 21:36:36.451186 3090 slave.cpp:7711] Finished recovering checkpointed state from '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_hJTaWZ/meta', beginning agent recovery I0402 21:36:36.451928 3093 task_status_update_manager.cpp:207] Recovering task status update manager I0402 21:36:36.452486 3099 containerizer.cpp:822] Recovering Mesos containers I0402 21:36:36.452939 3099 containerizer.cpp:1162] Recovering isolators I0402 21:36:36.454232 3089 containerizer.cpp:1201] Recovering provisioner I0402 21:36:36.455066 3085 provisioner.cpp:518] Provisioner recovery complete I0402 21:36:36.456063 3095 composing.cpp:343] Finished recovering all containerizers I0402 21:36:36.456388 3092 slave.cpp:8193] Recovering executors I0402 21:36:36.456542 3092 slave.cpp:8346] Finished recovery I0402 21:36:36.457485 3086 task_status_update_manager.cpp:181] Pausing sending task status updates I0402 21:36:36.457499 3096 slave.cpp:1459] New master detected at master@172.17.0.2:42083 I0402 21:36:36.457515 3084 status_update_manager_process.hpp:379] Pausing operation status update manager I0402 21:36:36.457648 3096 slave.cpp:1524] Detecting new master I0402 21:36:36.460134 3094 slave.cpp:1551] Authenticating with master master@172.17.0.2:42083 I0402 21:36:36.460242 3094 slave.cpp:1560] Using default CRAM-MD5 authenticatee I0402 21:36:36.460616 3093 authenticatee.cpp:121] Creating new client SASL connection I0402 21:36:36.460959 3098 master.cpp:9676] Authenticating slave(1245)@172.17.0.2:42083 I0402 21:36:36.461113 3087 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(2110)@172.17.0.2:42083 I0402 21:36:36.461546 3099 authenticator.cpp:98] Creating new server SASL connection I0402 21:36:36.461843 3095 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 I0402 21:36:36.461881 3095 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' I0402 21:36:36.462033 3095 authenticator.cpp:204] Received SASL authentication start I0402 21:36:36.462108 3095 authenticator.cpp:326] Authentication requires more steps I0402 21:36:36.462260 3089 authenticatee.cpp:259] Received SASL authentication step I0402 21:36:36.462436 3092 authenticator.cpp:232] Received SASL authentication step I0402 21:36:36.462482 3092 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '602ba2965ad8' server FQDN: '602ba2965ad8' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false I0402 21:36:36.462504 3092 auxprop.cpp:181] Looking up auxiliary property '*userPassword' I0402 21:36:36.462559 3092 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' I0402 21:36:36.462601 3092 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '602ba2965ad8' server FQDN: '602ba2965ad8' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true I0402 21:36:36.462625 3092 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true I0402 21:36:36.462641 3092 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true I0402 21:36:36.462667 3092 authenticator.cpp:318] Authentication success I0402 21:36:36.462764 3097 authenticatee.cpp:299] Authentication success I0402 21:36:36.462869 3086 master.cpp:9708] Successfully authenticated principal 'test-principal' at slave(1245)@172.17.0.2:42083 I0402 21:36:36.462945 3085 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(2110)@172.17.0.2:42083 I0402 21:36:36.463156 3084 slave.cpp:1651] Successfully authenticated with master master@172.17.0.2:42083 I0402 21:36:36.463500 3084 slave.cpp:2101] Will retry registration in 5.652367ms if necessary I0402 21:36:36.463732 3098 master.cpp:6174] Received register agent message from slave(1245)@172.17.0.2:42083 (602ba2965ad8) I0402 21:36:36.464172 3098 master.cpp:3705] Authorizing principal 'test-principal' to perform action REGISTER_AGENT on ANY object I0402 21:36:36.464761 3095 master.cpp:6241] Authorized registration of agent at slave(1245)@172.17.0.2:42083 (602ba2965ad8) I0402 21:36:36.464890 3095 master.cpp:6353] Registering agent at slave(1245)@172.17.0.2:42083 (602ba2965ad8) with id c8d6d593-6ab7-4da4-abaa-82b3189df132-S0 I0402 21:36:36.465679 3090 registrar.cpp:487] Applied 1 operations in 255494ns; attempting to update the registry I0402 21:36:36.466454 3090 registrar.cpp:544] Successfully updated the registry in 699904ns I0402 21:36:36.466660 3097 master.cpp:6401] Admitted agent c8d6d593-6ab7-4da4-abaa-82b3189df132-S0 at slave(1245)@172.17.0.2:42083 (602ba2965ad8) I0402 21:36:36.467519 3097 master.cpp:6446] Registered agent c8d6d593-6ab7-4da4-abaa-82b3189df132-S0 at slave(1245)@172.17.0.2:42083 (602ba2965ad8) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0402 21:36:36.467677 3085 slave.cpp:1684] Registered with master master@172.17.0.2:42083; given agent ID c8d6d593-6ab7-4da4-abaa-82b3189df132-S0 I0402 21:36:36.467849 3099 task_status_update_manager.cpp:188] Resuming sending task status updates I0402 21:36:36.467785 3094 hierarchical.cpp:959] Added agent c8d6d593-6ab7-4da4-abaa-82b3189df132-S0 (602ba2965ad8) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] (offered or allocated: {}) I0402 21:36:36.468228 3094 hierarchical.cpp:1853] Performed allocation for 1 agents in 145077ns I0402 21:36:36.493340 3085 slave.cpp:1719] Checkpointing SlaveInfo to '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_hJTaWZ/meta/slaves/c8d6d593-6ab7-4da4-abaa-82b3189df132-S0/slave.info' I0402 21:36:36.493497 3087 status_update_manager_process.hpp:385] Resuming operation status update manager I0402 21:36:36.494427 3085 slave.cpp:1771] Forwarding agent update {"operations":{},"resource_providers":{},"resource_version_uuid":{"value":"96wKTDQCTgOutgoiIQsEhQ=="},"slave_id":{"value":"c8d6d593-6ab7-4da4-abaa-82b3189df132-S0"},"update_oversubscribed_resources":false} I0402 21:36:36.495239 3096 master.cpp:7584] Ignoring update on agent c8d6d593-6ab7-4da4-abaa-82b3189df132-S0 at slave(1245)@172.17.0.2:42083 (602ba2965ad8) as it reports no changes I0402 21:36:36.498311 3094 hierarchical.cpp:1853] Performed allocation for 1 agents in 123539ns I0402 21:36:36.499670 3089 process.cpp:3671] Handling HTTP event for process 'slave(1245)' with path: '/slave(1245)/api/v1' I0402 21:36:36.501056 3093 http.cpp:1436] HTTP POST for /slave(1245)/api/v1 from 172.17.0.2:34452 I0402 21:36:36.501664 3093 http.cpp:2828] Processing GET_CONTAINERS call I0402 21:36:36.507848 3093 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0402 21:36:36.510331 3099 process.cpp:3671] Handling HTTP event for process 'slave(1245)' with path: '/slave(1245)/api/v1' I0402 21:36:36.511468 3087 http.cpp:1436] HTTP POST for /slave(1245)/api/v1 from 172.17.0.2:34454 I0402 21:36:36.512362 3087 http.cpp:3289] Processing LAUNCH_CONTAINER call for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0402 21:36:36.513607 3089 http.cpp:3399] Creating sandbox '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_hJTaWZ/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0402 21:36:36.514407 3086 containerizer.cpp:1397] Starting container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0402 21:36:36.514991 3086 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from STARTING to PROVISIONING after 255744ns I0402 21:36:36.515720 3086 containerizer.cpp:1575] Checkpointed ContainerConfig at '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_AXXkzo/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE/config' I0402 21:36:36.515772 3086 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from PROVISIONING to PREPARING after 784128ns I0402 21:36:36.536428 3095 containerizer.cpp:2101] Launching 'mesos-containerizer' with flags '--help="false" --launch_info="{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v1","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_S3rbkB","--available_capacity=0B","--volumes=","--forward=unix:///tmp/dp7oLc/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"environment":{"variables":[{"name":"MESOS_SANDBOX","type":"VALUE","value":"/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_hJTaWZ/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE"},{"name":"CSI_ENDPOINT","type":"VALUE","value":"unix:///tmp/mesos-csi-l0Wiko/endpoint.sock"}]},"task_environment":{},"working_directory":"/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_hJTaWZ/containers/o rg-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE"}" --pipe_read="111" --pipe_write="112" --runtime_directory="/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_AXXkzo/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE" --unshare_namespace_mnt="false"' I0402 21:36:36.545148 3095 launcher.cpp:145] Forked child with pid '14718' for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0402 21:36:36.546077 3095 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from PREPARING to ISOLATING after 30.284032ms I0402 21:36:36.547943 3086 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from ISOLATING to FETCHING after 1.7088ms I0402 21:36:36.548420 3099 fetcher.cpp:369] Starting to fetch URIs for container: org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE, directory: /tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_hJTaWZ/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0402 21:36:36.550179 3084 hierarchical.cpp:1853] Performed allocation for 1 agents in 273691ns I0402 21:36:36.550300 3090 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from FETCHING to RUNNING after 2.434048ms I0402 21:36:36.553290 3097 container_daemon.cpp:140] Invoking post-start hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0402 21:36:36.553597 3092 service_manager.cpp:703] Connecting to endpoint 'unix:///tmp/mesos-csi-l0Wiko/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0402 21:36:36.601977 3087 hierarchical.cpp:1853] Performed allocation for 1 agents in 180609ns I0402 21:36:36.653352 3096 hierarchical.cpp:1853] Performed allocation for 1 agents in 162234ns I0402 21:36:36.704200 3090 hierarchical.cpp:1853] Performed allocation for 1 agents in 195582ns I0402 21:36:36.755209 3095 hierarchical.cpp:1853] Performed allocation for 1 agents in 130156ns I0402 21:36:36.806334 3099 hierarchical.cpp:1853] Performed allocation for 1 agents in 199242ns I0402 21:36:36.857909 3088 hierarchical.cpp:1853] Performed allocation for 1 agents in 216369ns I0402 21:36:36.898304 3093 service_manager.cpp:545] Probing endpoint 'unix:///tmp/mesos-csi-l0Wiko/endpoint.sock' with CSI v1 I0402 21:36:36.905210 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Identity/Probe call I0402 21:36:36.908424 3084 container_daemon.cpp:171] Waiting for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0402 21:36:36.909341 3090 hierarchical.cpp:1853] Performed allocation for 1 agents in 165824ns I0402 21:36:36.911341 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Identity/GetPluginCapabilities call I0402 21:36:36.911981 3096 process.cpp:3671] Handling HTTP event for process 'slave(1245)' with path: '/slave(1245)/api/v1' I0402 21:36:36.913491 3087 http.cpp:1436] HTTP POST for /slave(1245)/api/v1 from 172.17.0.2:34456 I0402 21:36:36.914119 3087 http.cpp:3513] Processing WAIT_CONTAINER call for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0402 21:36:36.916199 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Identity/GetPluginInfo call I0402 21:36:36.916605 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Identity/GetPluginInfo call I0402 21:36:36.918501 3092 v1_volume_manager.cpp:649] NODE_SERVICE loaded: {} I0402 21:36:36.919008 3092 v1_volume_manager.cpp:649] CONTROLLER_SERVICE loaded: {} I0402 21:36:36.921154 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/ControllerGetCapabilities call I0402 21:36:36.925184 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Node/NodeGetCapabilities call I0402 21:36:36.928795 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Node/NodeGetInfo call I0402 21:36:36.931282 3098 provider.cpp:676] Recovered resources '{}' and 0 operations for resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test' I0402 21:36:36.931428 3090 status_update_manager_process.hpp:379] Pausing operation status update manager I0402 21:36:36.931938 3084 http_connection.hpp:227] New endpoint detected at http://172.17.0.2:42083/slave(1245)/api/v1/resource_provider I0402 21:36:36.935042 3095 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.2:42083/slave(1245)/api/v1/resource_provider I0402 21:36:36.935739 3091 provider.cpp:476] Connected to resource provider manager I0402 21:36:36.936475 3090 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.2:42083/slave(1245)/api/v1/resource_provider I0402 21:36:36.937606 3084 process.cpp:3671] Handling HTTP event for process 'slave(1245)' with path: '/slave(1245)/api/v1/resource_provider' I0402 21:36:36.939517 3094 http.cpp:1436] HTTP POST for /slave(1245)/api/v1/resource_provider from 172.17.0.2:34460 I0402 21:36:36.940311 3093 manager.cpp:779] Subscribing resource provider {"default_reservations":[{"role":"storage","type":"DYNAMIC"}],"name":"test","storage":{"plugin":{"containers":[{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v1","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_S3rbkB","--available_capacity=0B","--volumes=","--forward=unix:///tmp/dp7oLc/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"resources":[{"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"}],"services":["CONTROLLER_SERVICE","NODE_SERVICE"]}],"name":"local","type":"org.apache.mesos.csi.test"},"reconciliation_interval_seconds":15.0},"type":"org.apache.mesos.rp.local.storage"} I0402 21:36:36.961431 3090 hierarchical.cpp:1853] Performed allocation for 1 agents in 224504ns I0402 21:36:36.998154 3085 slave.cpp:8702] Handling resource provider message 'SUBSCRIBE: {"default_reservations":[{"role":"storage","type":"DYNAMIC"}],"id":{"value":"ae4dac74-e1de-4faa-807b-c42c75882fb0"},"name":"test","storage":{"plugin":{"containers":[{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v1","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_S3rbkB","--available_capacity=0B","--volumes=","--forward=unix:///tmp/dp7oLc/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"resources":[{"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"}],"services":["CONTROLLER_SERVICE","NODE_SERVICE"]}],"name":"local","type":"org.apache.mesos.csi.test"},"reconciliation_interval_seconds":15.0},"type":"org.apache.mesos.rp.local.storage"}' I0402 21:36:36.999970 3088 provider.cpp:498] Received SUBSCRIBED event I0402 21:36:37.000021 3088 provider.cpp:1309] Subscribed with ID ae4dac74-e1de-4faa-807b-c42c75882fb0 I0402 21:36:37.000902 3091 status_update_manager_process.hpp:314] Recovering operation status update manager I0402 21:36:37.012975 3090 hierarchical.cpp:1853] Performed allocation for 1 agents in 124497ns I0402 21:36:37.064182 3098 hierarchical.cpp:1853] Performed allocation for 1 agents in 147551ns I0402 21:36:37.075670 3095 provider.cpp:790] Reconciling storage pools and volumes I0402 21:36:37.078003 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/ListVolumes call I0402 21:36:37.081130 3086 provider.cpp:2217] Sending UPDATE_STATE call with resources '{}' and 0 operations to agent c8d6d593-6ab7-4da4-abaa-82b3189df132-S0 I0402 21:36:37.081444 3089 http_connection.hpp:131] Sending UPDATE_STATE call to http://172.17.0.2:42083/slave(1245)/api/v1/resource_provider I0402 21:36:37.081543 3086 provider.cpp:748] Resource provider ae4dac74-e1de-4faa-807b-c42c75882fb0 is in READY state I0402 21:36:37.081687 3085 status_update_manager_process.hpp:385] Resuming operation status update manager I0402 21:36:37.082446 3094 provider.cpp:1235] Updating profiles { test } for resource provider ae4dac74-e1de-4faa-807b-c42c75882fb0 I0402 21:36:37.083006 3096 process.cpp:3671] Handling HTTP event for process 'slave(1245)' with path: '/slave(1245)/api/v1/resource_provider' I0402 21:36:37.083890 3087 provider.cpp:790] Reconciling storage pools and volumes I0402 21:36:37.085059 3093 http.cpp:1436] HTTP POST for /slave(1245)/api/v1/resource_provider from 172.17.0.2:34458 I0402 21:36:37.085711 3090 manager.cpp:1011] Received UPDATE_STATE call with resources '[]' and 0 operations from resource provider ae4dac74-e1de-4faa-807b-c42c75882fb0 I0402 21:36:37.085953 3099 slave.cpp:8702] Handling resource provider message 'UPDATE_STATE: ae4dac74-e1de-4faa-807b-c42c75882fb0 {}' I0402 21:36:37.086066 3099 slave.cpp:8822] Forwarding new total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0402 21:36:37.086381 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/ListVolumes call I0402 21:36:37.086799 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/GetCapacity call I0402 21:36:37.087885 3090 hierarchical.cpp:1110] Grew agent c8d6d593-6ab7-4da4-abaa-82b3189df132-S0 by {} (total), { } (used) I0402 21:36:37.088476 3090 hierarchical.cpp:1067] Agent c8d6d593-6ab7-4da4-abaa-82b3189df132-S0 (602ba2965ad8) updated with total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0402 21:36:37.093006 3094 hierarchical.cpp:1853] Performed allocation for 1 agents in 143559ns I0402 21:36:37.093353 3099 provider.cpp:790] Reconciling storage pools and volumes I0402 21:36:37.095568 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/ListVolumes call I0402 21:36:37.095899 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/GetCapacity call I0402 21:36:37.106341 3093 slave.cpp:1000] Agent terminating I0402 21:36:37.107146 3093 manager.cpp:127] Terminating resource provider ae4dac74-e1de-4faa-807b-c42c75882fb0 I0402 21:36:37.107621 3098 master.cpp:1292] Agent c8d6d593-6ab7-4da4-abaa-82b3189df132-S0 at slave(1245)@172.17.0.2:42083 (602ba2965ad8) disconnected I0402 21:36:37.107661 3098 master.cpp:3361] Disconnecting agent c8d6d593-6ab7-4da4-abaa-82b3189df132-S0 at slave(1245)@172.17.0.2:42083 (602ba2965ad8) I0402 21:36:37.107740 3098 master.cpp:3380] Deactivating agent c8d6d593-6ab7-4da4-abaa-82b3189df132-S0 at slave(1245)@172.17.0.2:42083 (602ba2965ad8) I0402 21:36:37.107969 3085 hierarchical.cpp:1156] Agent c8d6d593-6ab7-4da4-abaa-82b3189df132-S0 deactivated E0402 21:36:37.108261 3097 http_connection.hpp:449] End-Of-File received I0402 21:36:37.108824 3097 http_connection.hpp:217] Re-detecting endpoint I0402 21:36:37.109361 3097 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0402 21:36:37.109444 3097 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0402 21:36:37.109475 3093 provider.cpp:488] Disconnected from resource provider manager I0402 21:36:37.109539 3097 http_connection.hpp:227] New endpoint detected at http://172.17.0.2:42083/slave(1245)/api/v1/resource_provider I0402 21:36:37.109642 3084 status_update_manager_process.hpp:379] Pausing operation status update manager I0402 21:36:37.111110 3089 containerizer.cpp:2623] Destroying container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE in RUNNING state I0402 21:36:37.111157 3089 containerizer.cpp:3321] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from RUNNING to DESTROYING after 15.560960256secs I0402 21:36:37.111534 3089 launcher.cpp:161] Asked to destroy container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0402 21:36:37.112455 3094 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.2:42083/slave(1245)/api/v1/resource_provider I0402 21:36:37.113170 3096 provider.cpp:476] Connected to resource provider manager I0402 21:36:37.113862 3091 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.2:42083/slave(1245)/api/v1/resource_provider I0402 21:36:37.114754 3100 process.cpp:2781] Returning '404 Not Found' for '/slave(1245)/api/v1/resource_provider' E0402 21:36:37.115948 3093 provider.cpp:721] Failed to subscribe resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test': Received '404 Not Found' () I0402 21:36:37.139036 3095 hierarchical.cpp:1853] Performed allocation for 1 agents in 130010ns I0402 21:36:37.189448 3085 containerizer.cpp:3159] Container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE has exited I0402 21:36:37.190961 3092 hierarchical.cpp:1853] Performed allocation for 1 agents in 168474ns I0402 21:36:37.191510 3088 provisioner.cpp:652] Ignoring destroy request for unknown container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0402 21:36:37.194263 3093 container_daemon.cpp:189] Invoking post-stop hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0402 21:36:37.194517 3097 service_manager.cpp:723] Disconnected from endpoint 'unix:///tmp/mesos-csi-l0Wiko/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0402 21:36:37.194825 3092 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0402 21:36:37.197904 3100 process.cpp:2781] Returning '404 Not Found' for '/slave(1245)/api/v1' I0402 21:36:37.209311 3083 master.cpp:1140] Master terminating I0402 21:36:37.209751 3097 hierarchical.cpp:1132] Removed all filters for agent c8d6d593-6ab7-4da4-abaa-82b3189df132-S0 I0402 21:36:37.209779 3097 hierarchical.cpp:1008] Removed agent c8d6d593-6ab7-4da4-abaa-82b3189df132-S0 [ OK ] CSIVersion/StorageLocalResourceProviderTest.Update/v1 (819 ms) [----------] 54 tests from CSIVersion/StorageLocalResourceProviderTest (102250 ms total) [----------] Global test environment tear-down [==========] 2319 tests from 223 test cases ran. (1302376 ms total) [ PASSED ] 2318 tests. [ FAILED ] 1 test, listed below: [ FAILED ] TaskGroupValidationTest.ResourceLimits 1 FAILED TEST YOU HAVE 34 DISABLED TESTS I0402 21:36:37.306282 3100 process.cpp:935] Stopped the socket accept loop Makefile:15957: recipe for target 'check-local' failed make[4]: *** [check-local] Error 1 make[4]: Leaving directory '/tmp/SRC/build/mesos-1.10.0/_build/sub/src' Makefile:15073: recipe for target 'check-am' failed make[3]: *** [check-am] Error 2 make[3]: Leaving directory '/tmp/SRC/build/mesos-1.10.0/_build/sub/src' Makefile:15077: recipe for target 'check' failed make[2]: *** [check] Error 2 make[2]: Leaving directory '/tmp/SRC/build/mesos-1.10.0/_build/sub/src' Makefile:785: recipe for target 'check-recursive' failed make[1]: *** [check-recursive] Error 1 make[1]: Leaving directory '/tmp/SRC/build/mesos-1.10.0/_build/sub' Makefile:991: recipe for target 'distcheck' failed make: *** [distcheck] Error 1 Untagged: mesos/mesos-build:ubuntu-16.04 Untagged: mesos/mesos-build@sha256:fa967cbcfb44f55708a3cbc87f245c6d29dd891464db558af56a03ee321526bb Deleted: sha256:e895c0531b9a9a288fabe479a49f7059aed83645351ac99ec2ea2616822c9f97 Deleted: sha256:09119b0b314a69ba6ec6251f2e89f4199fe1e874c84f9abf07dcbd23dbc3f1c1 Deleted: sha256:562fe6af5a3883058be9c784a839392215ed4185a21d21f1d99df0d17f3ae6e7 Deleted: sha256:0dcdfbe322a4f332f73ac70905d557300ec6dae3bd19586758772c750c7b4a19 Deleted: sha256:c66652d605f01094e2db53d62505dbd524e076d5aa69b89d5e620003803eb149 Deleted: sha256:a2cf79bfb9593c05fd7142ddb49afef77ea4ad5d2464e841f09fe62ffee396e0 Deleted: sha256:f7a904214b390f39d98573882f631dc908df8b2b540cf04e1062f8182c1efffd Deleted: sha256:ce1f6fcaa83dfce189d76e08f184085732eab4eeb2562d2399953958405c5bec Deleted: sha256:cce92fda689ab9033f0b8db214bc63edd1ae3e05831a0f3a9418976d7dc7ccdd Deleted: sha256:d22094bbd65447c59a42c580eaa3a44cee9cd855f00905f59409be21bcefc745 Deleted: sha256:b8976847450013f3eb5e9a81a5778f73ed7bef67e6393049712ef17102b4b7b7 Deleted: sha256:b8c891f0ffec910a12757d733b178e3f62d81dbbde2b31d3b754071c416108ed Full log: https://builds.apache.org/job/Mesos-Reviewbot-Linux/8536/console - Mesos Reviewbot On April 2, 2020, 5:17 p.m., Greg Mann wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/72297/ > ----------------------------------------------------------- > > (Updated April 2, 2020, 5:17 p.m.) > > > Review request for mesos, Benjamin Mahler and Qian Zhang. > > > Repository: mesos > > > Description > ------- > > This prevents tasks from being launched on agents which would > not be capable of enforcing the specified limits. > > > Diffs > ----- > > src/slave/slave.hpp d7e65e0538caa850b1a5bae837e7c06b8c725ff3 > src/slave/slave.cpp 6a4802338485f8d90220b7f03a99486acae8e2e2 > src/tests/master_tests.cpp 8cc8d20fbf44bf9f1bd7e3ab0bc600efbabd2709 > src/tests/master_validation_tests.cpp > 9efca42d66119dd909e117d239378eca08c5ab82 > > > Diff: https://reviews.apache.org/r/72297/diff/2/ > > > Testing > ------- > > `make check` > > > Thanks, > > Greg Mann > >
