----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72017/#review219406 -----------------------------------------------------------
Bad patch! Reviews applied: [72014, 72016, 72017] Failed command: ['bash', '-c', "set -o pipefail; export OS='ubuntu:16.04' BUILDTOOL='autotools' COMPILER='gcc' CONFIGURATION='--verbose --disable-libtool-wrappers --disable-parallel-test-execution' ENVIRONMENT='GLOG_v=1 MESOS_VERBOSE=1'; ./support/jenkins/buildbot.sh 2>&1 | tee build_72017"] Error: ...<truncated>... on.hpp:131] Sending UPDATE_OPERATION_STATUS call to http://172.17.0.3:43601/slave(1249)/api/v1/resource_provider I0128 20:10:50.233379 3185 process.cpp:3671] Handling HTTP event for process 'slave(1249)' with path: '/slave(1249)/api/v1/resource_provider' I0128 20:10:50.236794 3191 hierarchical.cpp:1853] Performed allocation for 1 agents in 1.165881ms I0128 20:10:50.237440 3186 master.cpp:9974] Sending offers [ e4dbffe1-4304-4562-8ffa-03413ef19b66-O3 ] to framework e4dbffe1-4304-4562-8ffa-03413ef19b66-0000 (default) at [email protected]:43601 I0128 20:10:50.238032 3192 sched.cpp:934] Scheduler::resourceOffers took 77206ns I0128 20:10:50.241688 3187 process.cpp:3671] Handling HTTP event for process 'master' with path: '/master/api/v1' I0128 20:10:50.243862 3197 http.cpp:1405] HTTP POST for /master/api/v1 from 172.17.0.3:57890 I0128 20:10:50.244195 3197 http.cpp:277] Processing call CREATE_VOLUMES I0128 20:10:50.245121 3197 master.cpp:3712] Authorizing principal 'test-principal' to perform action CREATE_VOLUME on object {"value":"storage/default-role","resource":{"provider_id":{"value":"4c621bd9-30d9-4fa0-ba51-fb1980a12c66"},"name":"disk","type":"SCALAR","scalar":{"value":2048.0},"reservations":[{"type":"DYNAMIC","role":"storage"},{"type":"DYNAMIC","role":"storage/default-role","principal":"test-principal"}],"disk":{"persistence":{"id":"ba8061cd-f62b-4bbe-8b4b-4f3aafb288d0","principal":"test-principal"},"volume":{"mode":"RW","container_path":"volume"},"source":{"type":"MOUNT","mount":{"root":"./csi/org.apache.mesos.csi.test/local/mounts"},"vendor":"org.apache.mesos.csi.test.local","id":"/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rzWLi3/2GB-6c5a24d0-e943-4be0-8243-68322fb3a29c","profile":"test"}}}} I0128 20:10:50.247067 3186 sched.cpp:960] Rescinded offer e4dbffe1-4304-4562-8ffa-03413ef19b66-O3 I0128 20:10:50.247191 3186 sched.cpp:971] Scheduler::offerRescinded took 52437ns I0128 20:10:50.247690 3192 hierarchical.cpp:1576] Recovered ports(allocated: storage/default-role):[31000-32000]; disk(allocated: storage/default-role)(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rzWLi3/2GB-6c5a24d0-e943-4be0-8243-68322fb3a29c,test)]:2048; cpus(allocated: storage/default-role):2; mem(allocated: storage/default-role):1024; disk(allocated: storage/default-role):1024 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rzWLi3/2GB-6c5a24d0-e943-4be0-8243-68322fb3a29c,test)]:2048, offered or allocated: {}) on agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 from framework e4dbf fe1-4304-4562-8ffa-03413ef19b66-0000 I0128 20:10:50.247849 3185 master.cpp:12273] Removing offer e4dbffe1-4304-4562-8ffa-03413ef19b66-O3 I0128 20:10:50.249441 3192 hierarchical.cpp:1625] Framework e4dbffe1-4304-4562-8ffa-03413ef19b66-0000 filtered agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 for 5secs I0128 20:10:50.252287 3187 master.cpp:12138] Sending operation '' (uuid: bb525bc6-1e8f-49d5-9d92-7c6ac93d0240) to agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 at slave(1249)@172.17.0.3:43601 (8d65c711bd18) I0128 20:10:50.252843 3187 slave.cpp:4428] Ignoring new checkpointed resources and operations identical to the current version I0128 20:10:50.255990 3182 provider.cpp:498] Received APPLY_OPERATION event I0128 20:10:50.256038 3182 provider.cpp:1351] Received CREATE operation '' (uuid: bb525bc6-1e8f-49d5-9d92-7c6ac93d0240) I0128 20:10:50.259626 3194 master.cpp:5958] Processing REVIVE call for framework e4dbffe1-4304-4562-8ffa-03413ef19b66-0000 (default) at [email protected]:43601 I0128 20:10:50.260083 3194 hierarchical.cpp:1721] Unsuppressed offers and cleared filters for roles { storage/default-role } of framework e4dbffe1-4304-4562-8ffa-03413ef19b66-0000 I0128 20:10:50.261405 3194 hierarchical.cpp:1853] Performed allocation for 1 agents in 1.144691ms I0128 20:10:50.261840 3194 hierarchical.cpp:1853] Performed allocation for 1 agents in 193407ns I0128 20:10:50.262406 3188 master.cpp:9974] Sending offers [ e4dbffe1-4304-4562-8ffa-03413ef19b66-O4 ] to framework e4dbffe1-4304-4562-8ffa-03413ef19b66-0000 (default) at [email protected]:43601 I0128 20:10:50.263254 3188 sched.cpp:934] Scheduler::resourceOffers took 117397ns I0128 20:10:50.276468 3186 http.cpp:1405] HTTP POST for /slave(1249)/api/v1/resource_provider from 172.17.0.3:57884 I0128 20:10:50.277528 3196 slave.cpp:8559] Handling resource provider message 'UPDATE_OPERATION_STATUS: (uuid: 00e9e192-f179-4888-968f-fceeddd3d5b0) for framework (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED)' I0128 20:10:50.277777 3196 slave.cpp:9012] Updating the state of operation with no ID (uuid: 00e9e192-f179-4888-968f-fceeddd3d5b0) for an operation API call (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED) I0128 20:10:50.277828 3196 slave.cpp:8766] Forwarding status update of operation with no ID (operation_uuid: 00e9e192-f179-4888-968f-fceeddd3d5b0) for an operator API call I0128 20:10:50.278192 3196 master.cpp:11790] Updating the state of operation '' (uuid: 00e9e192-f179-4888-968f-fceeddd3d5b0) for an operator API call (latest state: OPERATION_PENDING, status update state: OPERATION_FINISHED) I0128 20:10:50.278825 3189 slave.cpp:4428] Ignoring new checkpointed resources and operations identical to the current version I0128 20:10:50.369769 3191 status_update_manager_process.hpp:152] Received operation status update OPERATION_FINISHED (Status UUID: 32b601b9-292c-495a-8b97-f1c33cc796db) for operation UUID bb525bc6-1e8f-49d5-9d92-7c6ac93d0240 on agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 I0128 20:10:50.369884 3191 status_update_manager_process.hpp:414] Creating operation status update stream bb525bc6-1e8f-49d5-9d92-7c6ac93d0240 checkpoint=true I0128 20:10:50.369902 3182 provider.cpp:498] Received ACKNOWLEDGE_OPERATION_STATUS event I0128 20:10:50.370296 3191 status_update_manager_process.hpp:929] Checkpointing UPDATE for operation status update OPERATION_FINISHED (Status UUID: 32b601b9-292c-495a-8b97-f1c33cc796db) for operation UUID bb525bc6-1e8f-49d5-9d92-7c6ac93d0240 on agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 I0128 20:10:50.445610 3191 status_update_manager_process.hpp:528] Forwarding operation status update OPERATION_FINISHED (Status UUID: 32b601b9-292c-495a-8b97-f1c33cc796db) for operation UUID bb525bc6-1e8f-49d5-9d92-7c6ac93d0240 on agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 I0128 20:10:50.446127 3191 status_update_manager_process.hpp:252] Received operation status update acknowledgement (UUID: 303f79fe-377e-4735-8227-9dad4e2f4d4d) for stream 00e9e192-f179-4888-968f-fceeddd3d5b0 I0128 20:10:50.446199 3191 status_update_manager_process.hpp:929] Checkpointing ACK for operation status update OPERATION_FINISHED (Status UUID: 303f79fe-377e-4735-8227-9dad4e2f4d4d) for operation UUID 00e9e192-f179-4888-968f-fceeddd3d5b0 on agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 I0128 20:10:50.447139 3192 http_connection.hpp:131] Sending UPDATE_OPERATION_STATUS call to http://172.17.0.3:43601/slave(1249)/api/v1/resource_provider I0128 20:10:50.448520 3189 process.cpp:3671] Handling HTTP event for process 'slave(1249)' with path: '/slave(1249)/api/v1/resource_provider' I0128 20:10:50.492542 3195 http.cpp:1405] HTTP POST for /slave(1249)/api/v1/resource_provider from 172.17.0.3:57884 I0128 20:10:50.493700 3185 slave.cpp:8559] Handling resource provider message 'UPDATE_OPERATION_STATUS: (uuid: bb525bc6-1e8f-49d5-9d92-7c6ac93d0240) for framework (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED)' I0128 20:10:50.493983 3185 slave.cpp:9012] Updating the state of operation with no ID (uuid: bb525bc6-1e8f-49d5-9d92-7c6ac93d0240) for an operation API call (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED) I0128 20:10:50.494045 3185 slave.cpp:8766] Forwarding status update of operation with no ID (operation_uuid: bb525bc6-1e8f-49d5-9d92-7c6ac93d0240) for an operator API call I0128 20:10:50.494549 3182 master.cpp:11790] Updating the state of operation '' (uuid: bb525bc6-1e8f-49d5-9d92-7c6ac93d0240) for an operator API call (latest state: OPERATION_PENDING, status update state: OPERATION_FINISHED) I0128 20:10:50.495223 3192 slave.cpp:4428] Ignoring new checkpointed resources and operations identical to the current version I0128 20:10:50.496855 3195 provider.cpp:498] Received ACKNOWLEDGE_OPERATION_STATUS event I0128 20:10:50.520732 3191 status_update_manager_process.hpp:490] Cleaning up operation status update stream 00e9e192-f179-4888-968f-fceeddd3d5b0 I0128 20:10:50.521070 3191 status_update_manager_process.hpp:252] Received operation status update acknowledgement (UUID: 32b601b9-292c-495a-8b97-f1c33cc796db) for stream bb525bc6-1e8f-49d5-9d92-7c6ac93d0240 I0128 20:10:50.521175 3191 status_update_manager_process.hpp:929] Checkpointing ACK for operation status update OPERATION_FINISHED (Status UUID: 32b601b9-292c-495a-8b97-f1c33cc796db) for operation UUID bb525bc6-1e8f-49d5-9d92-7c6ac93d0240 on agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 I0128 20:10:50.612555 3191 status_update_manager_process.hpp:490] Cleaning up operation status update stream bb525bc6-1e8f-49d5-9d92-7c6ac93d0240 I0128 20:10:50.667834 3189 process.cpp:3671] Handling HTTP event for process 'master' with path: '/master/api/v1' I0128 20:10:50.669842 3197 http.cpp:1405] HTTP POST for /master/api/v1 from 172.17.0.3:57896 I0128 20:10:50.670285 3197 http.cpp:277] Processing call DESTROY_VOLUMES I0128 20:10:50.671741 3197 master.cpp:3712] Authorizing principal 'test-principal' to perform action DESTROY_VOLUME on object {"value":"test-principal","resource":{"provider_id":{"value":"4c621bd9-30d9-4fa0-ba51-fb1980a12c66"},"name":"disk","type":"SCALAR","scalar":{"value":2048.0},"reservations":[{"type":"DYNAMIC","role":"storage"},{"type":"DYNAMIC","role":"storage/default-role","principal":"test-principal"}],"disk":{"persistence":{"id":"ba8061cd-f62b-4bbe-8b4b-4f3aafb288d0","principal":"test-principal"},"volume":{"mode":"RW","container_path":"volume"},"source":{"type":"MOUNT","mount":{"root":"./csi/org.apache.mesos.csi.test/local/mounts"},"vendor":"org.apache.mesos.csi.test.local","id":"/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rzWLi3/2GB-6c5a24d0-e943-4be0-8243-68322fb3a29c","profile":"test"}}}} I0128 20:10:50.673740 3191 sched.cpp:960] Rescinded offer e4dbffe1-4304-4562-8ffa-03413ef19b66-O4 I0128 20:10:50.673841 3191 sched.cpp:971] Scheduler::offerRescinded took 30953ns I0128 20:10:50.674494 3186 hierarchical.cpp:1576] Recovered ports(allocated: storage/default-role):[31000-32000]; disk(allocated: storage/default-role)(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rzWLi3/2GB-6c5a24d0-e943-4be0-8243-68322fb3a29c,test),ba8061cd-f62b-4bbe-8b4b-4f3aafb288d0:volume]:2048; cpus(allocated: storage/default-role):2; mem(allocated: storage/default-role):1024; disk(allocated: storage/default-role):1024 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rzWLi3/2GB-6c5a24d0-e943-4be0-8243-68322fb3a29c,test),ba8061cd-f62b-4bbe-8b4b-4f3aafb288d0:volume]:2048, offered or allocated: {}) on agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 from framework e4dbffe1-4304-4562-8ffa-03413ef19b66-0000 I0128 20:10:50.674609 3185 master.cpp:12273] Removing offer e4dbffe1-4304-4562-8ffa-03413ef19b66-O4 I0128 20:10:50.676550 3186 hierarchical.cpp:1625] Framework e4dbffe1-4304-4562-8ffa-03413ef19b66-0000 filtered agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 for 5secs I0128 20:10:50.680125 3189 master.cpp:12138] Sending operation '' (uuid: c7cea75c-faa9-4b82-abee-aeb81ed3ad71) to agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 at slave(1249)@172.17.0.3:43601 (8d65c711bd18) I0128 20:10:50.680837 3183 slave.cpp:4428] Ignoring new checkpointed resources and operations identical to the current version I0128 20:10:50.684433 3196 provider.cpp:498] Received APPLY_OPERATION event I0128 20:10:50.684486 3196 provider.cpp:1351] Received DESTROY operation '' (uuid: c7cea75c-faa9-4b82-abee-aeb81ed3ad71) I0128 20:10:50.688657 3192 hierarchical.cpp:1853] Performed allocation for 1 agents in 1.918964ms I0128 20:10:50.689698 3189 master.cpp:9974] Sending offers [ e4dbffe1-4304-4562-8ffa-03413ef19b66-O5 ] to framework e4dbffe1-4304-4562-8ffa-03413ef19b66-0000 (default) at [email protected]:43601 I0128 20:10:50.690686 3189 sched.cpp:934] Scheduler::resourceOffers took 114860ns I0128 20:10:50.793488 3190 status_update_manager_process.hpp:152] Received operation status update OPERATION_FINISHED (Status UUID: 4980bb33-8102-4fe4-a3cc-5191a7263344) for operation UUID c7cea75c-faa9-4b82-abee-aeb81ed3ad71 on agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 I0128 20:10:50.793601 3190 status_update_manager_process.hpp:414] Creating operation status update stream c7cea75c-faa9-4b82-abee-aeb81ed3ad71 checkpoint=true I0128 20:10:50.793967 3190 status_update_manager_process.hpp:929] Checkpointing UPDATE for operation status update OPERATION_FINISHED (Status UUID: 4980bb33-8102-4fe4-a3cc-5191a7263344) for operation UUID c7cea75c-faa9-4b82-abee-aeb81ed3ad71 on agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 I0128 20:10:50.872238 3190 status_update_manager_process.hpp:528] Forwarding operation status update OPERATION_FINISHED (Status UUID: 4980bb33-8102-4fe4-a3cc-5191a7263344) for operation UUID c7cea75c-faa9-4b82-abee-aeb81ed3ad71 on agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 I0128 20:10:50.873397 3188 http_connection.hpp:131] Sending UPDATE_OPERATION_STATUS call to http://172.17.0.3:43601/slave(1249)/api/v1/resource_provider I0128 20:10:50.874752 3187 process.cpp:3671] Handling HTTP event for process 'slave(1249)' with path: '/slave(1249)/api/v1/resource_provider' I0128 20:10:50.878886 3197 process.cpp:3671] Handling HTTP event for process 'master' with path: '/master/api/v1' I0128 20:10:50.881399 3196 http.cpp:1405] HTTP POST for /master/api/v1 from 172.17.0.3:57898 I0128 20:10:50.881800 3196 http.cpp:277] Processing call UNRESERVE_RESOURCES I0128 20:10:50.883016 3196 master.cpp:3712] Authorizing principal 'test-principal' to perform action UNRESERVE_RESOURCES on object {"value":"test-principal","resource":{"provider_id":{"value":"4c621bd9-30d9-4fa0-ba51-fb1980a12c66"},"name":"disk","type":"SCALAR","scalar":{"value":2048.0},"reservations":[{"type":"DYNAMIC","role":"storage"},{"type":"DYNAMIC","role":"storage/default-role","principal":"test-principal"}],"disk":{"source":{"type":"MOUNT","mount":{"root":"./csi/org.apache.mesos.csi.test/local/mounts"},"vendor":"org.apache.mesos.csi.test.local","id":"/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rzWLi3/2GB-6c5a24d0-e943-4be0-8243-68322fb3a29c","profile":"test"}}}} I0128 20:10:50.885172 3191 sched.cpp:960] Rescinded offer e4dbffe1-4304-4562-8ffa-03413ef19b66-O5 I0128 20:10:50.885288 3191 sched.cpp:971] Scheduler::offerRescinded took 31182ns I0128 20:10:50.885607 3187 hierarchical.cpp:1576] Recovered ports(allocated: storage/default-role):[31000-32000]; disk(allocated: storage/default-role)(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rzWLi3/2GB-6c5a24d0-e943-4be0-8243-68322fb3a29c,test)]:2048; cpus(allocated: storage/default-role):2; mem(allocated: storage/default-role):1024; disk(allocated: storage/default-role):1024 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rzWLi3/2GB-6c5a24d0-e943-4be0-8243-68322fb3a29c,test)]:2048, offered or allocated: {}) on agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 from framework e4dbf fe1-4304-4562-8ffa-03413ef19b66-0000 I0128 20:10:50.885792 3184 master.cpp:12273] Removing offer e4dbffe1-4304-4562-8ffa-03413ef19b66-O5 I0128 20:10:50.887531 3187 hierarchical.cpp:1625] Framework e4dbffe1-4304-4562-8ffa-03413ef19b66-0000 filtered agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 for 5secs I0128 20:10:50.890606 3186 master.cpp:12138] Sending operation '' (uuid: 18d2cb68-4a7e-4e76-81b5-baa120674f8d) to agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 at slave(1249)@172.17.0.3:43601 (8d65c711bd18) I0128 20:10:50.891264 3189 slave.cpp:4428] Ignoring new checkpointed resources and operations identical to the current version I0128 20:10:50.894619 3195 provider.cpp:498] Received APPLY_OPERATION event I0128 20:10:50.894670 3195 provider.cpp:1351] Received UNRESERVE operation '' (uuid: 18d2cb68-4a7e-4e76-81b5-baa120674f8d) I0128 20:10:50.899395 3197 hierarchical.cpp:1853] Performed allocation for 1 agents in 1.551057ms I0128 20:10:50.900140 3192 master.cpp:9974] Sending offers [ e4dbffe1-4304-4562-8ffa-03413ef19b66-O6 ] to framework e4dbffe1-4304-4562-8ffa-03413ef19b66-0000 (default) at [email protected]:43601 I0128 20:10:50.900846 3193 sched.cpp:934] Scheduler::resourceOffers took 92144ns I0128 20:10:50.916611 3183 http.cpp:1405] HTTP POST for /slave(1249)/api/v1/resource_provider from 172.17.0.3:57884 I0128 20:10:50.918020 3184 slave.cpp:8559] Handling resource provider message 'UPDATE_OPERATION_STATUS: (uuid: c7cea75c-faa9-4b82-abee-aeb81ed3ad71) for framework (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED)' I0128 20:10:50.918251 3184 slave.cpp:9012] Updating the state of operation with no ID (uuid: c7cea75c-faa9-4b82-abee-aeb81ed3ad71) for an operation API call (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED) I0128 20:10:50.918305 3184 slave.cpp:8766] Forwarding status update of operation with no ID (operation_uuid: c7cea75c-faa9-4b82-abee-aeb81ed3ad71) for an operator API call I0128 20:10:50.918789 3185 master.cpp:11790] Updating the state of operation '' (uuid: c7cea75c-faa9-4b82-abee-aeb81ed3ad71) for an operator API call (latest state: OPERATION_PENDING, status update state: OPERATION_FINISHED) I0128 20:10:50.919435 3182 slave.cpp:4428] Ignoring new checkpointed resources and operations identical to the current version I0128 20:10:50.998044 3184 status_update_manager_process.hpp:152] Received operation status update OPERATION_FINISHED (Status UUID: c836c786-a563-4b14-b04d-b59ba1d46363) for operation UUID 18d2cb68-4a7e-4e76-81b5-baa120674f8d on agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 I0128 20:10:50.998152 3184 status_update_manager_process.hpp:414] Creating operation status update stream 18d2cb68-4a7e-4e76-81b5-baa120674f8d checkpoint=true I0128 20:10:50.998247 3195 provider.cpp:498] Received ACKNOWLEDGE_OPERATION_STATUS event I0128 20:10:50.998565 3184 status_update_manager_process.hpp:929] Checkpointing UPDATE for operation status update OPERATION_FINISHED (Status UUID: c836c786-a563-4b14-b04d-b59ba1d46363) for operation UUID 18d2cb68-4a7e-4e76-81b5-baa120674f8d on agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 I0128 20:10:51.060490 3184 status_update_manager_process.hpp:528] Forwarding operation status update OPERATION_FINISHED (Status UUID: c836c786-a563-4b14-b04d-b59ba1d46363) for operation UUID 18d2cb68-4a7e-4e76-81b5-baa120674f8d on agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 I0128 20:10:51.061103 3184 status_update_manager_process.hpp:252] Received operation status update acknowledgement (UUID: 4980bb33-8102-4fe4-a3cc-5191a7263344) for stream c7cea75c-faa9-4b82-abee-aeb81ed3ad71 I0128 20:10:51.061200 3184 status_update_manager_process.hpp:929] Checkpointing ACK for operation status update OPERATION_FINISHED (Status UUID: 4980bb33-8102-4fe4-a3cc-5191a7263344) for operation UUID c7cea75c-faa9-4b82-abee-aeb81ed3ad71 on agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 I0128 20:10:51.061764 3185 http_connection.hpp:131] Sending UPDATE_OPERATION_STATUS call to http://172.17.0.3:43601/slave(1249)/api/v1/resource_provider I0128 20:10:51.063133 3182 process.cpp:3671] Handling HTTP event for process 'slave(1249)' with path: '/slave(1249)/api/v1/resource_provider' I0128 20:10:51.104715 3194 http.cpp:1405] HTTP POST for /slave(1249)/api/v1/resource_provider from 172.17.0.3:57884 I0128 20:10:51.105985 3183 slave.cpp:8559] Handling resource provider message 'UPDATE_OPERATION_STATUS: (uuid: 18d2cb68-4a7e-4e76-81b5-baa120674f8d) for framework (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED)' I0128 20:10:51.106266 3183 slave.cpp:9012] Updating the state of operation with no ID (uuid: 18d2cb68-4a7e-4e76-81b5-baa120674f8d) for an operation API call (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED) I0128 20:10:51.106331 3183 slave.cpp:8766] Forwarding status update of operation with no ID (operation_uuid: 18d2cb68-4a7e-4e76-81b5-baa120674f8d) for an operator API call I0128 20:10:51.106781 3195 master.cpp:11790] Updating the state of operation '' (uuid: 18d2cb68-4a7e-4e76-81b5-baa120674f8d) for an operator API call (latest state: OPERATION_PENDING, status update state: OPERATION_FINISHED) I0128 20:10:51.107530 3185 slave.cpp:4428] Ignoring new checkpointed resources and operations identical to the current version I0128 20:10:51.109300 3190 provider.cpp:498] Received ACKNOWLEDGE_OPERATION_STATUS event I0128 20:10:51.115350 3184 status_update_manager_process.hpp:490] Cleaning up operation status update stream c7cea75c-faa9-4b82-abee-aeb81ed3ad71 I0128 20:10:51.115685 3184 status_update_manager_process.hpp:252] Received operation status update acknowledgement (UUID: c836c786-a563-4b14-b04d-b59ba1d46363) for stream 18d2cb68-4a7e-4e76-81b5-baa120674f8d I0128 20:10:51.115808 3184 status_update_manager_process.hpp:929] Checkpointing ACK for operation status update OPERATION_FINISHED (Status UUID: c836c786-a563-4b14-b04d-b59ba1d46363) for operation UUID 18d2cb68-4a7e-4e76-81b5-baa120674f8d on agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 I0128 20:10:51.211519 3184 status_update_manager_process.hpp:490] Cleaning up operation status update stream 18d2cb68-4a7e-4e76-81b5-baa120674f8d I0128 20:10:51.271775 3185 master.cpp:1414] Framework e4dbffe1-4304-4562-8ffa-03413ef19b66-0000 (default) at [email protected]:43601 disconnected I0128 20:10:51.271833 3185 master.cpp:3333] Deactivating framework e4dbffe1-4304-4562-8ffa-03413ef19b66-0000 (default) at [email protected]:43601 I0128 20:10:51.272310 3182 hierarchical.cpp:813] Deactivated framework e4dbffe1-4304-4562-8ffa-03413ef19b66-0000 I0128 20:10:51.272811 3182 hierarchical.cpp:1576] Recovered ports(allocated: storage/default-role):[31000-32000]; disk(allocated: storage/default-role)(reservations: [(DYNAMIC,storage)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rzWLi3/2GB-6c5a24d0-e943-4be0-8243-68322fb3a29c,test)]:2048; cpus(allocated: storage/default-role):2; mem(allocated: storage/default-role):1024; disk(allocated: storage/default-role):1024 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk(reservations: [(DYNAMIC,storage)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rzWLi3/2GB-6c5a24d0-e943-4be0-8243-68322fb3a29c,test)]:2048, offered or allocated: {}) on agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 from framework e4dbffe1-4304-4562-8ffa-03413ef19b66-0000 I0128 20:10:51.272984 3183 slave.cpp:989] Agent terminating I0128 20:10:51.273025 3185 master.cpp:12273] Removing offer e4dbffe1-4304-4562-8ffa-03413ef19b66-O6 I0128 20:10:51.273121 3185 master.cpp:3310] Disconnecting framework e4dbffe1-4304-4562-8ffa-03413ef19b66-0000 (default) at [email protected]:43601 I0128 20:10:51.273192 3185 master.cpp:1429] Giving framework e4dbffe1-4304-4562-8ffa-03413ef19b66-0000 (default) at [email protected]:43601 0ns to failover I0128 20:10:51.273864 3183 manager.cpp:127] Terminating resource provider 4c621bd9-30d9-4fa0-ba51-fb1980a12c66 I0128 20:10:51.274302 3190 master.cpp:1299] Agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 at slave(1249)@172.17.0.3:43601 (8d65c711bd18) disconnected I0128 20:10:51.274338 3190 master.cpp:3368] Disconnecting agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 at slave(1249)@172.17.0.3:43601 (8d65c711bd18) I0128 20:10:51.274447 3190 master.cpp:3387] Deactivating agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 at slave(1249)@172.17.0.3:43601 (8d65c711bd18) I0128 20:10:51.274590 3184 hierarchical.cpp:1156] Agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 deactivated I0128 20:10:51.274686 3190 master.cpp:9760] Framework failover timeout, removing framework e4dbffe1-4304-4562-8ffa-03413ef19b66-0000 (default) at [email protected]:43601 I0128 20:10:51.274729 3190 master.cpp:10762] Removing framework e4dbffe1-4304-4562-8ffa-03413ef19b66-0000 (default) at [email protected]:43601 E0128 20:10:51.275080 3185 http_connection.hpp:449] End-Of-File received I0128 20:10:51.275195 3189 hierarchical.cpp:1777] Allocation paused I0128 20:10:51.275557 3185 http_connection.hpp:217] Re-detecting endpoint I0128 20:10:51.275691 3189 hierarchical.cpp:757] Removed framework e4dbffe1-4304-4562-8ffa-03413ef19b66-0000 I0128 20:10:51.275754 3189 hierarchical.cpp:1787] Allocation resumed I0128 20:10:51.276026 3185 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0128 20:10:51.276085 3185 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0128 20:10:51.276120 3184 provider.cpp:488] Disconnected from resource provider manager I0128 20:10:51.276180 3185 http_connection.hpp:227] New endpoint detected at http://172.17.0.3:43601/slave(1249)/api/v1/resource_provider I0128 20:10:51.276258 3184 status_update_manager_process.hpp:379] Pausing operation status update manager I0128 20:10:51.277539 3189 containerizer.cpp:2619] Destroying container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE in RUNNING state I0128 20:10:51.277585 3189 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from RUNNING to DESTROYING after 2.736537984secs I0128 20:10:51.277962 3189 launcher.cpp:161] Asked to destroy container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0128 20:10:51.279080 3193 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.3:43601/slave(1249)/api/v1/resource_provider I0128 20:10:51.279801 3188 provider.cpp:476] Connected to resource provider manager I0128 20:10:51.279991 3190 hierarchical.cpp:1853] Performed allocation for 1 agents in 218367ns I0128 20:10:51.280488 3183 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.3:43601/slave(1249)/api/v1/resource_provider I0128 20:10:51.281400 3198 process.cpp:2781] Returning '404 Not Found' for '/slave(1249)/api/v1/resource_provider' E0128 20:10:51.282824 3187 provider.cpp:721] Failed to subscribe resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test': Received '404 Not Found' () I0128 20:10:51.332043 3184 hierarchical.cpp:1853] Performed allocation for 1 agents in 234459ns I0128 20:10:51.382313 3197 containerizer.cpp:3155] Container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE has exited I0128 20:10:51.383514 3188 hierarchical.cpp:1853] Performed allocation for 1 agents in 179757ns I0128 20:10:51.384099 3191 provisioner.cpp:652] Ignoring destroy request for unknown container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0128 20:10:51.387104 3187 container_daemon.cpp:189] Invoking post-stop hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0128 20:10:51.387322 3182 service_manager.cpp:723] Disconnected from endpoint 'unix:///tmp/mesos-csi-AkR92A/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0128 20:10:51.387554 3197 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0128 20:10:51.390508 3198 process.cpp:2781] Returning '404 Not Found' for '/slave(1249)/api/v1' I0128 20:10:51.403138 3181 master.cpp:1140] Master terminating I0128 20:10:51.404172 3194 hierarchical.cpp:1132] Removed all filters for agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 I0128 20:10:51.404204 3194 hierarchical.cpp:1008] Removed agent e4dbffe1-4304-4562-8ffa-03413ef19b66-S0 [ OK ] CSIVersion/StorageLocalResourceProviderTest.OperatorOperationsWithResourceProviderResources/v1 (2627 ms) [ RUN ] CSIVersion/StorageLocalResourceProviderTest.Update/v0 I0128 20:10:51.425937 3181 cluster.cpp:180] Creating default 'local' authorizer I0128 20:10:51.430944 3187 master.cpp:443] Master 3e9613ab-4ce8-4f7f-aa4f-138c9c42984f (8d65c711bd18) started on 172.17.0.3:43601 I0128 20:10:51.430997 3187 master.cpp:446] Flags at startup: --acls="" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins" --allocation_interval="50ms" --allocator="hierarchical" --authenticate_agents="true" --authenticate_frameworks="true" --authenticate_http_frameworks="true" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authentication_v0_timeout="15secs" --authenticators="crammd5" --authorizers="local" --credentials="/tmp/aiUrCB/credentials" --filter_gpu_resources="true" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_framework_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_operator_event_stream_subscribers="1000" --max_unreachable_tasks_per_framework="1000" --memory_profiling="false" --min_alloca table_resources="cpus:0.01|mem:32" --port="5050" --publish_per_framework_metrics="true" --quiet="false" --recovery_agent_removal_limit="100%" --registry="in_memory" --registry_fetch_timeout="1mins" --registry_gc_interval="15mins" --registry_max_agent_age="2weeks" --registry_max_agent_count="102400" --registry_store_timeout="100secs" --registry_strict="false" --require_agent_domain="false" --role_sorter="drf" --root_submissions="true" --version="false" --webui_dir="/tmp/SRC/build/mesos-1.10.0/_inst/share/mesos/webui" --work_dir="/tmp/aiUrCB/master" --zk_session_timeout="10secs" I0128 20:10:51.431628 3187 master.cpp:495] Master only allowing authenticated frameworks to register I0128 20:10:51.431656 3187 master.cpp:501] Master only allowing authenticated agents to register I0128 20:10:51.431680 3187 master.cpp:507] Master only allowing authenticated HTTP frameworks to register I0128 20:10:51.431705 3187 credentials.hpp:37] Loading credentials for authentication from '/tmp/aiUrCB/credentials' I0128 20:10:51.432137 3187 master.cpp:551] Using default 'crammd5' authenticator I0128 20:10:51.432505 3187 http.cpp:1265] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readonly' I0128 20:10:51.432899 3187 http.cpp:1265] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readwrite' I0128 20:10:51.433177 3187 http.cpp:1265] Creating default 'basic' HTTP authenticator for realm 'mesos-master-scheduler' I0128 20:10:51.433465 3187 master.cpp:632] Authorization enabled I0128 20:10:51.433993 3193 hierarchical.cpp:567] Initialized hierarchical allocator process I0128 20:10:51.434069 3182 whitelist_watcher.cpp:77] No whitelist given I0128 20:10:51.437959 3185 master.cpp:2172] Elected as the leading master! I0128 20:10:51.438001 3185 master.cpp:1668] Recovering from registrar I0128 20:10:51.438223 3189 registrar.cpp:339] Recovering registrar I0128 20:10:51.439198 3189 registrar.cpp:383] Successfully fetched the registry (0B) in 0ns I0128 20:10:51.439364 3189 registrar.cpp:487] Applied 1 operations in 54432ns; attempting to update the registry I0128 20:10:51.440217 3189 registrar.cpp:544] Successfully updated the registry in 0ns I0128 20:10:51.440383 3189 registrar.cpp:416] Successfully recovered registrar I0128 20:10:51.440943 3193 master.cpp:1821] Recovered 0 agents from the registry (144B); allowing 10mins for agents to reregister I0128 20:10:51.441018 3197 hierarchical.cpp:606] Skipping recovery of hierarchical allocator: nothing to recover W0128 20:10:51.446959 3181 process.cpp:2877] Attempted to spawn already running process [email protected]:43601 I0128 20:10:51.448443 3181 containerizer.cpp:317] Using isolation { environment_secret, posix/cpu, posix/mem, filesystem/posix, network/cni } W0128 20:10:51.449021 3181 backend.cpp:76] Failed to create 'overlay' backend: OverlayBackend requires root privileges W0128 20:10:51.449049 3181 backend.cpp:76] Failed to create 'aufs' backend: AufsBackend requires root privileges W0128 20:10:51.449065 3181 backend.cpp:76] Failed to create 'bind' backend: BindBackend requires root privileges I0128 20:10:51.449096 3181 provisioner.cpp:294] Using default backend 'copy' I0128 20:10:51.451843 3181 cluster.cpp:527] Creating default 'local' authorizer I0128 20:10:51.454375 3195 slave.cpp:270] Mesos agent started on (1250)@172.17.0.3:43601 I0128 20:10:51.454438 3195 slave.cpp:271] Flags at startup: --acls="" --appc_simple_discovery_uri_prefix="http://" --appc_store_dir="/tmp/aiUrCB/mhYj3l/store/appc" --authenticate_http_readonly="true" --authenticate_http_readwrite="false" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authentication_timeout_max="1mins" --authentication_timeout_min="5secs" --authorizer="local" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_destroy_timeout="1mins" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="mesos" --credential="/tmp/aiUrCB/mhYj3l/credential" --default_role="*" --disallow_sharing_agent_ipc_namespace="false" --disallow_sharing_agent_pid_namespace="false" --disk_profile_adaptor="org_apache_mesos_UriDiskProfileAdaptor" --disk_watch_interval="1mins" --docker="docker" --docker_ignore_runtime="false" --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io" --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/aiUrCB/mhYj3l/store/docker" --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume" --docker_volume_chown="false" --enforce_container_disk_quota="false" --executor_registration_timeout="1mins" --executor_reregistration_timeout="2secs" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/aiUrCB/mhYj3l/fetch" --fetcher_cache_size="2GB" --fetcher_stall_timeout="1mins" --frameworks_home="/tmp/aiUrCB/mhYj3l/frameworks" --gc_delay="1weeks" --gc_disk_headroom="0.1" --gc_non_executor_container_sandboxes="false" --help="false" --hostname_lookup="true" --http_command_executor="false" --http_credentials="/tmp/aiUrCB/mhYj3l/http_credentials" --http_executor_domain_sockets="false" --http_heartbeat_interval="30secs" --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem" --launcher="posi x" --launcher_dir="/tmp/SRC/build/mesos-1.10.0/_build/sub/src" --logbufsecs="0" --logging_level="INFO" --max_completed_executors_per_framework="150" --memory_profiling="false" --network_cni_metrics="true" --network_cni_root_dir_persist="false" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns" --quiet="false" --reconfiguration_policy="equal" --recover="reconnect" --recovery_timeout="15mins" --registration_backoff_factor="10ms" --resource_provider_config_dir="/tmp/aiUrCB/resource_provider_configs" --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]" --revocable_cpu_low_priority="true" --runtime_dir="/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_t81Fqa" --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true" --systemd_enable_support="true" --systemd_runtime_directory="/run/systemd/system" --version="false" --work_dir="/tmp/CSIVersion_StorageLoca lResourceProviderTest_Update_v0_IJF2NY" --zk_session_timeout="10secs" I0128 20:10:51.455087 3195 credentials.hpp:86] Loading credential for authentication from '/tmp/aiUrCB/mhYj3l/credential' I0128 20:10:51.455281 3195 slave.cpp:303] Agent using credential for: test-principal I0128 20:10:51.455312 3195 credentials.hpp:37] Loading credentials for authentication from '/tmp/aiUrCB/mhYj3l/http_credentials' I0128 20:10:51.455554 3195 http.cpp:1265] Creating default 'basic' HTTP authenticator for realm 'mesos-agent-readonly' I0128 20:10:51.455994 3195 disk_profile_adaptor.cpp:82] Creating disk profile adaptor module 'org_apache_mesos_UriDiskProfileAdaptor' I0128 20:10:51.457533 3188 uri_disk_profile_adaptor.cpp:305] Updated disk profile mapping to 1 active profiles I0128 20:10:51.457865 3195 slave.cpp:618] Agent resources: [{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}] I0128 20:10:51.458160 3195 slave.cpp:626] Agent attributes: [ ] I0128 20:10:51.458179 3195 slave.cpp:635] Agent hostname: 8d65c711bd18 I0128 20:10:51.458336 3187 status_update_manager_process.hpp:379] Pausing operation status update manager I0128 20:10:51.458350 3194 task_status_update_manager.cpp:181] Pausing sending task status updates I0128 20:10:51.460212 3196 state.cpp:68] Recovering state from '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_IJF2NY/meta' I0128 20:10:51.460528 3183 slave.cpp:7568] Finished recovering checkpointed state from '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_IJF2NY/meta', beginning agent recovery I0128 20:10:51.461094 3189 task_status_update_manager.cpp:207] Recovering task status update manager I0128 20:10:51.461673 3197 containerizer.cpp:820] Recovering Mesos containers I0128 20:10:51.462054 3197 containerizer.cpp:1160] Recovering isolators I0128 20:10:51.462958 3183 containerizer.cpp:1199] Recovering provisioner I0128 20:10:51.462957 3195 hierarchical.cpp:1853] Performed allocation for 0 agents in 123685ns I0128 20:10:51.463778 3192 provisioner.cpp:518] Provisioner recovery complete I0128 20:10:51.464695 3193 composing.cpp:339] Finished recovering all containerizers I0128 20:10:51.465088 3197 slave.cpp:8050] Recovering executors I0128 20:10:51.465201 3197 slave.cpp:8203] Finished recovery I0128 20:10:51.466003 3195 task_status_update_manager.cpp:181] Pausing sending task status updates I0128 20:10:51.466023 3182 slave.cpp:1416] New master detected at [email protected]:43601 I0128 20:10:51.466032 3194 status_update_manager_process.hpp:379] Pausing operation status update manager I0128 20:10:51.466147 3182 slave.cpp:1481] Detecting new master I0128 20:10:51.469524 3190 slave.cpp:1508] Authenticating with master [email protected]:43601 I0128 20:10:51.469630 3190 slave.cpp:1517] Using default CRAM-MD5 authenticatee I0128 20:10:51.470010 3191 authenticatee.cpp:121] Creating new client SASL connection I0128 20:10:51.470402 3184 master.cpp:10159] Authenticating slave(1250)@172.17.0.3:43601 I0128 20:10:51.470568 3185 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(2107)@172.17.0.3:43601 I0128 20:10:51.470882 3196 authenticator.cpp:98] Creating new server SASL connection I0128 20:10:51.471140 3193 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 I0128 20:10:51.471176 3193 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' I0128 20:10:51.471339 3187 authenticator.cpp:204] Received SASL authentication start I0128 20:10:51.471427 3187 authenticator.cpp:326] Authentication requires more steps I0128 20:10:51.471575 3197 authenticatee.cpp:259] Received SASL authentication step I0128 20:10:51.471735 3189 authenticator.cpp:232] Received SASL authentication step I0128 20:10:51.471778 3189 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '8d65c711bd18' server FQDN: '8d65c711bd18' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false I0128 20:10:51.471794 3189 auxprop.cpp:181] Looking up auxiliary property '*userPassword' I0128 20:10:51.471846 3189 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' I0128 20:10:51.471895 3189 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '8d65c711bd18' server FQDN: '8d65c711bd18' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true I0128 20:10:51.471916 3189 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true I0128 20:10:51.471927 3189 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true I0128 20:10:51.471949 3189 authenticator.cpp:318] Authentication success I0128 20:10:51.472050 3188 authenticatee.cpp:299] Authentication success I0128 20:10:51.472234 3183 master.cpp:10191] Successfully authenticated principal 'test-principal' at slave(1250)@172.17.0.3:43601 I0128 20:10:51.472278 3195 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(2107)@172.17.0.3:43601 I0128 20:10:51.472443 3194 slave.cpp:1608] Successfully authenticated with master [email protected]:43601 I0128 20:10:51.472887 3194 slave.cpp:2058] Will retry registration in 16.974202ms if necessary I0128 20:10:51.473078 3184 master.cpp:6629] Received register agent message from slave(1250)@172.17.0.3:43601 (8d65c711bd18) I0128 20:10:51.473549 3184 master.cpp:3712] Authorizing principal 'test-principal' to perform action REGISTER_AGENT on ANY object I0128 20:10:51.474267 3187 master.cpp:6696] Authorized registration of agent at slave(1250)@172.17.0.3:43601 (8d65c711bd18) I0128 20:10:51.474373 3187 master.cpp:6808] Registering agent at slave(1250)@172.17.0.3:43601 (8d65c711bd18) with id 3e9613ab-4ce8-4f7f-aa4f-138c9c42984f-S0 I0128 20:10:51.475152 3189 registrar.cpp:487] Applied 1 operations in 256190ns; attempting to update the registry I0128 20:10:51.475850 3189 registrar.cpp:544] Successfully updated the registry in 625920ns I0128 20:10:51.476186 3186 master.cpp:6856] Admitted agent 3e9613ab-4ce8-4f7f-aa4f-138c9c42984f-S0 at slave(1250)@172.17.0.3:43601 (8d65c711bd18) I0128 20:10:51.477035 3186 master.cpp:6901] Registered agent 3e9613ab-4ce8-4f7f-aa4f-138c9c42984f-S0 at slave(1250)@172.17.0.3:43601 (8d65c711bd18) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0128 20:10:51.477205 3195 slave.cpp:1641] Registered with master [email protected]:43601; given agent ID 3e9613ab-4ce8-4f7f-aa4f-138c9c42984f-S0 I0128 20:10:51.477222 3190 hierarchical.cpp:959] Added agent 3e9613ab-4ce8-4f7f-aa4f-138c9c42984f-S0 (8d65c711bd18) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] (offered or allocated: {}) I0128 20:10:51.477346 3196 task_status_update_manager.cpp:188] Resuming sending task status updates I0128 20:10:51.477608 3190 hierarchical.cpp:1853] Performed allocation for 1 agents in 152605ns I0128 20:10:51.477746 3195 slave.cpp:1676] Checkpointing SlaveInfo to '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_IJF2NY/meta/slaves/3e9613ab-4ce8-4f7f-aa4f-138c9c42984f-S0/slave.info' I0128 20:10:51.477869 3184 status_update_manager_process.hpp:385] Resuming operation status update manager I0128 20:10:51.479080 3195 slave.cpp:1728] Forwarding agent update {"operations":{},"resource_providers":{},"resource_version_uuid":{"value":"77O3pjVNSo2UKLbzhw+qow=="},"slave_id":{"value":"3e9613ab-4ce8-4f7f-aa4f-138c9c42984f-S0"},"update_oversubscribed_resources":false} I0128 20:10:51.479879 3192 master.cpp:8039] Ignoring update on agent 3e9613ab-4ce8-4f7f-aa4f-138c9c42984f-S0 at slave(1250)@172.17.0.3:43601 (8d65c711bd18) as it reports no changes I0128 20:10:51.483544 3190 process.cpp:3671] Handling HTTP event for process 'slave(1250)' with path: '/slave(1250)/api/v1' I0128 20:10:51.484942 3189 http.cpp:1405] HTTP POST for /slave(1250)/api/v1 from 172.17.0.3:57910 I0128 20:10:51.485491 3189 http.cpp:2146] Processing GET_CONTAINERS call I0128 20:10:51.491595 3189 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0128 20:10:51.494115 3191 process.cpp:3671] Handling HTTP event for process 'slave(1250)' with path: '/slave(1250)/api/v1' I0128 20:10:51.495260 3184 http.cpp:1405] HTTP POST for /slave(1250)/api/v1 from 172.17.0.3:57912 I0128 20:10:51.495972 3184 http.cpp:2606] Processing LAUNCH_CONTAINER call for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0128 20:10:51.497017 3195 http.cpp:2710] Creating sandbox '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_IJF2NY/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0128 20:10:51.514323 3192 hierarchical.cpp:1853] Performed allocation for 1 agents in 178201ns I0128 20:10:51.530488 3196 containerizer.cpp:1395] Starting container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0128 20:10:51.531236 3196 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from STARTING to PROVISIONING after 342016ns I0128 20:10:51.531985 3196 containerizer.cpp:1573] Checkpointed ContainerConfig at '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_t81Fqa/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE/config' I0128 20:10:51.532044 3196 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from PROVISIONING to PREPARING after 803840ns I0128 20:10:51.535174 3197 containerizer.cpp:2099] Launching 'mesos-containerizer' with flags '--help="false" --launch_info="{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v0","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_xhvqbN","--available_capacity=0B","--volumes=","--forward=unix:///tmp/aiUrCB/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"environment":{"variables":[{"name":"MESOS_SANDBOX","type":"VALUE","value":"/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_IJF2NY/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE"},{"name":"CSI_ENDPOINT","type":"VALUE","value":"unix:///tmp/mesos-csi-dLP7V6/endpoint.sock"}]},"task_environment":{},"working_directory":"/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_IJF2NY/containers/o rg-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE"}" --pipe_read="105" --pipe_write="106" --runtime_directory="/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_t81Fqa/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE" --unshare_namespace_mnt="false"' I0128 20:10:51.544044 3197 launcher.cpp:145] Forked child with pid '14704' for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0128 20:10:51.554879 3197 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from PREPARING to ISOLATING after 22.821376ms I0128 20:10:51.556048 3197 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from ISOLATING to FETCHING after 1.174784ms I0128 20:10:51.556288 3187 fetcher.cpp:369] Starting to fetch URIs for container: org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE, directory: /tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_IJF2NY/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0128 20:10:51.557335 3193 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from FETCHING to RUNNING after 1.270016ms I0128 20:10:51.559422 3194 container_daemon.cpp:140] Invoking post-start hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0128 20:10:51.559581 3194 service_manager.cpp:703] Connecting to endpoint 'unix:///tmp/mesos-csi-dLP7V6/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0128 20:10:51.566191 3186 hierarchical.cpp:1853] Performed allocation for 1 agents in 184450ns I0128 20:10:51.617822 3184 hierarchical.cpp:1853] Performed allocation for 1 agents in 190153ns I0128 20:10:51.669580 3189 hierarchical.cpp:1853] Performed allocation for 1 agents in 185822ns I0128 20:10:51.720391 3191 hierarchical.cpp:1853] Performed allocation for 1 agents in 162469ns I0128 20:10:51.771642 3196 hierarchical.cpp:1853] Performed allocation for 1 agents in 173648ns I0128 20:10:51.823247 3182 hierarchical.cpp:1853] Performed allocation for 1 agents in 210307ns I0128 20:10:51.871305 3188 service_manager.cpp:545] Probing endpoint 'unix:///tmp/mesos-csi-dLP7V6/endpoint.sock' with CSI v1 I0128 20:10:51.874003 3189 service_manager.cpp:532] Probing endpoint 'unix:///tmp/mesos-csi-dLP7V6/endpoint.sock' with CSI v0 I0128 20:10:51.874655 3194 hierarchical.cpp:1853] Performed allocation for 1 agents in 272540ns I0128 20:10:51.875428 14708 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Identity/Probe call I0128 20:10:51.878185 3182 container_daemon.cpp:171] Waiting for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0128 20:10:51.881079 14708 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Identity/GetPluginCapabilities call I0128 20:10:51.881793 3195 process.cpp:3671] Handling HTTP event for process 'slave(1250)' with path: '/slave(1250)/api/v1' I0128 20:10:51.883102 3187 http.cpp:1405] HTTP POST for /slave(1250)/api/v1 from 172.17.0.3:57914 I0128 20:10:51.883606 3187 http.cpp:2824] Processing WAIT_CONTAINER call for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0128 20:10:51.884785 14708 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Identity/GetPluginInfo call I0128 20:10:51.885090 14708 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Identity/GetPluginInfo call I0128 20:10:51.886795 3196 v0_volume_manager.cpp:628] NODE_SERVICE loaded: {} I0128 20:10:51.887295 3196 v0_volume_manager.cpp:628] CONTROLLER_SERVICE loaded: {} I0128 20:10:51.889359 14708 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/ControllerGetCapabilities call I0128 20:10:51.893095 14708 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Node/NodeGetCapabilities call I0128 20:10:51.896811 14708 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Node/NodeGetId call I0128 20:10:51.899209 3185 provider.cpp:676] Recovered resources '{}' and 0 operations for resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test' I0128 20:10:51.899425 3182 status_update_manager_process.hpp:379] Pausing operation status update manager I0128 20:10:51.899762 3187 http_connection.hpp:227] New endpoint detected at http://172.17.0.3:43601/slave(1250)/api/v1/resource_provider I0128 20:10:51.902927 3186 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.3:43601/slave(1250)/api/v1/resource_provider I0128 20:10:51.903683 3193 provider.cpp:476] Connected to resource provider manager I0128 20:10:51.904384 3184 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.3:43601/slave(1250)/api/v1/resource_provider I0128 20:10:51.905632 3183 process.cpp:3671] Handling HTTP event for process 'slave(1250)' with path: '/slave(1250)/api/v1/resource_provider' I0128 20:10:51.907500 3194 http.cpp:1405] HTTP POST for /slave(1250)/api/v1/resource_provider from 172.17.0.3:57918 I0128 20:10:51.908330 3194 manager.cpp:779] Subscribing resource provider {"default_reservations":[{"role":"storage","type":"DYNAMIC"}],"name":"test","storage":{"plugin":{"containers":[{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v0","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_xhvqbN","--available_capacity=0B","--volumes=","--forward=unix:///tmp/aiUrCB/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"resources":[{"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"}],"services":["CONTROLLER_SERVICE","NODE_SERVICE"]}],"name":"local","type":"org.apache.mesos.csi.test"},"reconciliation_interval_seconds":15.0},"type":"org.apache.mesos.rp.local.storage"} I0128 20:10:51.926465 3187 hierarchical.cpp:1853] Performed allocation for 1 agents in 213153ns I0128 20:10:51.944268 3183 slave.cpp:8559] Handling resource provider message 'SUBSCRIBE: {"default_reservations":[{"role":"storage","type":"DYNAMIC"}],"id":{"value":"a3175c97-fdd0-4887-b213-41e63f7f550b"},"name":"test","storage":{"plugin":{"containers":[{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v0","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_xhvqbN","--available_capacity=0B","--volumes=","--forward=unix:///tmp/aiUrCB/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"resources":[{"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"}],"services":["CONTROLLER_SERVICE","NODE_SERVICE"]}],"name":"local","type":"org.apache.mesos.csi.test"},"reconciliation_interval_seconds":15.0},"type":"org.apache.mesos.rp.local.storage"}' I0128 20:10:51.946022 3196 provider.cpp:498] Received SUBSCRIBED event I0128 20:10:51.946064 3196 provider.cpp:1309] Subscribed with ID a3175c97-fdd0-4887-b213-41e63f7f550b I0128 20:10:51.946954 3184 status_update_manager_process.hpp:314] Recovering operation status update manager I0128 20:10:51.978252 3186 hierarchical.cpp:1853] Performed allocation for 1 agents in 351052ns I0128 20:10:51.994307 3187 provider.cpp:790] Reconciling storage pools and volumes I0128 20:10:51.996865 14708 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/ListVolumes call I0128 20:10:52.000011 3185 provider.cpp:2217] Sending UPDATE_STATE call with resources '{}' and 0 operations to agent 3e9613ab-4ce8-4f7f-aa4f-138c9c42984f-S0 I0128 20:10:52.000308 3187 http_connection.hpp:131] Sending UPDATE_STATE call to http://172.17.0.3:43601/slave(1250)/api/v1/resource_provider I0128 20:10:52.000385 3185 provider.cpp:748] Resource provider a3175c97-fdd0-4887-b213-41e63f7f550b is in READY state I0128 20:10:52.000530 3188 status_update_manager_process.hpp:385] Resuming operation status update manager I0128 20:10:52.001344 3189 provider.cpp:1235] Updating profiles { test } for resource provider a3175c97-fdd0-4887-b213-41e63f7f550b I0128 20:10:52.001899 3196 process.cpp:3671] Handling HTTP event for process 'slave(1250)' with path: '/slave(1250)/api/v1/resource_provider' I0128 20:10:52.002588 3196 provider.cpp:790] Reconciling storage pools and volumes I0128 20:10:52.003341 3182 http.cpp:1405] HTTP POST for /slave(1250)/api/v1/resource_provider from 172.17.0.3:57916 I0128 20:10:52.004038 3193 manager.cpp:1011] Received UPDATE_STATE call with resources '[]' and 0 operations from resource provider a3175c97-fdd0-4887-b213-41e63f7f550b I0128 20:10:52.004269 3190 slave.cpp:8559] Handling resource provider message 'UPDATE_STATE: a3175c97-fdd0-4887-b213-41e63f7f550b {}' I0128 20:10:52.004382 3190 slave.cpp:8679] Forwarding new total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0128 20:10:52.005007 14708 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/ListVolumes call I0128 20:10:52.005527 14708 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/GetCapacity call I0128 20:10:52.006165 3194 hierarchical.cpp:1110] Grew agent 3e9613ab-4ce8-4f7f-aa4f-138c9c42984f-S0 by {} (total), { } (used) I0128 20:10:52.006603 3194 hierarchical.cpp:1067] Agent 3e9613ab-4ce8-4f7f-aa4f-138c9c42984f-S0 (8d65c711bd18) updated with total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0128 20:10:52.012248 3182 hierarchical.cpp:1853] Performed allocation for 1 agents in 190959ns I0128 20:10:52.012763 3196 provider.cpp:790] Reconciling storage pools and volumes I0128 20:10:52.014775 14708 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/ListVolumes call I0128 20:10:52.015525 14708 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/GetCapacity call I0128 20:10:52.026031 3181 slave.cpp:989] Agent terminating I0128 20:10:52.026986 3181 manager.cpp:127] Terminating resource provider a3175c97-fdd0-4887-b213-41e63f7f550b I0128 20:10:52.027504 3183 master.cpp:1299] Agent 3e9613ab-4ce8-4f7f-aa4f-138c9c42984f-S0 at slave(1250)@172.17.0.3:43601 (8d65c711bd18) disconnected I0128 20:10:52.027554 3183 master.cpp:3368] Disconnecting agent 3e9613ab-4ce8-4f7f-aa4f-138c9c42984f-S0 at slave(1250)@172.17.0.3:43601 (8d65c711bd18) I0128 20:10:52.027657 3183 master.cpp:3387] Deactivating agent 3e9613ab-4ce8-4f7f-aa4f-138c9c42984f-S0 at slave(1250)@172.17.0.3:43601 (8d65c711bd18) I0128 20:10:52.027884 3184 hierarchical.cpp:1156] Agent 3e9613ab-4ce8-4f7f-aa4f-138c9c42984f-S0 deactivated E0128 20:10:52.028158 3182 http_connection.hpp:449] End-Of-File received I0128 20:10:52.028810 3182 http_connection.hpp:217] Re-detecting endpoint I0128 20:10:52.029253 3182 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0128 20:10:52.029315 3182 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0128 20:10:52.029384 3182 http_connection.hpp:227] New endpoint detected at http://172.17.0.3:43601/slave(1250)/api/v1/resource_provider I0128 20:10:52.029520 3187 provider.cpp:488] Disconnected from resource provider manager I0128 20:10:52.029680 3187 status_update_manager_process.hpp:379] Pausing operation status update manager I0128 20:10:52.030856 3192 containerizer.cpp:2619] Destroying container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE in RUNNING state I0128 20:10:52.030920 3192 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from RUNNING to DESTROYING after 15.473609984secs I0128 20:10:52.031399 3192 launcher.cpp:161] Asked to destroy container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0128 20:10:52.032371 3183 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.3:43601/slave(1250)/api/v1/resource_provider I0128 20:10:52.033152 3195 provider.cpp:476] Connected to resource provider manager I0128 20:10:52.033839 3185 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.3:43601/slave(1250)/api/v1/resource_provider I0128 20:10:52.034730 3198 process.cpp:2781] Returning '404 Not Found' for '/slave(1250)/api/v1/resource_provider' E0128 20:10:52.036178 3196 provider.cpp:721] Failed to subscribe resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test': Received '404 Not Found' () I0128 20:10:52.058459 3187 hierarchical.cpp:1853] Performed allocation for 1 agents in 228085ns I0128 20:10:52.109066 3191 containerizer.cpp:3155] Container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE has exited I0128 20:10:52.109376 3183 hierarchical.cpp:1853] Performed allocation for 1 agents in 194163ns I0128 20:10:52.111131 3196 provisioner.cpp:652] Ignoring destroy request for unknown container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0128 20:10:52.114406 3195 container_daemon.cpp:189] Invoking post-stop hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0128 20:10:52.114701 3193 service_manager.cpp:723] Disconnected from endpoint 'unix:///tmp/mesos-csi-dLP7V6/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0128 20:10:52.114961 3185 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0128 20:10:52.118072 3198 process.cpp:2781] Returning '404 Not Found' for '/slave(1250)/api/v1' I0128 20:10:52.129782 3181 master.cpp:1140] Master terminating I0128 20:10:52.130153 3190 hierarchical.cpp:1132] Removed all filters for agent 3e9613ab-4ce8-4f7f-aa4f-138c9c42984f-S0 I0128 20:10:52.130179 3190 hierarchical.cpp:1008] Removed agent 3e9613ab-4ce8-4f7f-aa4f-138c9c42984f-S0 [ OK ] CSIVersion/StorageLocalResourceProviderTest.Update/v0 (722 ms) [ RUN ] CSIVersion/StorageLocalResourceProviderTest.Update/v1 I0128 20:10:52.149422 3181 cluster.cpp:180] Creating default 'local' authorizer I0128 20:10:52.154739 3194 master.cpp:443] Master 18417567-41e7-4fdc-98d3-541827137a09 (8d65c711bd18) started on 172.17.0.3:43601 I0128 20:10:52.154769 3194 master.cpp:446] Flags at startup: --acls="" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins" --allocation_interval="50ms" --allocator="hierarchical" --authenticate_agents="true" --authenticate_frameworks="true" --authenticate_http_frameworks="true" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authentication_v0_timeout="15secs" --authenticators="crammd5" --authorizers="local" --credentials="/tmp/Zdn2Mi/credentials" --filter_gpu_resources="true" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_framework_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_operator_event_stream_subscribers="1000" --max_unreachable_tasks_per_framework="1000" --memory_profiling="false" --min_alloca table_resources="cpus:0.01|mem:32" --port="5050" --publish_per_framework_metrics="true" --quiet="false" --recovery_agent_removal_limit="100%" --registry="in_memory" --registry_fetch_timeout="1mins" --registry_gc_interval="15mins" --registry_max_agent_age="2weeks" --registry_max_agent_count="102400" --registry_store_timeout="100secs" --registry_strict="false" --require_agent_domain="false" --role_sorter="drf" --root_submissions="true" --version="false" --webui_dir="/tmp/SRC/build/mesos-1.10.0/_inst/share/mesos/webui" --work_dir="/tmp/Zdn2Mi/master" --zk_session_timeout="10secs" I0128 20:10:52.155210 3194 master.cpp:495] Master only allowing authenticated frameworks to register I0128 20:10:52.155230 3194 master.cpp:501] Master only allowing authenticated agents to register I0128 20:10:52.155242 3194 master.cpp:507] Master only allowing authenticated HTTP frameworks to register I0128 20:10:52.155256 3194 credentials.hpp:37] Loading credentials for authentication from '/tmp/Zdn2Mi/credentials' I0128 20:10:52.155552 3194 master.cpp:551] Using default 'crammd5' authenticator I0128 20:10:52.155791 3194 http.cpp:1265] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readonly' I0128 20:10:52.156049 3194 http.cpp:1265] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readwrite' I0128 20:10:52.156261 3194 http.cpp:1265] Creating default 'basic' HTTP authenticator for realm 'mesos-master-scheduler' I0128 20:10:52.156466 3194 master.cpp:632] Authorization enabled I0128 20:10:52.156867 3188 hierarchical.cpp:567] Initialized hierarchical allocator process I0128 20:10:52.156924 3187 whitelist_watcher.cpp:77] No whitelist given I0128 20:10:52.161098 3184 master.cpp:2172] Elected as the leading master! I0128 20:10:52.161139 3184 master.cpp:1668] Recovering from registrar I0128 20:10:52.161330 3185 registrar.cpp:339] Recovering registrar I0128 20:10:52.162088 3185 registrar.cpp:383] Successfully fetched the registry (0B) in 0ns I0128 20:10:52.162221 3185 registrar.cpp:487] Applied 1 operations in 40738ns; attempting to update the registry I0128 20:10:52.162875 3185 registrar.cpp:544] Successfully updated the registry in 0ns I0128 20:10:52.163007 3185 registrar.cpp:416] Successfully recovered registrar I0128 20:10:52.163422 3188 master.cpp:1821] Recovered 0 agents from the registry (144B); allowing 10mins for agents to reregister I0128 20:10:52.163513 3192 hierarchical.cpp:606] Skipping recovery of hierarchical allocator: nothing to recover W0128 20:10:52.169096 3181 process.cpp:2877] Attempted to spawn already running process [email protected]:43601 I0128 20:10:52.170612 3181 containerizer.cpp:317] Using isolation { environment_secret, posix/cpu, posix/mem, filesystem/posix, network/cni } W0128 20:10:52.171278 3181 backend.cpp:76] Failed to create 'overlay' backend: OverlayBackend requires root privileges W0128 20:10:52.171311 3181 backend.cpp:76] Failed to create 'aufs' backend: AufsBackend requires root privileges W0128 20:10:52.171331 3181 backend.cpp:76] Failed to create 'bind' backend: BindBackend requires root privileges I0128 20:10:52.171367 3181 provisioner.cpp:294] Using default backend 'copy' I0128 20:10:52.174374 3181 cluster.cpp:527] Creating default 'local' authorizer I0128 20:10:52.177194 3183 slave.cpp:270] Mesos agent started on (1251)@172.17.0.3:43601 I0128 20:10:52.177232 3183 slave.cpp:271] Flags at startup: --acls="" --appc_simple_discovery_uri_prefix="http://" --appc_store_dir="/tmp/Zdn2Mi/98GpNa/store/appc" --authenticate_http_readonly="true" --authenticate_http_readwrite="false" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authentication_timeout_max="1mins" --authentication_timeout_min="5secs" --authorizer="local" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_destroy_timeout="1mins" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="mesos" --credential="/tmp/Zdn2Mi/98GpNa/credential" --default_role="*" --disallow_sharing_agent_ipc_namespace="false" --disallow_sharing_agent_pid_namespace="false" --disk_profile_adaptor="org_apache_mesos_UriDiskProfileAdaptor" --disk_watch_interval="1mins" --docker="docker" --docker_ignore_runtime="false" --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io" --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/Zdn2Mi/98GpNa/store/docker" --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume" --docker_volume_chown="false" --enforce_container_disk_quota="false" --executor_registration_timeout="1mins" --executor_reregistration_timeout="2secs" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/Zdn2Mi/98GpNa/fetch" --fetcher_cache_size="2GB" --fetcher_stall_timeout="1mins" --frameworks_home="/tmp/Zdn2Mi/98GpNa/frameworks" --gc_delay="1weeks" --gc_disk_headroom="0.1" --gc_non_executor_container_sandboxes="false" --help="false" --hostname_lookup="true" --http_command_executor="false" --http_credentials="/tmp/Zdn2Mi/98GpNa/http_credentials" --http_executor_domain_sockets="false" --http_heartbeat_interval="30secs" --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem" --launcher="posi x" --launcher_dir="/tmp/SRC/build/mesos-1.10.0/_build/sub/src" --logbufsecs="0" --logging_level="INFO" --max_completed_executors_per_framework="150" --memory_profiling="false" --network_cni_metrics="true" --network_cni_root_dir_persist="false" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns" --quiet="false" --reconfiguration_policy="equal" --recover="reconnect" --recovery_timeout="15mins" --registration_backoff_factor="10ms" --resource_provider_config_dir="/tmp/Zdn2Mi/resource_provider_configs" --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]" --revocable_cpu_low_priority="true" --runtime_dir="/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_mBHrhX" --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true" --systemd_enable_support="true" --systemd_runtime_directory="/run/systemd/system" --version="false" --work_dir="/tmp/CSIVersion_StorageLoca lResourceProviderTest_Update_v1_NiouLJ" --zk_session_timeout="10secs" I0128 20:10:52.177767 3183 credentials.hpp:86] Loading credential for authentication from '/tmp/Zdn2Mi/98GpNa/credential' I0128 20:10:52.177959 3183 slave.cpp:303] Agent using credential for: test-principal I0128 20:10:52.177992 3183 credentials.hpp:37] Loading credentials for authentication from '/tmp/Zdn2Mi/98GpNa/http_credentials' I0128 20:10:52.178241 3183 http.cpp:1265] Creating default 'basic' HTTP authenticator for realm 'mesos-agent-readonly' I0128 20:10:52.178637 3183 disk_profile_adaptor.cpp:82] Creating disk profile adaptor module 'org_apache_mesos_UriDiskProfileAdaptor' I0128 20:10:52.180583 3189 uri_disk_profile_adaptor.cpp:305] Updated disk profile mapping to 1 active profiles I0128 20:10:52.180474 3183 slave.cpp:618] Agent resources: [{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}] I0128 20:10:52.180815 3183 slave.cpp:626] Agent attributes: [ ] I0128 20:10:52.180850 3183 slave.cpp:635] Agent hostname: 8d65c711bd18 I0128 20:10:52.180994 3194 status_update_manager_process.hpp:379] Pausing operation status update manager I0128 20:10:52.181015 3193 task_status_update_manager.cpp:181] Pausing sending task status updates I0128 20:10:52.182615 3191 state.cpp:68] Recovering state from '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_NiouLJ/meta' I0128 20:10:52.182967 3197 slave.cpp:7568] Finished recovering checkpointed state from '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_NiouLJ/meta', beginning agent recovery I0128 20:10:52.183672 3187 task_status_update_manager.cpp:207] Recovering task status update manager I0128 20:10:52.184113 3188 containerizer.cpp:820] Recovering Mesos containers I0128 20:10:52.184567 3188 containerizer.cpp:1160] Recovering isolators I0128 20:10:52.185755 3195 hierarchical.cpp:1853] Performed allocation for 0 agents in 133343ns I0128 20:10:52.185853 3197 containerizer.cpp:1199] Recovering provisioner I0128 20:10:52.186727 3187 provisioner.cpp:518] Provisioner recovery complete I0128 20:10:52.187767 3188 composing.cpp:339] Finished recovering all containerizers I0128 20:10:52.188102 3194 slave.cpp:8050] Recovering executors I0128 20:10:52.188272 3194 slave.cpp:8203] Finished recovery I0128 20:10:52.189203 3187 task_status_update_manager.cpp:181] Pausing sending task status updates I0128 20:10:52.189270 3186 status_update_manager_process.hpp:379] Pausing operation status update manager I0128 20:10:52.189270 3197 slave.cpp:1416] New master detected at [email protected]:43601 I0128 20:10:52.189460 3197 slave.cpp:1481] Detecting new master I0128 20:10:52.195991 3182 slave.cpp:1508] Authenticating with master [email protected]:43601 I0128 20:10:52.196110 3182 slave.cpp:1517] Using default CRAM-MD5 authenticatee I0128 20:10:52.196494 3189 authenticatee.cpp:121] Creating new client SASL connection I0128 20:10:52.196864 3193 master.cpp:10159] Authenticating slave(1251)@172.17.0.3:43601 I0128 20:10:52.197099 3190 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(2108)@172.17.0.3:43601 I0128 20:10:52.197494 3183 authenticator.cpp:98] Creating new server SASL connection I0128 20:10:52.197762 3188 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 I0128 20:10:52.197816 3188 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' I0128 20:10:52.197984 3196 authenticator.cpp:204] Received SASL authentication start I0128 20:10:52.198062 3196 authenticator.cpp:326] Authentication requires more steps I0128 20:10:52.198187 3196 authenticatee.cpp:259] Received SASL authentication step I0128 20:10:52.198338 3194 authenticator.cpp:232] Received SASL authentication step I0128 20:10:52.198384 3194 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '8d65c711bd18' server FQDN: '8d65c711bd18' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false I0128 20:10:52.198446 3194 auxprop.cpp:181] Looking up auxiliary property '*userPassword' I0128 20:10:52.198515 3194 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' I0128 20:10:52.198554 3194 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '8d65c711bd18' server FQDN: '8d65c711bd18' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true I0128 20:10:52.198573 3194 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true I0128 20:10:52.198586 3194 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true I0128 20:10:52.198606 3194 authenticator.cpp:318] Authentication success I0128 20:10:52.198732 3192 authenticatee.cpp:299] Authentication success I0128 20:10:52.198843 3187 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(2108)@172.17.0.3:43601 I0128 20:10:52.198839 3185 master.cpp:10191] Successfully authenticated principal 'test-principal' at slave(1251)@172.17.0.3:43601 I0128 20:10:52.199291 3186 slave.cpp:1608] Successfully authenticated with master [email protected]:43601 I0128 20:10:52.199750 3186 slave.cpp:2058] Will retry registration in 4.069981ms if necessary I0128 20:10:52.199983 3189 master.cpp:6629] Received register agent message from slave(1251)@172.17.0.3:43601 (8d65c711bd18) I0128 20:10:52.200507 3189 master.cpp:3712] Authorizing principal 'test-principal' to perform action REGISTER_AGENT on ANY object I0128 20:10:52.201258 3188 master.cpp:6696] Authorized registration of agent at slave(1251)@172.17.0.3:43601 (8d65c711bd18) I0128 20:10:52.201367 3188 master.cpp:6808] Registering agent at slave(1251)@172.17.0.3:43601 (8d65c711bd18) with id 18417567-41e7-4fdc-98d3-541827137a09-S0 I0128 20:10:52.202172 3196 registrar.cpp:487] Applied 1 operations in 289512ns; attempting to update the registry I0128 20:10:52.202977 3196 registrar.cpp:544] Successfully updated the registry in 732160ns I0128 20:10:52.203217 3191 master.cpp:6856] Admitted agent 18417567-41e7-4fdc-98d3-541827137a09-S0 at slave(1251)@172.17.0.3:43601 (8d65c711bd18) I0128 20:10:52.204171 3191 master.cpp:6901] Registered agent 18417567-41e7-4fdc-98d3-541827137a09-S0 at slave(1251)@172.17.0.3:43601 (8d65c711bd18) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0128 20:10:52.204233 3192 slave.cpp:1641] Registered with master [email protected]:43601; given agent ID 18417567-41e7-4fdc-98d3-541827137a09-S0 I0128 20:10:52.204282 3182 hierarchical.cpp:959] Added agent 18417567-41e7-4fdc-98d3-541827137a09-S0 (8d65c711bd18) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] (offered or allocated: {}) I0128 20:10:52.204370 3190 task_status_update_manager.cpp:188] Resuming sending task status updates I0128 20:10:52.204668 3182 hierarchical.cpp:1853] Performed allocation for 1 agents in 143265ns I0128 20:10:52.228391 3192 slave.cpp:1676] Checkpointing SlaveInfo to '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_NiouLJ/meta/slaves/18417567-41e7-4fdc-98d3-541827137a09-S0/slave.info' I0128 20:10:52.228530 3189 status_update_manager_process.hpp:385] Resuming operation status update manager I0128 20:10:52.229389 3192 slave.cpp:1728] Forwarding agent update {"operations":{},"resource_providers":{},"resource_version_uuid":{"value":"YgMlcSJLTEycbkWW1nzY3g=="},"slave_id":{"value":"18417567-41e7-4fdc-98d3-541827137a09-S0"},"update_oversubscribed_resources":false} I0128 20:10:52.230253 3194 master.cpp:8039] Ignoring update on agent 18417567-41e7-4fdc-98d3-541827137a09-S0 at slave(1251)@172.17.0.3:43601 (8d65c711bd18) as it reports no changes I0128 20:10:52.234627 3189 process.cpp:3671] Handling HTTP event for process 'slave(1251)' with path: '/slave(1251)/api/v1' I0128 20:10:52.236121 3187 http.cpp:1405] HTTP POST for /slave(1251)/api/v1 from 172.17.0.3:57926 I0128 20:10:52.236594 3186 hierarchical.cpp:1853] Performed allocation for 1 agents in 142231ns I0128 20:10:52.236657 3187 http.cpp:2146] Processing GET_CONTAINERS call I0128 20:10:52.242810 3187 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0128 20:10:52.245724 3191 process.cpp:3671] Handling HTTP event for process 'slave(1251)' with path: '/slave(1251)/api/v1' I0128 20:10:52.246850 3193 http.cpp:1405] HTTP POST for /slave(1251)/api/v1 from 172.17.0.3:57928 I0128 20:10:52.247634 3193 http.cpp:2606] Processing LAUNCH_CONTAINER call for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0128 20:10:52.248546 3185 http.cpp:2710] Creating sandbox '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_NiouLJ/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0128 20:10:52.249316 3187 containerizer.cpp:1395] Starting container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0128 20:10:52.250100 3187 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from STARTING to PROVISIONING after 289024ns I0128 20:10:52.251066 3187 containerizer.cpp:1573] Checkpointed ContainerConfig at '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_mBHrhX/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE/config' I0128 20:10:52.251127 3187 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from PROVISIONING to PREPARING after 1.028864ms I0128 20:10:52.254492 3189 containerizer.cpp:2099] Launching 'mesos-containerizer' with flags '--help="false" --launch_info="{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v1","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_4S0xfw","--available_capacity=0B","--volumes=","--forward=unix:///tmp/Zdn2Mi/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"environment":{"variables":[{"name":"MESOS_SANDBOX","type":"VALUE","value":"/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_NiouLJ/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE"},{"name":"CSI_ENDPOINT","type":"VALUE","value":"unix:///tmp/mesos-csi-K5FAt3/endpoint.sock"}]},"task_environment":{},"working_directory":"/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_NiouLJ/containers/o rg-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE"}" --pipe_read="105" --pipe_write="106" --runtime_directory="/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_mBHrhX/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE" --unshare_namespace_mnt="false"' I0128 20:10:52.265653 3189 launcher.cpp:145] Forked child with pid '14718' for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0128 20:10:52.288259 3192 hierarchical.cpp:1853] Performed allocation for 1 agents in 198635ns I0128 20:10:52.337555 3189 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from PREPARING to ISOLATING after 86.42816ms I0128 20:10:52.338809 3189 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from ISOLATING to FETCHING after 1.227776ms I0128 20:10:52.339143 3195 fetcher.cpp:369] Starting to fetch URIs for container: org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE, directory: /tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_NiouLJ/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0128 20:10:52.339264 3182 hierarchical.cpp:1853] Performed allocation for 1 agents in 205336ns I0128 20:10:52.340165 3194 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from FETCHING to RUNNING after 1.371136ms I0128 20:10:52.342218 3190 container_daemon.cpp:140] Invoking post-start hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0128 20:10:52.342373 3190 service_manager.cpp:703] Connecting to endpoint 'unix:///tmp/mesos-csi-K5FAt3/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0128 20:10:52.391201 3194 hierarchical.cpp:1853] Performed allocation for 1 agents in 163431ns I0128 20:10:52.442818 3184 hierarchical.cpp:1853] Performed allocation for 1 agents in 197622ns I0128 20:10:52.494318 3195 hierarchical.cpp:1853] Performed allocation for 1 agents in 193425ns I0128 20:10:52.545516 3191 hierarchical.cpp:1853] Performed allocation for 1 agents in 145232ns I0128 20:10:52.597170 3182 hierarchical.cpp:1853] Performed allocation for 1 agents in 144077ns I0128 20:10:52.600600 3192 service_manager.cpp:545] Probing endpoint 'unix:///tmp/mesos-csi-K5FAt3/endpoint.sock' with CSI v1 I0128 20:10:52.602560 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Identity/Probe call I0128 20:10:52.605507 3186 container_daemon.cpp:171] Waiting for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0128 20:10:52.608448 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Identity/GetPluginCapabilities call I0128 20:10:52.609143 3189 process.cpp:3671] Handling HTTP event for process 'slave(1251)' with path: '/slave(1251)/api/v1' I0128 20:10:52.610664 3185 http.cpp:1405] HTTP POST for /slave(1251)/api/v1 from 172.17.0.3:57930 I0128 20:10:52.611224 3185 http.cpp:2824] Processing WAIT_CONTAINER call for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0128 20:10:52.612669 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Identity/GetPluginInfo call I0128 20:10:52.613019 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Identity/GetPluginInfo call I0128 20:10:52.614888 3194 v1_volume_manager.cpp:649] NODE_SERVICE loaded: {} I0128 20:10:52.615470 3194 v1_volume_manager.cpp:649] CONTROLLER_SERVICE loaded: {} I0128 20:10:52.617583 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/ControllerGetCapabilities call I0128 20:10:52.621446 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Node/NodeGetCapabilities call I0128 20:10:52.625095 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Node/NodeGetInfo call I0128 20:10:52.635280 3191 provider.cpp:676] Recovered resources '{}' and 0 operations for resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test' I0128 20:10:52.635494 3184 status_update_manager_process.hpp:379] Pausing operation status update manager I0128 20:10:52.635823 3185 http_connection.hpp:227] New endpoint detected at http://172.17.0.3:43601/slave(1251)/api/v1/resource_provider I0128 20:10:52.638888 3195 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.3:43601/slave(1251)/api/v1/resource_provider I0128 20:10:52.639672 3196 provider.cpp:476] Connected to resource provider manager I0128 20:10:52.640254 3186 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.3:43601/slave(1251)/api/v1/resource_provider I0128 20:10:52.641526 3185 process.cpp:3671] Handling HTTP event for process 'slave(1251)' with path: '/slave(1251)/api/v1/resource_provider' I0128 20:10:52.643352 3183 http.cpp:1405] HTTP POST for /slave(1251)/api/v1/resource_provider from 172.17.0.3:57934 I0128 20:10:52.644165 3183 manager.cpp:779] Subscribing resource provider {"default_reservations":[{"role":"storage","type":"DYNAMIC"}],"name":"test","storage":{"plugin":{"containers":[{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v1","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_4S0xfw","--available_capacity=0B","--volumes=","--forward=unix:///tmp/Zdn2Mi/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"resources":[{"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"}],"services":["CONTROLLER_SERVICE","NODE_SERVICE"]}],"name":"local","type":"org.apache.mesos.csi.test"},"reconciliation_interval_seconds":15.0},"type":"org.apache.mesos.rp.local.storage"} I0128 20:10:52.648066 3197 hierarchical.cpp:1853] Performed allocation for 1 agents in 202521ns I0128 20:10:52.699091 3191 hierarchical.cpp:1853] Performed allocation for 1 agents in 123434ns I0128 20:10:52.706725 3190 slave.cpp:8559] Handling resource provider message 'SUBSCRIBE: {"default_reservations":[{"role":"storage","type":"DYNAMIC"}],"id":{"value":"d1f16707-9dc9-4f4a-9b56-b8169afb6f25"},"name":"test","storage":{"plugin":{"containers":[{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v1","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_4S0xfw","--available_capacity=0B","--volumes=","--forward=unix:///tmp/Zdn2Mi/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"resources":[{"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"}],"services":["CONTROLLER_SERVICE","NODE_SERVICE"]}],"name":"local","type":"org.apache.mesos.csi.test"},"reconciliation_interval_seconds":15.0},"type":"org.apache.mesos.rp.local.storage"}' I0128 20:10:52.708403 3196 provider.cpp:498] Received SUBSCRIBED event I0128 20:10:52.708446 3196 provider.cpp:1309] Subscribed with ID d1f16707-9dc9-4f4a-9b56-b8169afb6f25 I0128 20:10:52.709218 3197 status_update_manager_process.hpp:314] Recovering operation status update manager I0128 20:10:52.750599 3182 hierarchical.cpp:1853] Performed allocation for 1 agents in 122783ns I0128 20:10:52.801781 3184 hierarchical.cpp:1853] Performed allocation for 1 agents in 194482ns I0128 20:10:52.853446 3192 hierarchical.cpp:1853] Performed allocation for 1 agents in 105849ns I0128 20:10:52.897168 3191 provider.cpp:790] Reconciling storage pools and volumes I0128 20:10:52.899744 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/ListVolumes call I0128 20:10:52.902922 3189 provider.cpp:2217] Sending UPDATE_STATE call with resources '{}' and 0 operations to agent 18417567-41e7-4fdc-98d3-541827137a09-S0 I0128 20:10:52.903321 3189 provider.cpp:748] Resource provider d1f16707-9dc9-4f4a-9b56-b8169afb6f25 is in READY state I0128 20:10:52.903316 3191 http_connection.hpp:131] Sending UPDATE_STATE call to http://172.17.0.3:43601/slave(1251)/api/v1/resource_provider I0128 20:10:52.903409 3195 status_update_manager_process.hpp:385] Resuming operation status update manager I0128 20:10:52.904170 3194 provider.cpp:1235] Updating profiles { test } for resource provider d1f16707-9dc9-4f4a-9b56-b8169afb6f25 I0128 20:10:52.904469 3190 hierarchical.cpp:1853] Performed allocation for 1 agents in 162144ns I0128 20:10:52.904914 3197 process.cpp:3671] Handling HTTP event for process 'slave(1251)' with path: '/slave(1251)/api/v1/resource_provider' I0128 20:10:52.905490 3187 provider.cpp:790] Reconciling storage pools and volumes I0128 20:10:52.907059 3183 http.cpp:1405] HTTP POST for /slave(1251)/api/v1/resource_provider from 172.17.0.3:57932 I0128 20:10:52.907733 3186 manager.cpp:1011] Received UPDATE_STATE call with resources '[]' and 0 operations from resource provider d1f16707-9dc9-4f4a-9b56-b8169afb6f25 I0128 20:10:52.907944 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/ListVolumes call I0128 20:10:52.907968 3197 slave.cpp:8559] Handling resource provider message 'UPDATE_STATE: d1f16707-9dc9-4f4a-9b56-b8169afb6f25 {}' I0128 20:10:52.908071 3197 slave.cpp:8679] Forwarding new total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0128 20:10:52.908516 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/GetCapacity call I0128 20:10:52.909620 3188 hierarchical.cpp:1110] Grew agent 18417567-41e7-4fdc-98d3-541827137a09-S0 by {} (total), { } (used) I0128 20:10:52.910190 3188 hierarchical.cpp:1067] Agent 18417567-41e7-4fdc-98d3-541827137a09-S0 (8d65c711bd18) updated with total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0128 20:10:52.914958 3195 hierarchical.cpp:1853] Performed allocation for 1 agents in 142227ns I0128 20:10:52.915351 3190 provider.cpp:790] Reconciling storage pools and volumes I0128 20:10:52.917380 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/ListVolumes call I0128 20:10:52.917848 14722 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/GetCapacity call I0128 20:10:52.928550 3181 slave.cpp:989] Agent terminating I0128 20:10:52.929262 3181 manager.cpp:127] Terminating resource provider d1f16707-9dc9-4f4a-9b56-b8169afb6f25 I0128 20:10:52.929708 3190 master.cpp:1299] Agent 18417567-41e7-4fdc-98d3-541827137a09-S0 at slave(1251)@172.17.0.3:43601 (8d65c711bd18) disconnected I0128 20:10:52.929746 3190 master.cpp:3368] Disconnecting agent 18417567-41e7-4fdc-98d3-541827137a09-S0 at slave(1251)@172.17.0.3:43601 (8d65c711bd18) I0128 20:10:52.929824 3190 master.cpp:3387] Deactivating agent 18417567-41e7-4fdc-98d3-541827137a09-S0 at slave(1251)@172.17.0.3:43601 (8d65c711bd18) I0128 20:10:52.930024 3193 hierarchical.cpp:1156] Agent 18417567-41e7-4fdc-98d3-541827137a09-S0 deactivated E0128 20:10:52.930414 3191 http_connection.hpp:449] End-Of-File received I0128 20:10:52.930903 3191 http_connection.hpp:217] Re-detecting endpoint I0128 20:10:52.931387 3191 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0128 20:10:52.931452 3191 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0128 20:10:52.931526 3186 provider.cpp:488] Disconnected from resource provider manager I0128 20:10:52.931560 3191 http_connection.hpp:227] New endpoint detected at http://172.17.0.3:43601/slave(1251)/api/v1/resource_provider I0128 20:10:52.931635 3186 status_update_manager_process.hpp:379] Pausing operation status update manager I0128 20:10:52.933022 3188 containerizer.cpp:2619] Destroying container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE in RUNNING state I0128 20:10:52.933089 3188 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from RUNNING to DESTROYING after 15.59293312secs I0128 20:10:52.933534 3188 launcher.cpp:161] Asked to destroy container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0128 20:10:52.934455 3194 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.3:43601/slave(1251)/api/v1/resource_provider I0128 20:10:52.935079 3193 provider.cpp:476] Connected to resource provider manager I0128 20:10:52.935734 3191 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.3:43601/slave(1251)/api/v1/resource_provider I0128 20:10:52.936656 3198 process.cpp:2781] Returning '404 Not Found' for '/slave(1251)/api/v1/resource_provider' E0128 20:10:52.937943 3196 provider.cpp:721] Failed to subscribe resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test': Received '404 Not Found' () I0128 20:10:52.961410 3186 hierarchical.cpp:1853] Performed allocation for 1 agents in 191094ns I0128 20:10:53.011339 3187 containerizer.cpp:3155] Container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE has exited I0128 20:10:53.013025 3189 hierarchical.cpp:1853] Performed allocation for 1 agents in 153726ns I0128 20:10:53.013124 3196 provisioner.cpp:652] Ignoring destroy request for unknown container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0128 20:10:53.016279 3183 container_daemon.cpp:189] Invoking post-stop hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0128 20:10:53.016527 3183 service_manager.cpp:723] Disconnected from endpoint 'unix:///tmp/mesos-csi-K5FAt3/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0128 20:10:53.016855 3196 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0128 20:10:53.019570 3198 process.cpp:2781] Returning '404 Not Found' for '/slave(1251)/api/v1' I0128 20:10:53.031792 3181 master.cpp:1140] Master terminating I0128 20:10:53.032173 3185 hierarchical.cpp:1132] Removed all filters for agent 18417567-41e7-4fdc-98d3-541827137a09-S0 I0128 20:10:53.032204 3185 hierarchical.cpp:1008] Removed agent 18417567-41e7-4fdc-98d3-541827137a09-S0 [ OK ] CSIVersion/StorageLocalResourceProviderTest.Update/v1 (907 ms) [----------] 54 tests from CSIVersion/StorageLocalResourceProviderTest (110273 ms total) [----------] Global test environment tear-down [==========] 2320 tests from 222 test cases ran. (1234261 ms total) [ PASSED ] 2319 tests. [ FAILED ] 1 test, listed below: [ FAILED ] OversubscriptionTest.FixedResourceEstimator 1 FAILED TEST YOU HAVE 34 DISABLED TESTS I0128 20:10:53.136183 3198 process.cpp:935] Stopped the socket accept loop Makefile:15957: recipe for target 'check-local' failed make[4]: *** [check-local] Error 1 make[4]: Leaving directory '/tmp/SRC/build/mesos-1.10.0/_build/sub/src' Makefile:15073: recipe for target 'check-am' failed make[3]: *** [check-am] Error 2 make[3]: Leaving directory '/tmp/SRC/build/mesos-1.10.0/_build/sub/src' Makefile:15077: recipe for target 'check' failed make[2]: *** [check] Error 2 make[2]: Leaving directory '/tmp/SRC/build/mesos-1.10.0/_build/sub/src' Makefile:791: recipe for target 'check-recursive' failed make[1]: *** [check-recursive] Error 1 make[1]: Leaving directory '/tmp/SRC/build/mesos-1.10.0/_build/sub' Makefile:997: recipe for target 'distcheck' failed make: *** [distcheck] Error 1 Untagged: mesos/mesos-build:ubuntu-16.04 Untagged: mesos/mesos-build@sha256:fa967cbcfb44f55708a3cbc87f245c6d29dd891464db558af56a03ee321526bb Deleted: sha256:e895c0531b9a9a288fabe479a49f7059aed83645351ac99ec2ea2616822c9f97 Deleted: sha256:09119b0b314a69ba6ec6251f2e89f4199fe1e874c84f9abf07dcbd23dbc3f1c1 Deleted: sha256:562fe6af5a3883058be9c784a839392215ed4185a21d21f1d99df0d17f3ae6e7 Deleted: sha256:0dcdfbe322a4f332f73ac70905d557300ec6dae3bd19586758772c750c7b4a19 Deleted: sha256:c66652d605f01094e2db53d62505dbd524e076d5aa69b89d5e620003803eb149 Deleted: sha256:a2cf79bfb9593c05fd7142ddb49afef77ea4ad5d2464e841f09fe62ffee396e0 Deleted: sha256:f7a904214b390f39d98573882f631dc908df8b2b540cf04e1062f8182c1efffd Deleted: sha256:ce1f6fcaa83dfce189d76e08f184085732eab4eeb2562d2399953958405c5bec Deleted: sha256:cce92fda689ab9033f0b8db214bc63edd1ae3e05831a0f3a9418976d7dc7ccdd Deleted: sha256:d22094bbd65447c59a42c580eaa3a44cee9cd855f00905f59409be21bcefc745 Deleted: sha256:b8976847450013f3eb5e9a81a5778f73ed7bef67e6393049712ef17102b4b7b7 Deleted: sha256:b8c891f0ffec910a12757d733b178e3f62d81dbbde2b31d3b754071c416108ed Full log: https://builds.apache.org/job/Mesos-Reviewbot-Linux/6816/console - Mesos Reviewbot On Jan. 16, 2020, 6:49 p.m., Joseph Wu wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/72017/ > ----------------------------------------------------------- > > (Updated Jan. 16, 2020, 6:49 p.m.) > > > Review request for mesos, Benjamin Mahler and Greg Mann. > > > Bugs: MESOS-10073 > https://issues.apache.org/jira/browse/MESOS-10073 > > > Repository: mesos > > > Description > ------- > > This adds downgrade support, in the same fashion that the > Libevent SSL socket does (and copies a good chunk of the code > from there too). To account for Windows not having `io::poll`, > a slight hack is taken to check for readable bytes. > > > Diffs > ----- > > 3rdparty/libprocess/src/ssl/openssl_socket.cpp > 74f9fe2443efa37c0b6c7f77120b140f5ac0b53b > > > Diff: https://reviews.apache.org/r/72017/diff/1/ > > > Testing > ------- > > make check (tests enabled with the previous review now pass) > > > Thanks, > > Joseph Wu > >
