----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72099/#review219608 -----------------------------------------------------------
Bad patch! Reviews applied: [72130, 72094, 72095, 72089, 72093, 72096, 72097, 72098, 72099] Failed command: ['bash', '-c', "set -o pipefail; export OS='ubuntu:16.04' BUILDTOOL='autotools' COMPILER='gcc' CONFIGURATION='--verbose --disable-libtool-wrappers --disable-parallel-test-execution' ENVIRONMENT='GLOG_v=1 MESOS_VERBOSE=1'; ./support/jenkins/buildbot.sh 2>&1 | tee build_72099"] Error: ...<truncated>... 33030 3182 status_update_manager_process.hpp:528] Forwarding operation status update OPERATION_FINISHED (Status UUID: ba933a0f-7ae5-4764-8055-f8c4c77ab905) for operation UUID fb5cd456-88d3-4c7c-a077-c77eab97d02b on agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 I0218 11:07:40.533741 3176 http_connection.hpp:131] Sending UPDATE_OPERATION_STATUS call to http://172.17.0.3:33135/slave(1239)/api/v1/resource_provider I0218 11:07:40.534659 3174 process.cpp:3671] Handling HTTP event for process 'slave(1239)' with path: '/slave(1239)/api/v1/resource_provider' I0218 11:07:40.537600 3181 hierarchical.cpp:1853] Performed allocation for 1 agents in 979360ns I0218 11:07:40.538233 3184 master.cpp:9453] Sending offers [ 12d259d9-8ecf-470c-bfce-e55cd73de4df-O3 ] to framework 12d259d9-8ecf-470c-bfce-e55cd73de4df-0000 (default) at [email protected]:33135 I0218 11:07:40.538854 3171 sched.cpp:934] Scheduler::resourceOffers took 93389ns I0218 11:07:40.541914 3180 process.cpp:3671] Handling HTTP event for process 'master' with path: '/master/api/v1' I0218 11:07:40.544034 3179 http.cpp:1405] HTTP POST for /master/api/v1 from 172.17.0.3:42404 I0218 11:07:40.544241 3179 http.cpp:277] Processing call CREATE_VOLUMES I0218 11:07:40.544971 3179 master.cpp:3673] Authorizing principal 'test-principal' to perform action CREATE_VOLUME on object {"value":"storage/default-role","resource":{"provider_id":{"value":"a4f67a65-bdbd-4dc8-b176-8546cb89ee5e"},"name":"disk","type":"SCALAR","scalar":{"value":2048.0},"reservations":[{"type":"DYNAMIC","role":"storage"},{"type":"DYNAMIC","role":"storage/default-role","principal":"test-principal"}],"disk":{"persistence":{"id":"c75311a0-ee53-4fe9-bb7c-774c72716adf","principal":"test-principal"},"volume":{"mode":"RW","container_path":"volume"},"source":{"type":"MOUNT","mount":{"root":"./csi/org.apache.mesos.csi.test/local/mounts"},"vendor":"org.apache.mesos.csi.test.local","id":"/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rjI5n7/2GB-74edc35d-edc5-43a1-a64f-7d922b7c8017","profile":"test"}}}} I0218 11:07:40.546627 3184 sched.cpp:960] Rescinded offer 12d259d9-8ecf-470c-bfce-e55cd73de4df-O3 I0218 11:07:40.546703 3184 sched.cpp:971] Scheduler::offerRescinded took 22352ns I0218 11:07:40.547191 3171 hierarchical.cpp:1576] Recovered ports(allocated: storage/default-role):[31000-32000]; disk(allocated: storage/default-role)(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rjI5n7/2GB-74edc35d-edc5-43a1-a64f-7d922b7c8017,test)]:2048; cpus(allocated: storage/default-role):2; mem(allocated: storage/default-role):1024; disk(allocated: storage/default-role):1024 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rjI5n7/2GB-74edc35d-edc5-43a1-a64f-7d922b7c8017,test)]:2048, offered or allocated: {}) on agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 from framework 12d25 9d9-8ecf-470c-bfce-e55cd73de4df-0000 I0218 11:07:40.547484 3174 master.cpp:11745] Removing offer 12d259d9-8ecf-470c-bfce-e55cd73de4df-O3 I0218 11:07:40.548858 3171 hierarchical.cpp:1625] Framework 12d259d9-8ecf-470c-bfce-e55cd73de4df-0000 filtered agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 for 5secs I0218 11:07:40.551600 3180 master.cpp:11610] Sending operation '' (uuid: f278abc5-c0b8-4d74-afe5-8e67a411a648) to agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 at slave(1239)@172.17.0.3:33135 (7bf56466d523) I0218 11:07:40.552290 3173 slave.cpp:4434] Ignoring new checkpointed resources and operations identical to the current version I0218 11:07:40.555595 3185 provider.cpp:498] Received APPLY_OPERATION event I0218 11:07:40.555639 3185 provider.cpp:1351] Received CREATE operation '' (uuid: f278abc5-c0b8-4d74-afe5-8e67a411a648) I0218 11:07:40.560294 3180 master.cpp:5503] Processing REVIVE call for framework 12d259d9-8ecf-470c-bfce-e55cd73de4df-0000 (default) at [email protected]:33135 I0218 11:07:40.560786 3180 hierarchical.cpp:1721] Unsuppressed offers and cleared filters for roles { storage/default-role } of framework 12d259d9-8ecf-470c-bfce-e55cd73de4df-0000 I0218 11:07:40.562218 3180 hierarchical.cpp:1853] Performed allocation for 1 agents in 1.239567ms I0218 11:07:40.562659 3180 hierarchical.cpp:1853] Performed allocation for 1 agents in 203416ns I0218 11:07:40.563166 3182 master.cpp:9453] Sending offers [ 12d259d9-8ecf-470c-bfce-e55cd73de4df-O4 ] to framework 12d259d9-8ecf-470c-bfce-e55cd73de4df-0000 (default) at [email protected]:33135 I0218 11:07:40.563952 3173 sched.cpp:934] Scheduler::resourceOffers took 102938ns I0218 11:07:40.577674 3184 http.cpp:1405] HTTP POST for /slave(1239)/api/v1/resource_provider from 172.17.0.3:42398 I0218 11:07:40.578702 3178 slave.cpp:8565] Handling resource provider message 'UPDATE_OPERATION_STATUS: (uuid: fb5cd456-88d3-4c7c-a077-c77eab97d02b) for framework (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED)' I0218 11:07:40.578946 3178 slave.cpp:9018] Updating the state of operation with no ID (uuid: fb5cd456-88d3-4c7c-a077-c77eab97d02b) for an operation API call (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED) I0218 11:07:40.579011 3178 slave.cpp:8772] Forwarding status update of operation with no ID (operation_uuid: fb5cd456-88d3-4c7c-a077-c77eab97d02b) for an operator API call I0218 11:07:40.579422 3183 master.cpp:11262] Updating the state of operation '' (uuid: fb5cd456-88d3-4c7c-a077-c77eab97d02b) for an operator API call (latest state: OPERATION_PENDING, status update state: OPERATION_FINISHED) I0218 11:07:40.580057 3180 slave.cpp:4434] Ignoring new checkpointed resources and operations identical to the current version I0218 11:07:40.664041 3177 status_update_manager_process.hpp:152] Received operation status update OPERATION_FINISHED (Status UUID: ca4a41e9-880e-4803-9de0-692467b07a5b) for operation UUID f278abc5-c0b8-4d74-afe5-8e67a411a648 on agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 I0218 11:07:40.664122 3177 status_update_manager_process.hpp:414] Creating operation status update stream f278abc5-c0b8-4d74-afe5-8e67a411a648 checkpoint=true I0218 11:07:40.664130 3185 provider.cpp:498] Received ACKNOWLEDGE_OPERATION_STATUS event I0218 11:07:40.664467 3177 status_update_manager_process.hpp:929] Checkpointing UPDATE for operation status update OPERATION_FINISHED (Status UUID: ca4a41e9-880e-4803-9de0-692467b07a5b) for operation UUID f278abc5-c0b8-4d74-afe5-8e67a411a648 on agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 I0218 11:07:40.722543 3177 status_update_manager_process.hpp:528] Forwarding operation status update OPERATION_FINISHED (Status UUID: ca4a41e9-880e-4803-9de0-692467b07a5b) for operation UUID f278abc5-c0b8-4d74-afe5-8e67a411a648 on agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 I0218 11:07:40.723023 3177 status_update_manager_process.hpp:252] Received operation status update acknowledgement (UUID: ba933a0f-7ae5-4764-8055-f8c4c77ab905) for stream fb5cd456-88d3-4c7c-a077-c77eab97d02b I0218 11:07:40.723114 3177 status_update_manager_process.hpp:929] Checkpointing ACK for operation status update OPERATION_FINISHED (Status UUID: ba933a0f-7ae5-4764-8055-f8c4c77ab905) for operation UUID fb5cd456-88d3-4c7c-a077-c77eab97d02b on agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 I0218 11:07:40.723462 3178 http_connection.hpp:131] Sending UPDATE_OPERATION_STATUS call to http://172.17.0.3:33135/slave(1239)/api/v1/resource_provider I0218 11:07:40.724503 3182 process.cpp:3671] Handling HTTP event for process 'slave(1239)' with path: '/slave(1239)/api/v1/resource_provider' I0218 11:07:40.769778 3172 http.cpp:1405] HTTP POST for /slave(1239)/api/v1/resource_provider from 172.17.0.3:42398 I0218 11:07:40.770710 3184 slave.cpp:8565] Handling resource provider message 'UPDATE_OPERATION_STATUS: (uuid: f278abc5-c0b8-4d74-afe5-8e67a411a648) for framework (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED)' I0218 11:07:40.770902 3184 slave.cpp:9018] Updating the state of operation with no ID (uuid: f278abc5-c0b8-4d74-afe5-8e67a411a648) for an operation API call (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED) I0218 11:07:40.770951 3184 slave.cpp:8772] Forwarding status update of operation with no ID (operation_uuid: f278abc5-c0b8-4d74-afe5-8e67a411a648) for an operator API call I0218 11:07:40.771302 3185 master.cpp:11262] Updating the state of operation '' (uuid: f278abc5-c0b8-4d74-afe5-8e67a411a648) for an operator API call (latest state: OPERATION_PENDING, status update state: OPERATION_FINISHED) I0218 11:07:40.771847 3178 slave.cpp:4434] Ignoring new checkpointed resources and operations identical to the current version I0218 11:07:40.773468 3172 provider.cpp:498] Received ACKNOWLEDGE_OPERATION_STATUS event I0218 11:07:40.806042 3177 status_update_manager_process.hpp:490] Cleaning up operation status update stream fb5cd456-88d3-4c7c-a077-c77eab97d02b I0218 11:07:40.806279 3177 status_update_manager_process.hpp:252] Received operation status update acknowledgement (UUID: ca4a41e9-880e-4803-9de0-692467b07a5b) for stream f278abc5-c0b8-4d74-afe5-8e67a411a648 I0218 11:07:40.806362 3177 status_update_manager_process.hpp:929] Checkpointing ACK for operation status update OPERATION_FINISHED (Status UUID: ca4a41e9-880e-4803-9de0-692467b07a5b) for operation UUID f278abc5-c0b8-4d74-afe5-8e67a411a648 on agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 I0218 11:07:40.851898 3177 status_update_manager_process.hpp:490] Cleaning up operation status update stream f278abc5-c0b8-4d74-afe5-8e67a411a648 I0218 11:07:40.914412 3171 process.cpp:3671] Handling HTTP event for process 'master' with path: '/master/api/v1' I0218 11:07:40.916577 3174 http.cpp:1405] HTTP POST for /master/api/v1 from 172.17.0.3:42406 I0218 11:07:40.916882 3174 http.cpp:277] Processing call DESTROY_VOLUMES I0218 11:07:40.917928 3174 master.cpp:3673] Authorizing principal 'test-principal' to perform action DESTROY_VOLUME on object {"value":"test-principal","resource":{"provider_id":{"value":"a4f67a65-bdbd-4dc8-b176-8546cb89ee5e"},"name":"disk","type":"SCALAR","scalar":{"value":2048.0},"reservations":[{"type":"DYNAMIC","role":"storage"},{"type":"DYNAMIC","role":"storage/default-role","principal":"test-principal"}],"disk":{"persistence":{"id":"c75311a0-ee53-4fe9-bb7c-774c72716adf","principal":"test-principal"},"volume":{"mode":"RW","container_path":"volume"},"source":{"type":"MOUNT","mount":{"root":"./csi/org.apache.mesos.csi.test/local/mounts"},"vendor":"org.apache.mesos.csi.test.local","id":"/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rjI5n7/2GB-74edc35d-edc5-43a1-a64f-7d922b7c8017","profile":"test"}}}} I0218 11:07:40.919821 3177 sched.cpp:960] Rescinded offer 12d259d9-8ecf-470c-bfce-e55cd73de4df-O4 I0218 11:07:40.919978 3177 sched.cpp:971] Scheduler::offerRescinded took 78384ns I0218 11:07:40.920542 3176 hierarchical.cpp:1576] Recovered ports(allocated: storage/default-role):[31000-32000]; disk(allocated: storage/default-role)(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rjI5n7/2GB-74edc35d-edc5-43a1-a64f-7d922b7c8017,test),c75311a0-ee53-4fe9-bb7c-774c72716adf:volume]:2048; cpus(allocated: storage/default-role):2; mem(allocated: storage/default-role):1024; disk(allocated: storage/default-role):1024 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rjI5n7/2GB-74edc35d-edc5-43a1-a64f-7d922b7c8017,test),c75311a0-ee53-4fe9-bb7c-774c72716adf:volume]:2048, offered or allocated: {}) on agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 from framework 12d259d9-8ecf-470c-bfce-e55cd73de4df-0000 I0218 11:07:40.920635 3181 master.cpp:11745] Removing offer 12d259d9-8ecf-470c-bfce-e55cd73de4df-O4 I0218 11:07:40.922755 3176 hierarchical.cpp:1625] Framework 12d259d9-8ecf-470c-bfce-e55cd73de4df-0000 filtered agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 for 5secs I0218 11:07:40.926357 3185 master.cpp:11610] Sending operation '' (uuid: 63c5f1aa-326e-4f75-9780-a168af9f6dca) to agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 at slave(1239)@172.17.0.3:33135 (7bf56466d523) I0218 11:07:40.926926 3186 slave.cpp:4434] Ignoring new checkpointed resources and operations identical to the current version I0218 11:07:40.930372 3183 provider.cpp:498] Received APPLY_OPERATION event I0218 11:07:40.930420 3183 provider.cpp:1351] Received DESTROY operation '' (uuid: 63c5f1aa-326e-4f75-9780-a168af9f6dca) I0218 11:07:40.934856 3171 hierarchical.cpp:1853] Performed allocation for 1 agents in 1.250889ms I0218 11:07:40.935678 3178 master.cpp:9453] Sending offers [ 12d259d9-8ecf-470c-bfce-e55cd73de4df-O5 ] to framework 12d259d9-8ecf-470c-bfce-e55cd73de4df-0000 (default) at [email protected]:33135 I0218 11:07:40.936455 3185 sched.cpp:934] Scheduler::resourceOffers took 91154ns I0218 11:07:41.046491 3175 status_update_manager_process.hpp:152] Received operation status update OPERATION_FINISHED (Status UUID: 4018fbed-cdc6-4291-9513-9def1d12c244) for operation UUID 63c5f1aa-326e-4f75-9780-a168af9f6dca on agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 I0218 11:07:41.046552 3175 status_update_manager_process.hpp:414] Creating operation status update stream 63c5f1aa-326e-4f75-9780-a168af9f6dca checkpoint=true I0218 11:07:41.046816 3175 status_update_manager_process.hpp:929] Checkpointing UPDATE for operation status update OPERATION_FINISHED (Status UUID: 4018fbed-cdc6-4291-9513-9def1d12c244) for operation UUID 63c5f1aa-326e-4f75-9780-a168af9f6dca on agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 I0218 11:07:41.123455 3175 status_update_manager_process.hpp:528] Forwarding operation status update OPERATION_FINISHED (Status UUID: 4018fbed-cdc6-4291-9513-9def1d12c244) for operation UUID 63c5f1aa-326e-4f75-9780-a168af9f6dca on agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 I0218 11:07:41.124300 3175 http_connection.hpp:131] Sending UPDATE_OPERATION_STATUS call to http://172.17.0.3:33135/slave(1239)/api/v1/resource_provider I0218 11:07:41.125211 3186 process.cpp:3671] Handling HTTP event for process 'slave(1239)' with path: '/slave(1239)/api/v1/resource_provider' I0218 11:07:41.128584 3181 process.cpp:3671] Handling HTTP event for process 'master' with path: '/master/api/v1' I0218 11:07:41.130740 3183 http.cpp:1405] HTTP POST for /master/api/v1 from 172.17.0.3:42408 I0218 11:07:41.131036 3183 http.cpp:277] Processing call UNRESERVE_RESOURCES I0218 11:07:41.131909 3183 master.cpp:3673] Authorizing principal 'test-principal' to perform action UNRESERVE_RESOURCES on object {"value":"test-principal","resource":{"provider_id":{"value":"a4f67a65-bdbd-4dc8-b176-8546cb89ee5e"},"name":"disk","type":"SCALAR","scalar":{"value":2048.0},"reservations":[{"type":"DYNAMIC","role":"storage"},{"type":"DYNAMIC","role":"storage/default-role","principal":"test-principal"}],"disk":{"source":{"type":"MOUNT","mount":{"root":"./csi/org.apache.mesos.csi.test/local/mounts"},"vendor":"org.apache.mesos.csi.test.local","id":"/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rjI5n7/2GB-74edc35d-edc5-43a1-a64f-7d922b7c8017","profile":"test"}}}} I0218 11:07:41.133255 3174 sched.cpp:960] Rescinded offer 12d259d9-8ecf-470c-bfce-e55cd73de4df-O5 I0218 11:07:41.133342 3174 sched.cpp:971] Scheduler::offerRescinded took 38822ns I0218 11:07:41.133754 3186 hierarchical.cpp:1576] Recovered ports(allocated: storage/default-role):[31000-32000]; disk(allocated: storage/default-role)(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rjI5n7/2GB-74edc35d-edc5-43a1-a64f-7d922b7c8017,test)]:2048; cpus(allocated: storage/default-role):2; mem(allocated: storage/default-role):1024; disk(allocated: storage/default-role):1024 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk(reservations: [(DYNAMIC,storage),(DYNAMIC,storage/default-role,test-principal)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rjI5n7/2GB-74edc35d-edc5-43a1-a64f-7d922b7c8017,test)]:2048, offered or allocated: {}) on agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 from framework 12d25 9d9-8ecf-470c-bfce-e55cd73de4df-0000 I0218 11:07:41.133849 3175 master.cpp:11745] Removing offer 12d259d9-8ecf-470c-bfce-e55cd73de4df-O5 I0218 11:07:41.135252 3186 hierarchical.cpp:1625] Framework 12d259d9-8ecf-470c-bfce-e55cd73de4df-0000 filtered agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 for 5secs I0218 11:07:41.137838 3177 master.cpp:11610] Sending operation '' (uuid: a1375ba4-3161-46af-9713-30ec1df620e0) to agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 at slave(1239)@172.17.0.3:33135 (7bf56466d523) I0218 11:07:41.138453 3176 slave.cpp:4434] Ignoring new checkpointed resources and operations identical to the current version I0218 11:07:41.141746 3172 provider.cpp:498] Received APPLY_OPERATION event I0218 11:07:41.141788 3172 provider.cpp:1351] Received UNRESERVE operation '' (uuid: a1375ba4-3161-46af-9713-30ec1df620e0) I0218 11:07:41.149503 3181 hierarchical.cpp:1853] Performed allocation for 1 agents in 1.315126ms I0218 11:07:41.150280 3185 master.cpp:9453] Sending offers [ 12d259d9-8ecf-470c-bfce-e55cd73de4df-O6 ] to framework 12d259d9-8ecf-470c-bfce-e55cd73de4df-0000 (default) at [email protected]:33135 I0218 11:07:41.150995 3182 sched.cpp:934] Scheduler::resourceOffers took 93325ns I0218 11:07:41.169656 3183 http.cpp:1405] HTTP POST for /slave(1239)/api/v1/resource_provider from 172.17.0.3:42398 I0218 11:07:41.170840 3175 slave.cpp:8565] Handling resource provider message 'UPDATE_OPERATION_STATUS: (uuid: 63c5f1aa-326e-4f75-9780-a168af9f6dca) for framework (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED)' I0218 11:07:41.171007 3175 slave.cpp:9018] Updating the state of operation with no ID (uuid: 63c5f1aa-326e-4f75-9780-a168af9f6dca) for an operation API call (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED) I0218 11:07:41.171052 3175 slave.cpp:8772] Forwarding status update of operation with no ID (operation_uuid: 63c5f1aa-326e-4f75-9780-a168af9f6dca) for an operator API call I0218 11:07:41.171360 3186 master.cpp:11262] Updating the state of operation '' (uuid: 63c5f1aa-326e-4f75-9780-a168af9f6dca) for an operator API call (latest state: OPERATION_PENDING, status update state: OPERATION_FINISHED) I0218 11:07:41.171945 3177 slave.cpp:4434] Ignoring new checkpointed resources and operations identical to the current version I0218 11:07:41.241444 3175 status_update_manager_process.hpp:152] Received operation status update OPERATION_FINISHED (Status UUID: d000f246-affc-4d66-88fa-f86b2dd360a0) for operation UUID a1375ba4-3161-46af-9713-30ec1df620e0 on agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 I0218 11:07:41.241500 3175 status_update_manager_process.hpp:414] Creating operation status update stream a1375ba4-3161-46af-9713-30ec1df620e0 checkpoint=true I0218 11:07:41.241498 3172 provider.cpp:498] Received ACKNOWLEDGE_OPERATION_STATUS event I0218 11:07:41.241750 3175 status_update_manager_process.hpp:929] Checkpointing UPDATE for operation status update OPERATION_FINISHED (Status UUID: d000f246-affc-4d66-88fa-f86b2dd360a0) for operation UUID a1375ba4-3161-46af-9713-30ec1df620e0 on agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 I0218 11:07:41.324997 3175 status_update_manager_process.hpp:528] Forwarding operation status update OPERATION_FINISHED (Status UUID: d000f246-affc-4d66-88fa-f86b2dd360a0) for operation UUID a1375ba4-3161-46af-9713-30ec1df620e0 on agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 I0218 11:07:41.325311 3175 status_update_manager_process.hpp:252] Received operation status update acknowledgement (UUID: 4018fbed-cdc6-4291-9513-9def1d12c244) for stream 63c5f1aa-326e-4f75-9780-a168af9f6dca I0218 11:07:41.325383 3175 status_update_manager_process.hpp:929] Checkpointing ACK for operation status update OPERATION_FINISHED (Status UUID: 4018fbed-cdc6-4291-9513-9def1d12c244) for operation UUID 63c5f1aa-326e-4f75-9780-a168af9f6dca on agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 I0218 11:07:41.325800 3186 http_connection.hpp:131] Sending UPDATE_OPERATION_STATUS call to http://172.17.0.3:33135/slave(1239)/api/v1/resource_provider I0218 11:07:41.326752 3185 process.cpp:3671] Handling HTTP event for process 'slave(1239)' with path: '/slave(1239)/api/v1/resource_provider' I0218 11:07:41.369773 3173 http.cpp:1405] HTTP POST for /slave(1239)/api/v1/resource_provider from 172.17.0.3:42398 I0218 11:07:41.370952 3176 slave.cpp:8565] Handling resource provider message 'UPDATE_OPERATION_STATUS: (uuid: a1375ba4-3161-46af-9713-30ec1df620e0) for framework (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED)' I0218 11:07:41.371162 3176 slave.cpp:9018] Updating the state of operation with no ID (uuid: a1375ba4-3161-46af-9713-30ec1df620e0) for an operation API call (latest state: OPERATION_FINISHED, status update state: OPERATION_FINISHED) I0218 11:07:41.371222 3176 slave.cpp:8772] Forwarding status update of operation with no ID (operation_uuid: a1375ba4-3161-46af-9713-30ec1df620e0) for an operator API call I0218 11:07:41.371639 3172 master.cpp:11262] Updating the state of operation '' (uuid: a1375ba4-3161-46af-9713-30ec1df620e0) for an operator API call (latest state: OPERATION_PENDING, status update state: OPERATION_FINISHED) I0218 11:07:41.372398 3186 slave.cpp:4434] Ignoring new checkpointed resources and operations identical to the current version I0218 11:07:41.374135 3174 provider.cpp:498] Received ACKNOWLEDGE_OPERATION_STATUS event I0218 11:07:41.396553 3175 status_update_manager_process.hpp:490] Cleaning up operation status update stream 63c5f1aa-326e-4f75-9780-a168af9f6dca I0218 11:07:41.396776 3175 status_update_manager_process.hpp:252] Received operation status update acknowledgement (UUID: d000f246-affc-4d66-88fa-f86b2dd360a0) for stream a1375ba4-3161-46af-9713-30ec1df620e0 I0218 11:07:41.396842 3175 status_update_manager_process.hpp:929] Checkpointing ACK for operation status update OPERATION_FINISHED (Status UUID: d000f246-affc-4d66-88fa-f86b2dd360a0) for operation UUID a1375ba4-3161-46af-9713-30ec1df620e0 on agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 I0218 11:07:41.455423 3175 status_update_manager_process.hpp:490] Cleaning up operation status update stream a1375ba4-3161-46af-9713-30ec1df620e0 I0218 11:07:41.515162 3183 master.cpp:1408] Framework 12d259d9-8ecf-470c-bfce-e55cd73de4df-0000 (default) at [email protected]:33135 disconnected I0218 11:07:41.515211 3183 master.cpp:3294] Deactivating framework 12d259d9-8ecf-470c-bfce-e55cd73de4df-0000 (default) at [email protected]:33135 I0218 11:07:41.515668 3184 hierarchical.cpp:813] Deactivated framework 12d259d9-8ecf-470c-bfce-e55cd73de4df-0000 I0218 11:07:41.515975 3173 slave.cpp:995] Agent terminating I0218 11:07:41.516459 3184 hierarchical.cpp:1576] Recovered ports(allocated: storage/default-role):[31000-32000]; disk(allocated: storage/default-role)(reservations: [(DYNAMIC,storage)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rjI5n7/2GB-74edc35d-edc5-43a1-a64f-7d922b7c8017,test)]:2048; cpus(allocated: storage/default-role):2; mem(allocated: storage/default-role):1024; disk(allocated: storage/default-role):1024 (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk(reservations: [(DYNAMIC,storage)])[MOUNT(org.apache.mesos.csi.test.local,/tmp/CSIVersion_StorageLocalResourceProviderTest_OperatorOperationsWithResourceProviderResources_v1_rjI5n7/2GB-74edc35d-edc5-43a1-a64f-7d922b7c8017,test)]:2048, offered or allocated: {}) on agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 from framework 12d259d9-8ecf-470c-bfce-e55cd73de4df-0000 I0218 11:07:41.516742 3183 master.cpp:11745] Removing offer 12d259d9-8ecf-470c-bfce-e55cd73de4df-O6 I0218 11:07:41.516867 3183 master.cpp:3278] Disconnecting framework 12d259d9-8ecf-470c-bfce-e55cd73de4df-0000 (default) at [email protected]:33135 I0218 11:07:41.516928 3173 manager.cpp:127] Terminating resource provider a4f67a65-bdbd-4dc8-b176-8546cb89ee5e I0218 11:07:41.517071 3183 master.cpp:1423] Giving framework 12d259d9-8ecf-470c-bfce-e55cd73de4df-0000 (default) at [email protected]:33135 0ns to failover I0218 11:07:41.517669 3171 master.cpp:1293] Agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 at slave(1239)@172.17.0.3:33135 (7bf56466d523) disconnected I0218 11:07:41.517716 3171 master.cpp:3329] Disconnecting agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 at slave(1239)@172.17.0.3:33135 (7bf56466d523) I0218 11:07:41.517837 3171 master.cpp:3348] Deactivating agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 at slave(1239)@172.17.0.3:33135 (7bf56466d523) E0218 11:07:41.517868 3175 http_connection.hpp:449] End-Of-File received I0218 11:07:41.518225 3182 master.cpp:9239] Framework failover timeout, removing framework 12d259d9-8ecf-470c-bfce-e55cd73de4df-0000 (default) at [email protected]:33135 I0218 11:07:41.518270 3182 master.cpp:10244] Removing framework 12d259d9-8ecf-470c-bfce-e55cd73de4df-0000 (default) at [email protected]:33135 I0218 11:07:41.518281 3175 http_connection.hpp:217] Re-detecting endpoint I0218 11:07:41.518793 3175 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0218 11:07:41.518846 3175 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0218 11:07:41.518904 3175 http_connection.hpp:227] New endpoint detected at http://172.17.0.3:33135/slave(1239)/api/v1/resource_provider I0218 11:07:41.518944 3173 provider.cpp:488] Disconnected from resource provider manager I0218 11:07:41.519011 3184 hierarchical.cpp:1156] Agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 deactivated I0218 11:07:41.519091 3176 status_update_manager_process.hpp:379] Pausing operation status update manager I0218 11:07:41.519160 3184 hierarchical.cpp:1777] Allocation paused I0218 11:07:41.519733 3184 hierarchical.cpp:757] Removed framework 12d259d9-8ecf-470c-bfce-e55cd73de4df-0000 I0218 11:07:41.519835 3184 hierarchical.cpp:1787] Allocation resumed I0218 11:07:41.520375 3172 containerizer.cpp:2619] Destroying container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE in RUNNING state I0218 11:07:41.520448 3172 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from RUNNING to DESTROYING after 2.55986112secs I0218 11:07:41.520963 3172 launcher.cpp:161] Asked to destroy container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0218 11:07:41.523514 3178 hierarchical.cpp:1853] Performed allocation for 1 agents in 164556ns I0218 11:07:41.523758 3183 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.3:33135/slave(1239)/api/v1/resource_provider I0218 11:07:41.524452 3173 provider.cpp:476] Connected to resource provider manager I0218 11:07:41.525089 3176 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.3:33135/slave(1239)/api/v1/resource_provider I0218 11:07:41.526049 3187 process.cpp:2781] Returning '404 Not Found' for '/slave(1239)/api/v1/resource_provider' E0218 11:07:41.527374 3184 provider.cpp:721] Failed to subscribe resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test': Received '404 Not Found' () I0218 11:07:41.575595 3174 hierarchical.cpp:1853] Performed allocation for 1 agents in 208879ns I0218 11:07:41.625864 3177 containerizer.cpp:3155] Container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE has exited I0218 11:07:41.627161 3185 hierarchical.cpp:1853] Performed allocation for 1 agents in 134138ns I0218 11:07:41.627660 3180 provisioner.cpp:652] Ignoring destroy request for unknown container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0218 11:07:41.630592 3176 container_daemon.cpp:189] Invoking post-stop hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0218 11:07:41.630872 3172 service_manager.cpp:723] Disconnected from endpoint 'unix:///tmp/mesos-csi-HIP4vy/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0218 11:07:41.631144 3180 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0218 11:07:41.634337 3187 process.cpp:2781] Returning '404 Not Found' for '/slave(1239)/api/v1' I0218 11:07:41.646168 3170 master.cpp:1141] Master terminating I0218 11:07:41.647058 3171 hierarchical.cpp:1132] Removed all filters for agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 I0218 11:07:41.647089 3171 hierarchical.cpp:1008] Removed agent 12d259d9-8ecf-470c-bfce-e55cd73de4df-S0 [ OK ] CSIVersion/StorageLocalResourceProviderTest.OperatorOperationsWithResourceProviderResources/v1 (2447 ms) [ RUN ] CSIVersion/StorageLocalResourceProviderTest.Update/v0 I0218 11:07:41.666005 3170 cluster.cpp:186] Creating default 'local' authorizer I0218 11:07:41.671473 3177 master.cpp:444] Master aac3d7fc-7f31-4db8-8f66-e0f0f2f1744b (7bf56466d523) started on 172.17.0.3:33135 I0218 11:07:41.671514 3177 master.cpp:447] Flags at startup: --acls="" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins" --allocation_interval="50ms" --allocator="hierarchical" --authenticate_agents="true" --authenticate_frameworks="true" --authenticate_http_frameworks="true" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authentication_v0_timeout="15secs" --authenticators="crammd5" --authorizers="local" --credentials="/tmp/h4uqIZ/credentials" --filter_gpu_resources="true" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_framework_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_operator_event_stream_subscribers="1000" --max_unreachable_tasks_per_framework="1000" --memory_profiling="false" --min_alloca table_resources="cpus:0.01|mem:32" --port="5050" --publish_per_framework_metrics="true" --quiet="false" --recovery_agent_removal_limit="100%" --registry="in_memory" --registry_fetch_timeout="1mins" --registry_gc_interval="15mins" --registry_max_agent_age="2weeks" --registry_max_agent_count="102400" --registry_store_timeout="100secs" --registry_strict="false" --require_agent_domain="false" --role_sorter="drf" --root_submissions="true" --version="false" --webui_dir="/tmp/SRC/build/mesos-1.10.0/_inst/share/mesos/webui" --work_dir="/tmp/h4uqIZ/master" --zk_session_timeout="10secs" I0218 11:07:41.672047 3177 master.cpp:496] Master only allowing authenticated frameworks to register I0218 11:07:41.672077 3177 master.cpp:502] Master only allowing authenticated agents to register I0218 11:07:41.672094 3177 master.cpp:508] Master only allowing authenticated HTTP frameworks to register I0218 11:07:41.672111 3177 credentials.hpp:37] Loading credentials for authentication from '/tmp/h4uqIZ/credentials' I0218 11:07:41.672471 3177 master.cpp:552] Using default 'crammd5' authenticator I0218 11:07:41.672744 3177 http.cpp:1265] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readonly' I0218 11:07:41.673044 3177 http.cpp:1265] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readwrite' I0218 11:07:41.673296 3177 http.cpp:1265] Creating default 'basic' HTTP authenticator for realm 'mesos-master-scheduler' I0218 11:07:41.673542 3177 master.cpp:633] Authorization enabled I0218 11:07:41.674084 3183 hierarchical.cpp:567] Initialized hierarchical allocator process I0218 11:07:41.674146 3172 whitelist_watcher.cpp:77] No whitelist given I0218 11:07:41.678035 3173 master.cpp:2166] Elected as the leading master! I0218 11:07:41.678071 3173 master.cpp:1662] Recovering from registrar I0218 11:07:41.678264 3186 registrar.cpp:339] Recovering registrar I0218 11:07:41.678994 3186 registrar.cpp:383] Successfully fetched the registry (0B) in 0ns I0218 11:07:41.679116 3186 registrar.cpp:487] Applied 1 operations in 35358ns; attempting to update the registry I0218 11:07:41.679738 3186 registrar.cpp:544] Successfully updated the registry in 0ns I0218 11:07:41.679930 3186 registrar.cpp:416] Successfully recovered registrar I0218 11:07:41.680395 3186 master.cpp:1815] Recovered 0 agents from the registry (144B); allowing 10mins for agents to reregister I0218 11:07:41.680501 3177 hierarchical.cpp:606] Skipping recovery of hierarchical allocator: nothing to recover W0218 11:07:41.685894 3170 process.cpp:2877] Attempted to spawn already running process [email protected]:33135 I0218 11:07:41.687327 3170 containerizer.cpp:317] Using isolation { environment_secret, posix/cpu, posix/mem, filesystem/posix, network/cni } W0218 11:07:41.687932 3170 backend.cpp:76] Failed to create 'overlay' backend: OverlayBackend requires root privileges W0218 11:07:41.687959 3170 backend.cpp:76] Failed to create 'aufs' backend: AufsBackend requires root privileges W0218 11:07:41.687974 3170 backend.cpp:76] Failed to create 'bind' backend: BindBackend requires root privileges I0218 11:07:41.688004 3170 provisioner.cpp:294] Using default backend 'copy' I0218 11:07:41.690428 3170 cluster.cpp:533] Creating default 'local' authorizer I0218 11:07:41.692785 3185 slave.cpp:274] Mesos agent started on (1240)@172.17.0.3:33135 I0218 11:07:41.692816 3185 slave.cpp:275] Flags at startup: --acls="" --appc_simple_discovery_uri_prefix="http://"; --appc_store_dir="/tmp/h4uqIZ/PTRqYm/store/appc" --authenticate_http_readonly="true" --authenticate_http_readwrite="false" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authentication_timeout_max="1mins" --authentication_timeout_min="5secs" --authorizer="local" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_destroy_timeout="1mins" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="mesos" --credential="/tmp/h4uqIZ/PTRqYm/credential" --default_role="*" --disallow_sharing_agent_ipc_namespace="false" --disallow_sharing_agent_pid_namespace="false" --disk_profile_adaptor="org_apache_mesos_UriDiskProfileAdaptor" --disk_watch_interval="1mins" --docker="docker" --docker_ignore_runtime="false" --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io"; --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/h4uqIZ/PTRqYm/store/docker" --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume" --docker_volume_chown="false" --enforce_container_disk_quota="false" --executor_registration_timeout="1mins" --executor_reregistration_timeout="2secs" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/h4uqIZ/PTRqYm/fetch" --fetcher_cache_size="2GB" --fetcher_stall_timeout="1mins" --frameworks_home="/tmp/h4uqIZ/PTRqYm/frameworks" --gc_delay="1weeks" --gc_disk_headroom="0.1" --gc_non_executor_container_sandboxes="false" --help="false" --hostname_lookup="true" --http_command_executor="false" --http_credentials="/tmp/h4uqIZ/PTRqYm/http_credentials" --http_executor_domain_sockets="false" --http_heartbeat_interval="30secs" --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem" --launcher="posi x" --launcher_dir="/tmp/SRC/build/mesos-1.10.0/_build/sub/src" --logbufsecs="0" --logging_level="INFO" --max_completed_executors_per_framework="150" --memory_profiling="false" --network_cni_metrics="true" --network_cni_root_dir_persist="false" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns" --quiet="false" --reconfiguration_policy="equal" --recover="reconnect" --recovery_timeout="15mins" --registration_backoff_factor="10ms" --resource_provider_config_dir="/tmp/h4uqIZ/resource_provider_configs" --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]" --revocable_cpu_low_priority="true" --runtime_dir="/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_F7b18L" --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true" --systemd_enable_support="true" --systemd_runtime_directory="/run/systemd/system" --version="false" --work_dir="/tmp/CSIVersion_StorageLoca lResourceProviderTest_Update_v0_FqcCjb" --zk_session_timeout="10secs" I0218 11:07:41.693454 3185 credentials.hpp:86] Loading credential for authentication from '/tmp/h4uqIZ/PTRqYm/credential' I0218 11:07:41.693620 3185 slave.cpp:307] Agent using credential for: test-principal I0218 11:07:41.693648 3185 credentials.hpp:37] Loading credentials for authentication from '/tmp/h4uqIZ/PTRqYm/http_credentials' I0218 11:07:41.693902 3185 http.cpp:1265] Creating default 'basic' HTTP authenticator for realm 'mesos-agent-readonly' I0218 11:07:41.694371 3185 disk_profile_adaptor.cpp:82] Creating disk profile adaptor module 'org_apache_mesos_UriDiskProfileAdaptor' I0218 11:07:41.696177 3180 uri_disk_profile_adaptor.cpp:305] Updated disk profile mapping to 1 active profiles I0218 11:07:41.696144 3185 slave.cpp:622] Agent resources: [{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}] I0218 11:07:41.696425 3185 slave.cpp:630] Agent attributes: [ ] I0218 11:07:41.696445 3185 slave.cpp:639] Agent hostname: 7bf56466d523 I0218 11:07:41.696630 3175 status_update_manager_process.hpp:379] Pausing operation status update manager I0218 11:07:41.696666 3173 task_status_update_manager.cpp:181] Pausing sending task status updates I0218 11:07:41.698527 3178 state.cpp:68] Recovering state from '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_FqcCjb/meta' I0218 11:07:41.698858 3184 slave.cpp:7574] Finished recovering checkpointed state from '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_FqcCjb/meta', beginning agent recovery I0218 11:07:41.699525 3179 task_status_update_manager.cpp:207] Recovering task status update manager I0218 11:07:41.700152 3186 containerizer.cpp:820] Recovering Mesos containers I0218 11:07:41.700562 3186 containerizer.cpp:1160] Recovering isolators I0218 11:07:41.701684 3182 containerizer.cpp:1199] Recovering provisioner I0218 11:07:41.702117 3179 hierarchical.cpp:1853] Performed allocation for 0 agents in 100394ns I0218 11:07:41.702615 3179 provisioner.cpp:518] Provisioner recovery complete I0218 11:07:41.703832 3178 composing.cpp:339] Finished recovering all containerizers I0218 11:07:41.704210 3180 slave.cpp:8056] Recovering executors I0218 11:07:41.704331 3180 slave.cpp:8209] Finished recovery I0218 11:07:41.705152 3182 task_status_update_manager.cpp:181] Pausing sending task status updates I0218 11:07:41.705207 3184 status_update_manager_process.hpp:379] Pausing operation status update manager I0218 11:07:41.705230 3180 slave.cpp:1422] New master detected at [email protected]:33135 I0218 11:07:41.705379 3180 slave.cpp:1487] Detecting new master I0218 11:07:41.709933 3177 slave.cpp:1514] Authenticating with master [email protected]:33135 I0218 11:07:41.710077 3177 slave.cpp:1523] Using default CRAM-MD5 authenticatee I0218 11:07:41.710428 3171 authenticatee.cpp:121] Creating new client SASL connection I0218 11:07:41.710763 3174 master.cpp:9638] Authenticating slave(1240)@172.17.0.3:33135 I0218 11:07:41.710974 3175 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(2092)@172.17.0.3:33135 I0218 11:07:41.711357 3181 authenticator.cpp:98] Creating new server SASL connection I0218 11:07:41.711606 3186 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 I0218 11:07:41.711642 3186 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' I0218 11:07:41.711762 3186 authenticator.cpp:204] Received SASL authentication start I0218 11:07:41.711858 3186 authenticator.cpp:326] Authentication requires more steps I0218 11:07:41.712007 3173 authenticatee.cpp:259] Received SASL authentication step I0218 11:07:41.712182 3173 authenticator.cpp:232] Received SASL authentication step I0218 11:07:41.712226 3173 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '7bf56466d523' server FQDN: '7bf56466d523' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false I0218 11:07:41.712246 3173 auxprop.cpp:181] Looking up auxiliary property '*userPassword' I0218 11:07:41.712314 3173 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' I0218 11:07:41.712368 3173 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '7bf56466d523' server FQDN: '7bf56466d523' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true I0218 11:07:41.712389 3173 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true I0218 11:07:41.712404 3173 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true I0218 11:07:41.712441 3173 authenticator.cpp:318] Authentication success I0218 11:07:41.712576 3172 authenticatee.cpp:299] Authentication success I0218 11:07:41.712720 3176 master.cpp:9670] Successfully authenticated principal 'test-principal' at slave(1240)@172.17.0.3:33135 I0218 11:07:41.712735 3173 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(2092)@172.17.0.3:33135 I0218 11:07:41.713110 3182 slave.cpp:1614] Successfully authenticated with master [email protected]:33135 I0218 11:07:41.713608 3182 slave.cpp:2064] Will retry registration in 6.79136ms if necessary I0218 11:07:41.713867 3171 master.cpp:6144] Received register agent message from slave(1240)@172.17.0.3:33135 (7bf56466d523) I0218 11:07:41.714303 3171 master.cpp:3673] Authorizing principal 'test-principal' to perform action REGISTER_AGENT on ANY object I0218 11:07:41.714963 3178 master.cpp:6211] Authorized registration of agent at slave(1240)@172.17.0.3:33135 (7bf56466d523) I0218 11:07:41.715073 3178 master.cpp:6323] Registering agent at slave(1240)@172.17.0.3:33135 (7bf56466d523) with id aac3d7fc-7f31-4db8-8f66-e0f0f2f1744b-S0 I0218 11:07:41.715950 3183 registrar.cpp:487] Applied 1 operations in 323170ns; attempting to update the registry I0218 11:07:41.716773 3183 registrar.cpp:544] Successfully updated the registry in 742912ns I0218 11:07:41.717018 3177 master.cpp:6371] Admitted agent aac3d7fc-7f31-4db8-8f66-e0f0f2f1744b-S0 at slave(1240)@172.17.0.3:33135 (7bf56466d523) I0218 11:07:41.717854 3177 master.cpp:6416] Registered agent aac3d7fc-7f31-4db8-8f66-e0f0f2f1744b-S0 at slave(1240)@172.17.0.3:33135 (7bf56466d523) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0218 11:07:41.718020 3172 slave.cpp:1647] Registered with master [email protected]:33135; given agent ID aac3d7fc-7f31-4db8-8f66-e0f0f2f1744b-S0 I0218 11:07:41.718170 3171 task_status_update_manager.cpp:188] Resuming sending task status updates I0218 11:07:41.718194 3182 hierarchical.cpp:959] Added agent aac3d7fc-7f31-4db8-8f66-e0f0f2f1744b-S0 (7bf56466d523) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] (offered or allocated: {}) I0218 11:07:41.718529 3172 slave.cpp:1682] Checkpointing SlaveInfo to '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_FqcCjb/meta/slaves/aac3d7fc-7f31-4db8-8f66-e0f0f2f1744b-S0/slave.info' I0218 11:07:41.718595 3174 status_update_manager_process.hpp:385] Resuming operation status update manager I0218 11:07:41.718596 3182 hierarchical.cpp:1853] Performed allocation for 1 agents in 157923ns I0218 11:07:41.719871 3172 slave.cpp:1734] Forwarding agent update {"operations":{},"resource_providers":{},"resource_version_uuid":{"value":"Q2qCuHExSMie+icnj3bzSQ=="},"slave_id":{"value":"aac3d7fc-7f31-4db8-8f66-e0f0f2f1744b-S0"},"update_oversubscribed_resources":false} I0218 11:07:41.722800 3172 master.cpp:7554] Ignoring update on agent aac3d7fc-7f31-4db8-8f66-e0f0f2f1744b-S0 at slave(1240)@172.17.0.3:33135 (7bf56466d523) as it reports no changes I0218 11:07:41.728193 3184 process.cpp:3671] Handling HTTP event for process 'slave(1240)' with path: '/slave(1240)/api/v1' I0218 11:07:41.730159 3183 http.cpp:1405] HTTP POST for /slave(1240)/api/v1 from 172.17.0.3:42416 I0218 11:07:41.730787 3183 http.cpp:2146] Processing GET_CONTAINERS call I0218 11:07:41.753430 3183 hierarchical.cpp:1853] Performed allocation for 1 agents in 205067ns I0218 11:07:41.756284 3177 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0218 11:07:41.759076 3185 process.cpp:3671] Handling HTTP event for process 'slave(1240)' with path: '/slave(1240)/api/v1' I0218 11:07:41.760486 3182 http.cpp:1405] HTTP POST for /slave(1240)/api/v1 from 172.17.0.3:42418 I0218 11:07:41.761345 3182 http.cpp:2606] Processing LAUNCH_CONTAINER call for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0218 11:07:41.762450 3172 http.cpp:2710] Creating sandbox '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_FqcCjb/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0218 11:07:41.768497 3179 containerizer.cpp:1395] Starting container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0218 11:07:41.769119 3179 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from STARTING to PROVISIONING after 276736ns I0218 11:07:41.769917 3179 containerizer.cpp:1573] Checkpointed ContainerConfig at '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_F7b18L/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE/config' I0218 11:07:41.769973 3179 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from PROVISIONING to PREPARING after 855296ns I0218 11:07:41.773293 3186 containerizer.cpp:2099] Launching 'mesos-containerizer' with flags '--help="false" --launch_info="{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v0","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_fE3duA","--available_capacity=0B","--volumes=","--forward=unix:///tmp/h4uqIZ/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"environment":{"variables":[{"name":"MESOS_SANDBOX","type":"VALUE","value":"/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_FqcCjb/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE"},{"name":"CSI_ENDPOINT","type":"VALUE","value":"unix:///tmp/mesos-csi-g1wQOK/endpoint.sock"}]},"task_environment":{},"working_directory":"/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_FqcCjb/containers/o rg-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE"}" --pipe_read="112" --pipe_write="113" --runtime_directory="/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_F7b18L/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE" --unshare_namespace_mnt="false"' I0218 11:07:41.782344 3186 launcher.cpp:145] Forked child with pid '14719' for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0218 11:07:41.783186 3186 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from PREPARING to ISOLATING after 13.20704ms I0218 11:07:41.785100 3175 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from ISOLATING to FETCHING after 1.810944ms I0218 11:07:41.785480 3185 fetcher.cpp:369] Starting to fetch URIs for container: org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE, directory: /tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_FqcCjb/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0218 11:07:41.786871 3178 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from FETCHING to RUNNING after 1.793024ms I0218 11:07:41.789898 3179 container_daemon.cpp:140] Invoking post-start hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0218 11:07:41.790213 3171 service_manager.cpp:703] Connecting to endpoint 'unix:///tmp/mesos-csi-g1wQOK/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0218 11:07:41.804986 3174 hierarchical.cpp:1853] Performed allocation for 1 agents in 217821ns I0218 11:07:41.855895 3183 hierarchical.cpp:1853] Performed allocation for 1 agents in 215885ns I0218 11:07:41.907377 3171 hierarchical.cpp:1853] Performed allocation for 1 agents in 106438ns I0218 11:07:41.958722 3182 hierarchical.cpp:1853] Performed allocation for 1 agents in 140637ns I0218 11:07:42.010363 3186 hierarchical.cpp:1853] Performed allocation for 1 agents in 177832ns I0218 11:07:42.061554 3176 hierarchical.cpp:1853] Performed allocation for 1 agents in 215804ns I0218 11:07:42.112974 3177 hierarchical.cpp:1853] Performed allocation for 1 agents in 205431ns I0218 11:07:42.122444 3186 service_manager.cpp:545] Probing endpoint 'unix:///tmp/mesos-csi-g1wQOK/endpoint.sock' with CSI v1 I0218 11:07:42.124512 3173 service_manager.cpp:532] Probing endpoint 'unix:///tmp/mesos-csi-g1wQOK/endpoint.sock' with CSI v0 I0218 11:07:42.125398 14723 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Identity/Probe call I0218 11:07:42.128396 3184 container_daemon.cpp:171] Waiting for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0218 11:07:42.130877 14723 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Identity/GetPluginCapabilities call I0218 11:07:42.131850 3186 process.cpp:3671] Handling HTTP event for process 'slave(1240)' with path: '/slave(1240)/api/v1' I0218 11:07:42.132863 3178 http.cpp:1405] HTTP POST for /slave(1240)/api/v1 from 172.17.0.3:42420 I0218 11:07:42.133406 3178 http.cpp:2824] Processing WAIT_CONTAINER call for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0218 11:07:42.134936 14723 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Identity/GetPluginInfo call I0218 11:07:42.135203 14723 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Identity/GetPluginInfo call I0218 11:07:42.136920 3175 v0_volume_manager.cpp:628] NODE_SERVICE loaded: {} I0218 11:07:42.137413 3175 v0_volume_manager.cpp:628] CONTROLLER_SERVICE loaded: {} I0218 11:07:42.139259 14723 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/ControllerGetCapabilities call I0218 11:07:42.142760 14723 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Node/NodeGetCapabilities call I0218 11:07:42.146045 14723 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Node/NodeGetId call I0218 11:07:42.148346 3176 provider.cpp:676] Recovered resources '{}' and 0 operations for resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test' I0218 11:07:42.148497 3183 status_update_manager_process.hpp:379] Pausing operation status update manager I0218 11:07:42.148907 3178 http_connection.hpp:227] New endpoint detected at http://172.17.0.3:33135/slave(1240)/api/v1/resource_provider I0218 11:07:42.151759 3174 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.3:33135/slave(1240)/api/v1/resource_provider I0218 11:07:42.152423 3182 provider.cpp:476] Connected to resource provider manager I0218 11:07:42.153034 3184 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.3:33135/slave(1240)/api/v1/resource_provider I0218 11:07:42.154105 3178 process.cpp:3671] Handling HTTP event for process 'slave(1240)' with path: '/slave(1240)/api/v1/resource_provider' I0218 11:07:42.155905 3181 http.cpp:1405] HTTP POST for /slave(1240)/api/v1/resource_provider from 172.17.0.3:42424 I0218 11:07:42.156661 3179 manager.cpp:779] Subscribing resource provider {"default_reservations":[{"role":"storage","type":"DYNAMIC"}],"name":"test","storage":{"plugin":{"containers":[{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v0","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_fE3duA","--available_capacity=0B","--volumes=","--forward=unix:///tmp/h4uqIZ/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"resources":[{"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"}],"services":["CONTROLLER_SERVICE","NODE_SERVICE"]}],"name":"local","type":"org.apache.mesos.csi.test"},"reconciliation_interval_seconds":15.0},"type":"org.apache.mesos.rp.local.storage"} I0218 11:07:42.164499 3176 hierarchical.cpp:1853] Performed allocation for 1 agents in 170195ns I0218 11:07:42.183470 3186 slave.cpp:8565] Handling resource provider message 'SUBSCRIBE: {"default_reservations":[{"role":"storage","type":"DYNAMIC"}],"id":{"value":"7ae0c5f9-8208-482b-a76b-e1b4c4228c7a"},"name":"test","storage":{"plugin":{"containers":[{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v0","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v0_fE3duA","--available_capacity=0B","--volumes=","--forward=unix:///tmp/h4uqIZ/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"resources":[{"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"}],"services":["CONTROLLER_SERVICE","NODE_SERVICE"]}],"name":"local","type":"org.apache.mesos.csi.test"},"reconciliation_interval_seconds":15.0},"type":"org.apache.mesos.rp.local.storage"}' I0218 11:07:42.185124 3184 provider.cpp:498] Received SUBSCRIBED event I0218 11:07:42.185181 3184 provider.cpp:1309] Subscribed with ID 7ae0c5f9-8208-482b-a76b-e1b4c4228c7a I0218 11:07:42.185856 3183 status_update_manager_process.hpp:314] Recovering operation status update manager I0218 11:07:42.216137 3174 hierarchical.cpp:1853] Performed allocation for 1 agents in 127231ns I0218 11:07:42.231585 3176 provider.cpp:790] Reconciling storage pools and volumes I0218 11:07:42.233813 14723 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/ListVolumes call I0218 11:07:42.237008 3173 provider.cpp:2217] Sending UPDATE_STATE call with resources '{}' and 0 operations to agent aac3d7fc-7f31-4db8-8f66-e0f0f2f1744b-S0 I0218 11:07:42.237341 3173 provider.cpp:748] Resource provider 7ae0c5f9-8208-482b-a76b-e1b4c4228c7a is in READY state I0218 11:07:42.237339 3176 http_connection.hpp:131] Sending UPDATE_STATE call to http://172.17.0.3:33135/slave(1240)/api/v1/resource_provider I0218 11:07:42.237390 3180 status_update_manager_process.hpp:385] Resuming operation status update manager I0218 11:07:42.238050 3181 provider.cpp:1235] Updating profiles { test } for resource provider 7ae0c5f9-8208-482b-a76b-e1b4c4228c7a I0218 11:07:42.238433 3175 process.cpp:3671] Handling HTTP event for process 'slave(1240)' with path: '/slave(1240)/api/v1/resource_provider' I0218 11:07:42.239212 3186 provider.cpp:790] Reconciling storage pools and volumes I0218 11:07:42.240080 3172 http.cpp:1405] HTTP POST for /slave(1240)/api/v1/resource_provider from 172.17.0.3:42422 I0218 11:07:42.240626 3174 manager.cpp:1011] Received UPDATE_STATE call with resources '[]' and 0 operations from resource provider 7ae0c5f9-8208-482b-a76b-e1b4c4228c7a I0218 11:07:42.240816 3175 slave.cpp:8565] Handling resource provider message 'UPDATE_STATE: 7ae0c5f9-8208-482b-a76b-e1b4c4228c7a {}' I0218 11:07:42.240909 3175 slave.cpp:8685] Forwarding new total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0218 11:07:42.241180 14723 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/ListVolumes call I0218 11:07:42.241632 14723 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/GetCapacity call I0218 11:07:42.242605 3181 hierarchical.cpp:1110] Grew agent aac3d7fc-7f31-4db8-8f66-e0f0f2f1744b-S0 by {} (total), { } (used) I0218 11:07:42.243134 3181 hierarchical.cpp:1067] Agent aac3d7fc-7f31-4db8-8f66-e0f0f2f1744b-S0 (7bf56466d523) updated with total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0218 11:07:42.248265 3185 hierarchical.cpp:1853] Performed allocation for 1 agents in 233753ns I0218 11:07:42.248561 3173 provider.cpp:790] Reconciling storage pools and volumes I0218 11:07:42.250805 14723 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/ListVolumes call I0218 11:07:42.251294 14723 test_csi_plugin.cpp:1915] Forwarding /csi.v0.Controller/GetCapacity call I0218 11:07:42.261770 3172 slave.cpp:995] Agent terminating I0218 11:07:42.262814 3172 manager.cpp:127] Terminating resource provider 7ae0c5f9-8208-482b-a76b-e1b4c4228c7a I0218 11:07:42.263408 3176 master.cpp:1293] Agent aac3d7fc-7f31-4db8-8f66-e0f0f2f1744b-S0 at slave(1240)@172.17.0.3:33135 (7bf56466d523) disconnected I0218 11:07:42.263453 3176 master.cpp:3329] Disconnecting agent aac3d7fc-7f31-4db8-8f66-e0f0f2f1744b-S0 at slave(1240)@172.17.0.3:33135 (7bf56466d523) I0218 11:07:42.263566 3176 master.cpp:3348] Deactivating agent aac3d7fc-7f31-4db8-8f66-e0f0f2f1744b-S0 at slave(1240)@172.17.0.3:33135 (7bf56466d523) I0218 11:07:42.263720 3173 hierarchical.cpp:1156] Agent aac3d7fc-7f31-4db8-8f66-e0f0f2f1744b-S0 deactivated E0218 11:07:42.263839 3173 http_connection.hpp:449] End-Of-File received I0218 11:07:42.264330 3173 http_connection.hpp:217] Re-detecting endpoint I0218 11:07:42.264789 3173 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0218 11:07:42.264865 3173 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0218 11:07:42.264907 3172 provider.cpp:488] Disconnected from resource provider manager I0218 11:07:42.264935 3173 http_connection.hpp:227] New endpoint detected at http://172.17.0.3:33135/slave(1240)/api/v1/resource_provider I0218 11:07:42.265115 3183 status_update_manager_process.hpp:379] Pausing operation status update manager I0218 11:07:42.266388 3178 containerizer.cpp:2619] Destroying container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE in RUNNING state I0218 11:07:42.266463 3178 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from RUNNING to DESTROYING after 15.479674112secs I0218 11:07:42.266911 3178 launcher.cpp:161] Asked to destroy container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0218 11:07:42.267827 3182 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.3:33135/slave(1240)/api/v1/resource_provider I0218 11:07:42.268471 3176 provider.cpp:476] Connected to resource provider manager I0218 11:07:42.269325 3186 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.3:33135/slave(1240)/api/v1/resource_provider I0218 11:07:42.270185 3187 process.cpp:2781] Returning '404 Not Found' for '/slave(1240)/api/v1/resource_provider' E0218 11:07:42.271551 3180 provider.cpp:721] Failed to subscribe resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test': Received '404 Not Found' () I0218 11:07:42.294761 3172 hierarchical.cpp:1853] Performed allocation for 1 agents in 224165ns I0218 11:07:42.344739 3179 containerizer.cpp:3155] Container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE has exited I0218 11:07:42.346294 3177 hierarchical.cpp:1853] Performed allocation for 1 agents in 162348ns I0218 11:07:42.346650 3185 provisioner.cpp:652] Ignoring destroy request for unknown container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0218 11:07:42.349215 3171 container_daemon.cpp:189] Invoking post-stop hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0218 11:07:42.349438 3180 service_manager.cpp:723] Disconnected from endpoint 'unix:///tmp/mesos-csi-g1wQOK/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0218 11:07:42.349737 3177 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0218 11:07:42.352412 3187 process.cpp:2781] Returning '404 Not Found' for '/slave(1240)/api/v1' I0218 11:07:42.365226 3170 master.cpp:1141] Master terminating I0218 11:07:42.365595 3177 hierarchical.cpp:1132] Removed all filters for agent aac3d7fc-7f31-4db8-8f66-e0f0f2f1744b-S0 I0218 11:07:42.365628 3177 hierarchical.cpp:1008] Removed agent aac3d7fc-7f31-4db8-8f66-e0f0f2f1744b-S0 [ OK ] CSIVersion/StorageLocalResourceProviderTest.Update/v0 (714 ms) [ RUN ] CSIVersion/StorageLocalResourceProviderTest.Update/v1 I0218 11:07:42.381455 3170 cluster.cpp:186] Creating default 'local' authorizer I0218 11:07:42.385998 3181 master.cpp:444] Master e84acff5-1094-4cb3-bbbd-12395494f5b5 (7bf56466d523) started on 172.17.0.3:33135 I0218 11:07:42.386029 3181 master.cpp:447] Flags at startup: --acls="" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins" --allocation_interval="50ms" --allocator="hierarchical" --authenticate_agents="true" --authenticate_frameworks="true" --authenticate_http_frameworks="true" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authentication_v0_timeout="15secs" --authenticators="crammd5" --authorizers="local" --credentials="/tmp/ywjqSn/credentials" --filter_gpu_resources="true" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_framework_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_operator_event_stream_subscribers="1000" --max_unreachable_tasks_per_framework="1000" --memory_profiling="false" --min_alloca table_resources="cpus:0.01|mem:32" --port="5050" --publish_per_framework_metrics="true" --quiet="false" --recovery_agent_removal_limit="100%" --registry="in_memory" --registry_fetch_timeout="1mins" --registry_gc_interval="15mins" --registry_max_agent_age="2weeks" --registry_max_agent_count="102400" --registry_store_timeout="100secs" --registry_strict="false" --require_agent_domain="false" --role_sorter="drf" --root_submissions="true" --version="false" --webui_dir="/tmp/SRC/build/mesos-1.10.0/_inst/share/mesos/webui" --work_dir="/tmp/ywjqSn/master" --zk_session_timeout="10secs" I0218 11:07:42.386354 3181 master.cpp:496] Master only allowing authenticated frameworks to register I0218 11:07:42.386368 3181 master.cpp:502] Master only allowing authenticated agents to register I0218 11:07:42.386375 3181 master.cpp:508] Master only allowing authenticated HTTP frameworks to register I0218 11:07:42.386384 3181 credentials.hpp:37] Loading credentials for authentication from '/tmp/ywjqSn/credentials' I0218 11:07:42.386634 3181 master.cpp:552] Using default 'crammd5' authenticator I0218 11:07:42.386831 3181 http.cpp:1265] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readonly' I0218 11:07:42.387063 3181 http.cpp:1265] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readwrite' I0218 11:07:42.387270 3181 http.cpp:1265] Creating default 'basic' HTTP authenticator for realm 'mesos-master-scheduler' I0218 11:07:42.387468 3181 master.cpp:633] Authorization enabled I0218 11:07:42.387825 3171 hierarchical.cpp:567] Initialized hierarchical allocator process I0218 11:07:42.387908 3186 whitelist_watcher.cpp:77] No whitelist given I0218 11:07:42.390630 3183 master.cpp:2166] Elected as the leading master! I0218 11:07:42.390707 3183 master.cpp:1662] Recovering from registrar I0218 11:07:42.390971 3172 registrar.cpp:339] Recovering registrar I0218 11:07:42.392133 3172 registrar.cpp:383] Successfully fetched the registry (0B) in 0ns I0218 11:07:42.392324 3172 registrar.cpp:487] Applied 1 operations in 66413ns; attempting to update the registry I0218 11:07:42.393232 3172 registrar.cpp:544] Successfully updated the registry in 0ns I0218 11:07:42.393414 3172 registrar.cpp:416] Successfully recovered registrar I0218 11:07:42.393991 3171 master.cpp:1815] Recovered 0 agents from the registry (144B); allowing 10mins for agents to reregister I0218 11:07:42.394001 3180 hierarchical.cpp:606] Skipping recovery of hierarchical allocator: nothing to recover W0218 11:07:42.399509 3170 process.cpp:2877] Attempted to spawn already running process [email protected]:33135 I0218 11:07:42.400882 3170 containerizer.cpp:317] Using isolation { environment_secret, posix/cpu, posix/mem, filesystem/posix, network/cni } W0218 11:07:42.401454 3170 backend.cpp:76] Failed to create 'overlay' backend: OverlayBackend requires root privileges W0218 11:07:42.401480 3170 backend.cpp:76] Failed to create 'aufs' backend: AufsBackend requires root privileges W0218 11:07:42.401497 3170 backend.cpp:76] Failed to create 'bind' backend: BindBackend requires root privileges I0218 11:07:42.401531 3170 provisioner.cpp:294] Using default backend 'copy' I0218 11:07:42.404045 3170 cluster.cpp:533] Creating default 'local' authorizer I0218 11:07:42.406352 3176 slave.cpp:274] Mesos agent started on (1241)@172.17.0.3:33135 I0218 11:07:42.406378 3176 slave.cpp:275] Flags at startup: --acls="" --appc_simple_discovery_uri_prefix="http://"; --appc_store_dir="/tmp/ywjqSn/W0GwCS/store/appc" --authenticate_http_readonly="true" --authenticate_http_readwrite="false" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authentication_timeout_max="1mins" --authentication_timeout_min="5secs" --authorizer="local" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_destroy_timeout="1mins" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="mesos" --credential="/tmp/ywjqSn/W0GwCS/credential" --default_role="*" --disallow_sharing_agent_ipc_namespace="false" --disallow_sharing_agent_pid_namespace="false" --disk_profile_adaptor="org_apache_mesos_UriDiskProfileAdaptor" --disk_watch_interval="1mins" --docker="docker" --docker_ignore_runtime="false" --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io"; --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/ywjqSn/W0GwCS/store/docker" --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume" --docker_volume_chown="false" --enforce_container_disk_quota="false" --executor_registration_timeout="1mins" --executor_reregistration_timeout="2secs" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/ywjqSn/W0GwCS/fetch" --fetcher_cache_size="2GB" --fetcher_stall_timeout="1mins" --frameworks_home="/tmp/ywjqSn/W0GwCS/frameworks" --gc_delay="1weeks" --gc_disk_headroom="0.1" --gc_non_executor_container_sandboxes="false" --help="false" --hostname_lookup="true" --http_command_executor="false" --http_credentials="/tmp/ywjqSn/W0GwCS/http_credentials" --http_executor_domain_sockets="false" --http_heartbeat_interval="30secs" --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem" --launcher="posi x" --launcher_dir="/tmp/SRC/build/mesos-1.10.0/_build/sub/src" --logbufsecs="0" --logging_level="INFO" --max_completed_executors_per_framework="150" --memory_profiling="false" --network_cni_metrics="true" --network_cni_root_dir_persist="false" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns" --quiet="false" --reconfiguration_policy="equal" --recover="reconnect" --recovery_timeout="15mins" --registration_backoff_factor="10ms" --resource_provider_config_dir="/tmp/ywjqSn/resource_provider_configs" --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]" --revocable_cpu_low_priority="true" --runtime_dir="/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_WkfdVf" --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true" --systemd_enable_support="true" --systemd_runtime_directory="/run/systemd/system" --version="false" --work_dir="/tmp/CSIVersion_StorageLoca lResourceProviderTest_Update_v1_SgnUdD" --zk_session_timeout="10secs" I0218 11:07:42.406801 3176 credentials.hpp:86] Loading credential for authentication from '/tmp/ywjqSn/W0GwCS/credential' I0218 11:07:42.406939 3176 slave.cpp:307] Agent using credential for: test-principal I0218 11:07:42.406968 3176 credentials.hpp:37] Loading credentials for authentication from '/tmp/ywjqSn/W0GwCS/http_credentials' I0218 11:07:42.407184 3176 http.cpp:1265] Creating default 'basic' HTTP authenticator for realm 'mesos-agent-readonly' I0218 11:07:42.407582 3176 disk_profile_adaptor.cpp:82] Creating disk profile adaptor module 'org_apache_mesos_UriDiskProfileAdaptor' I0218 11:07:42.409858 3181 uri_disk_profile_adaptor.cpp:305] Updated disk profile mapping to 1 active profiles I0218 11:07:42.410137 3176 slave.cpp:622] Agent resources: [{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}] I0218 11:07:42.410423 3176 slave.cpp:630] Agent attributes: [ ] I0218 11:07:42.410441 3176 slave.cpp:639] Agent hostname: 7bf56466d523 I0218 11:07:42.410637 3183 task_status_update_manager.cpp:181] Pausing sending task status updates I0218 11:07:42.410693 3185 status_update_manager_process.hpp:379] Pausing operation status update manager I0218 11:07:42.412668 3178 state.cpp:68] Recovering state from '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_SgnUdD/meta' I0218 11:07:42.412916 3184 slave.cpp:7574] Finished recovering checkpointed state from '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_SgnUdD/meta', beginning agent recovery I0218 11:07:42.413720 3186 task_status_update_manager.cpp:207] Recovering task status update manager I0218 11:07:42.414309 3171 containerizer.cpp:820] Recovering Mesos containers I0218 11:07:42.414686 3171 containerizer.cpp:1160] Recovering isolators I0218 11:07:42.415740 3179 containerizer.cpp:1199] Recovering provisioner I0218 11:07:42.416821 3186 provisioner.cpp:518] Provisioner recovery complete I0218 11:07:42.417616 3182 composing.cpp:339] Finished recovering all containerizers I0218 11:07:42.417938 3173 slave.cpp:8056] Recovering executors I0218 11:07:42.418072 3173 slave.cpp:8209] Finished recovery I0218 11:07:42.418617 3183 hierarchical.cpp:1853] Performed allocation for 0 agents in 143982ns I0218 11:07:42.418850 3178 task_status_update_manager.cpp:181] Pausing sending task status updates I0218 11:07:42.418879 3181 status_update_manager_process.hpp:379] Pausing operation status update manager I0218 11:07:42.418956 3184 slave.cpp:1422] New master detected at [email protected]:33135 I0218 11:07:42.419144 3184 slave.cpp:1487] Detecting new master I0218 11:07:42.426532 3175 slave.cpp:1514] Authenticating with master [email protected]:33135 I0218 11:07:42.426642 3175 slave.cpp:1523] Using default CRAM-MD5 authenticatee I0218 11:07:42.426995 3176 authenticatee.cpp:121] Creating new client SASL connection I0218 11:07:42.427325 3185 master.cpp:9638] Authenticating slave(1241)@172.17.0.3:33135 I0218 11:07:42.427529 3180 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(2093)@172.17.0.3:33135 I0218 11:07:42.427913 3182 authenticator.cpp:98] Creating new server SASL connection I0218 11:07:42.428143 3171 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 I0218 11:07:42.428184 3171 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' I0218 11:07:42.428321 3171 authenticator.cpp:204] Received SASL authentication start I0218 11:07:42.428396 3171 authenticator.cpp:326] Authentication requires more steps I0218 11:07:42.428604 3172 authenticatee.cpp:259] Received SASL authentication step I0218 11:07:42.428797 3179 authenticator.cpp:232] Received SASL authentication step I0218 11:07:42.428838 3179 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '7bf56466d523' server FQDN: '7bf56466d523' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false I0218 11:07:42.428854 3179 auxprop.cpp:181] Looking up auxiliary property '*userPassword' I0218 11:07:42.428906 3179 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' I0218 11:07:42.428941 3179 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '7bf56466d523' server FQDN: '7bf56466d523' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true I0218 11:07:42.428964 3179 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true I0218 11:07:42.428977 3179 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true I0218 11:07:42.429000 3179 authenticator.cpp:318] Authentication success I0218 11:07:42.429142 3174 authenticatee.cpp:299] Authentication success I0218 11:07:42.429278 3178 master.cpp:9670] Successfully authenticated principal 'test-principal' at slave(1241)@172.17.0.3:33135 I0218 11:07:42.429342 3183 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(2093)@172.17.0.3:33135 I0218 11:07:42.429782 3179 slave.cpp:1614] Successfully authenticated with master [email protected]:33135 I0218 11:07:42.430264 3179 slave.cpp:2064] Will retry registration in 9.01623ms if necessary I0218 11:07:42.430461 3185 master.cpp:6144] Received register agent message from slave(1241)@172.17.0.3:33135 (7bf56466d523) I0218 11:07:42.430915 3185 master.cpp:3673] Authorizing principal 'test-principal' to perform action REGISTER_AGENT on ANY object I0218 11:07:42.431496 3173 master.cpp:6211] Authorized registration of agent at slave(1241)@172.17.0.3:33135 (7bf56466d523) I0218 11:07:42.431609 3173 master.cpp:6323] Registering agent at slave(1241)@172.17.0.3:33135 (7bf56466d523) with id e84acff5-1094-4cb3-bbbd-12395494f5b5-S0 I0218 11:07:42.432636 3172 registrar.cpp:487] Applied 1 operations in 453443ns; attempting to update the registry I0218 11:07:42.433631 3172 registrar.cpp:544] Successfully updated the registry in 911104ns I0218 11:07:42.433864 3175 master.cpp:6371] Admitted agent e84acff5-1094-4cb3-bbbd-12395494f5b5-S0 at slave(1241)@172.17.0.3:33135 (7bf56466d523) I0218 11:07:42.434747 3175 master.cpp:6416] Registered agent e84acff5-1094-4cb3-bbbd-12395494f5b5-S0 at slave(1241)@172.17.0.3:33135 (7bf56466d523) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0218 11:07:42.434897 3178 slave.cpp:1647] Registered with master [email protected]:33135; given agent ID e84acff5-1094-4cb3-bbbd-12395494f5b5-S0 I0218 11:07:42.435051 3180 task_status_update_manager.cpp:188] Resuming sending task status updates I0218 11:07:42.435087 3177 hierarchical.cpp:959] Added agent e84acff5-1094-4cb3-bbbd-12395494f5b5-S0 (7bf56466d523) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] (offered or allocated: {}) I0218 11:07:42.435418 3178 slave.cpp:1682] Checkpointing SlaveInfo to '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_SgnUdD/meta/slaves/e84acff5-1094-4cb3-bbbd-12395494f5b5-S0/slave.info' I0218 11:07:42.435495 3185 status_update_manager_process.hpp:385] Resuming operation status update manager I0218 11:07:42.435516 3177 hierarchical.cpp:1853] Performed allocation for 1 agents in 181802ns I0218 11:07:42.436830 3178 slave.cpp:1734] Forwarding agent update {"operations":{},"resource_providers":{},"resource_version_uuid":{"value":"pbk3uwkCR1afvevCXL5o5A=="},"slave_id":{"value":"e84acff5-1094-4cb3-bbbd-12395494f5b5-S0"},"update_oversubscribed_resources":false} I0218 11:07:42.437710 3186 master.cpp:7554] Ignoring update on agent e84acff5-1094-4cb3-bbbd-12395494f5b5-S0 at slave(1241)@172.17.0.3:33135 (7bf56466d523) as it reports no changes I0218 11:07:42.442499 3174 process.cpp:3671] Handling HTTP event for process 'slave(1241)' with path: '/slave(1241)/api/v1' I0218 11:07:42.443787 3186 http.cpp:1405] HTTP POST for /slave(1241)/api/v1 from 172.17.0.3:42432 I0218 11:07:42.444322 3186 http.cpp:2146] Processing GET_CONTAINERS call I0218 11:07:42.450258 3186 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0218 11:07:42.453081 3179 process.cpp:3671] Handling HTTP event for process 'slave(1241)' with path: '/slave(1241)/api/v1' I0218 11:07:42.454174 3181 http.cpp:1405] HTTP POST for /slave(1241)/api/v1 from 172.17.0.3:42434 I0218 11:07:42.454792 3181 http.cpp:2606] Processing LAUNCH_CONTAINER call for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0218 11:07:42.455687 3178 http.cpp:2710] Creating sandbox '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_SgnUdD/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0218 11:07:42.470247 3175 hierarchical.cpp:1853] Performed allocation for 1 agents in 176487ns I0218 11:07:42.477990 3184 containerizer.cpp:1395] Starting container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0218 11:07:42.478675 3184 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from STARTING to PROVISIONING after 274944ns I0218 11:07:42.479539 3184 containerizer.cpp:1573] Checkpointed ContainerConfig at '/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_WkfdVf/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE/config' I0218 11:07:42.479602 3184 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from PROVISIONING to PREPARING after 929024ns I0218 11:07:42.483274 3171 containerizer.cpp:2099] Launching 'mesos-containerizer' with flags '--help="false" --launch_info="{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v1","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_slrCw0","--available_capacity=0B","--volumes=","--forward=unix:///tmp/ywjqSn/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"environment":{"variables":[{"name":"MESOS_SANDBOX","type":"VALUE","value":"/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_SgnUdD/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE"},{"name":"CSI_ENDPOINT","type":"VALUE","value":"unix:///tmp/mesos-csi-KSJJQn/endpoint.sock"}]},"task_environment":{},"working_directory":"/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_SgnUdD/containers/o rg-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE"}" --pipe_read="110" --pipe_write="111" --runtime_directory="/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_WkfdVf/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE" --unshare_namespace_mnt="false"' I0218 11:07:42.493024 3171 launcher.cpp:145] Forked child with pid '14734' for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0218 11:07:42.493978 3171 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from PREPARING to ISOLATING after 14.365952ms I0218 11:07:42.495642 3171 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from ISOLATING to FETCHING after 1.662976ms I0218 11:07:42.496039 3185 fetcher.cpp:369] Starting to fetch URIs for container: org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE, directory: /tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_SgnUdD/containers/org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0218 11:07:42.521791 3183 hierarchical.cpp:1853] Performed allocation for 1 agents in 279238ns I0218 11:07:42.537436 3177 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from FETCHING to RUNNING after 41.771264ms I0218 11:07:42.539742 3175 container_daemon.cpp:140] Invoking post-start hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0218 11:07:42.539980 3179 service_manager.cpp:703] Connecting to endpoint 'unix:///tmp/mesos-csi-KSJJQn/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0218 11:07:42.573029 3177 hierarchical.cpp:1853] Performed allocation for 1 agents in 218537ns I0218 11:07:42.624585 3180 hierarchical.cpp:1853] Performed allocation for 1 agents in 203588ns I0218 11:07:42.675856 3185 hierarchical.cpp:1853] Performed allocation for 1 agents in 165047ns I0218 11:07:42.727177 3180 hierarchical.cpp:1853] Performed allocation for 1 agents in 141039ns I0218 11:07:42.778678 3179 hierarchical.cpp:1853] Performed allocation for 1 agents in 180612ns I0218 11:07:42.829900 3172 hierarchical.cpp:1853] Performed allocation for 1 agents in 179794ns I0218 11:07:42.881642 3186 hierarchical.cpp:1853] Performed allocation for 1 agents in 214615ns I0218 11:07:42.892235 3171 service_manager.cpp:545] Probing endpoint 'unix:///tmp/mesos-csi-KSJJQn/endpoint.sock' with CSI v1 I0218 11:07:42.894054 14738 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Identity/Probe call I0218 11:07:42.896953 3177 container_daemon.cpp:171] Waiting for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0218 11:07:42.899539 14738 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Identity/GetPluginCapabilities call I0218 11:07:42.900256 3184 process.cpp:3671] Handling HTTP event for process 'slave(1241)' with path: '/slave(1241)/api/v1' I0218 11:07:42.901499 3185 http.cpp:1405] HTTP POST for /slave(1241)/api/v1 from 172.17.0.3:42436 I0218 11:07:42.902096 3185 http.cpp:2824] Processing WAIT_CONTAINER call for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0218 11:07:42.903762 14738 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Identity/GetPluginInfo call I0218 11:07:42.904158 14738 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Identity/GetPluginInfo call I0218 11:07:42.905730 3182 v1_volume_manager.cpp:649] NODE_SERVICE loaded: {} I0218 11:07:42.906234 3182 v1_volume_manager.cpp:649] CONTROLLER_SERVICE loaded: {} I0218 11:07:42.908147 14738 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/ControllerGetCapabilities call I0218 11:07:42.911717 14738 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Node/NodeGetCapabilities call I0218 11:07:42.915002 14738 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Node/NodeGetInfo call I0218 11:07:42.917289 3173 provider.cpp:676] Recovered resources '{}' and 0 operations for resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test' I0218 11:07:42.917426 3181 status_update_manager_process.hpp:379] Pausing operation status update manager I0218 11:07:42.917780 3176 http_connection.hpp:227] New endpoint detected at http://172.17.0.3:33135/slave(1241)/api/v1/resource_provider I0218 11:07:42.920589 3177 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.3:33135/slave(1241)/api/v1/resource_provider I0218 11:07:42.921404 3183 provider.cpp:476] Connected to resource provider manager I0218 11:07:42.922062 3181 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.3:33135/slave(1241)/api/v1/resource_provider I0218 11:07:42.923158 3185 process.cpp:3671] Handling HTTP event for process 'slave(1241)' with path: '/slave(1241)/api/v1/resource_provider' I0218 11:07:42.924849 3180 http.cpp:1405] HTTP POST for /slave(1241)/api/v1/resource_provider from 172.17.0.3:42440 I0218 11:07:42.925566 3184 manager.cpp:779] Subscribing resource provider {"default_reservations":[{"role":"storage","type":"DYNAMIC"}],"name":"test","storage":{"plugin":{"containers":[{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v1","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_slrCw0","--available_capacity=0B","--volumes=","--forward=unix:///tmp/ywjqSn/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"resources":[{"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"}],"services":["CONTROLLER_SERVICE","NODE_SERVICE"]}],"name":"local","type":"org.apache.mesos.csi.test"},"reconciliation_interval_seconds":15.0},"type":"org.apache.mesos.rp.local.storage"} I0218 11:07:42.933648 3176 hierarchical.cpp:1853] Performed allocation for 1 agents in 192554ns I0218 11:07:42.952239 3178 slave.cpp:8565] Handling resource provider message 'SUBSCRIBE: {"default_reservations":[{"role":"storage","type":"DYNAMIC"}],"id":{"value":"ef1fdbad-d153-48ad-b95b-e9dc7eea17ab"},"name":"test","storage":{"plugin":{"containers":[{"command":{"arguments":["/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin","--api_version=v1","--work_dir=/tmp/CSIVersion_StorageLocalResourceProviderTest_Update_v1_slrCw0","--available_capacity=0B","--volumes=","--forward=unix:///tmp/ywjqSn/mock_csi.sock","--create_parameters=","--volume_metadata="],"shell":false,"value":"/tmp/SRC/build/mesos-1.10.0/_build/sub/src/test-csi-plugin"},"resources":[{"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"}],"services":["CONTROLLER_SERVICE","NODE_SERVICE"]}],"name":"local","type":"org.apache.mesos.csi.test"},"reconciliation_interval_seconds":15.0},"type":"org.apache.mesos.rp.local.storage"}' I0218 11:07:42.953896 3182 provider.cpp:498] Received SUBSCRIBED event I0218 11:07:42.953944 3182 provider.cpp:1309] Subscribed with ID ef1fdbad-d153-48ad-b95b-e9dc7eea17ab I0218 11:07:42.954774 3176 status_update_manager_process.hpp:314] Recovering operation status update manager I0218 11:07:42.984925 3172 hierarchical.cpp:1853] Performed allocation for 1 agents in 152472ns I0218 11:07:43.018635 3174 provider.cpp:790] Reconciling storage pools and volumes I0218 11:07:43.021013 14738 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/ListVolumes call I0218 11:07:43.023388 3178 provider.cpp:2217] Sending UPDATE_STATE call with resources '{}' and 0 operations to agent e84acff5-1094-4cb3-bbbd-12395494f5b5-S0 I0218 11:07:43.023617 3174 http_connection.hpp:131] Sending UPDATE_STATE call to http://172.17.0.3:33135/slave(1241)/api/v1/resource_provider I0218 11:07:43.023715 3178 provider.cpp:748] Resource provider ef1fdbad-d153-48ad-b95b-e9dc7eea17ab is in READY state I0218 11:07:43.023797 3171 status_update_manager_process.hpp:385] Resuming operation status update manager I0218 11:07:43.024384 3183 provider.cpp:1235] Updating profiles { test } for resource provider ef1fdbad-d153-48ad-b95b-e9dc7eea17ab I0218 11:07:43.024766 3177 process.cpp:3671] Handling HTTP event for process 'slave(1241)' with path: '/slave(1241)/api/v1/resource_provider' I0218 11:07:43.025269 3185 provider.cpp:790] Reconciling storage pools and volumes I0218 11:07:43.026727 3173 http.cpp:1405] HTTP POST for /slave(1241)/api/v1/resource_provider from 172.17.0.3:42438 I0218 11:07:43.027513 3173 manager.cpp:1011] Received UPDATE_STATE call with resources '[]' and 0 operations from resource provider ef1fdbad-d153-48ad-b95b-e9dc7eea17ab I0218 11:07:43.027730 14738 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/ListVolumes call I0218 11:07:43.027763 3175 slave.cpp:8565] Handling resource provider message 'UPDATE_STATE: ef1fdbad-d153-48ad-b95b-e9dc7eea17ab {}' I0218 11:07:43.027909 3175 slave.cpp:8685] Forwarding new total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0218 11:07:43.028124 14738 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/GetCapacity call I0218 11:07:43.029933 3171 hierarchical.cpp:1110] Grew agent e84acff5-1094-4cb3-bbbd-12395494f5b5-S0 by {} (total), { } (used) I0218 11:07:43.030328 3171 hierarchical.cpp:1067] Agent e84acff5-1094-4cb3-bbbd-12395494f5b5-S0 (7bf56466d523) updated with total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0218 11:07:43.033774 3178 hierarchical.cpp:1853] Performed allocation for 1 agents in 205967ns I0218 11:07:43.033911 3171 provider.cpp:790] Reconciling storage pools and volumes I0218 11:07:43.035931 14738 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/ListVolumes call I0218 11:07:43.036432 14738 test_csi_plugin.cpp:1915] Forwarding /csi.v1.Controller/GetCapacity call I0218 11:07:43.046855 3183 slave.cpp:995] Agent terminating I0218 11:07:43.047700 3183 manager.cpp:127] Terminating resource provider ef1fdbad-d153-48ad-b95b-e9dc7eea17ab I0218 11:07:43.048205 3173 master.cpp:1293] Agent e84acff5-1094-4cb3-bbbd-12395494f5b5-S0 at slave(1241)@172.17.0.3:33135 (7bf56466d523) disconnected I0218 11:07:43.048259 3173 master.cpp:3329] Disconnecting agent e84acff5-1094-4cb3-bbbd-12395494f5b5-S0 at slave(1241)@172.17.0.3:33135 (7bf56466d523) I0218 11:07:43.048374 3173 master.cpp:3348] Deactivating agent e84acff5-1094-4cb3-bbbd-12395494f5b5-S0 at slave(1241)@172.17.0.3:33135 (7bf56466d523) I0218 11:07:43.048553 3181 hierarchical.cpp:1156] Agent e84acff5-1094-4cb3-bbbd-12395494f5b5-S0 deactivated E0218 11:07:43.048655 3181 http_connection.hpp:449] End-Of-File received I0218 11:07:43.049067 3181 http_connection.hpp:217] Re-detecting endpoint I0218 11:07:43.049491 3181 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0218 11:07:43.049552 3181 http_connection.hpp:338] Ignoring disconnection attempt from stale connection I0218 11:07:43.049615 3181 http_connection.hpp:227] New endpoint detected at http://172.17.0.3:33135/slave(1241)/api/v1/resource_provider I0218 11:07:43.049690 3183 provider.cpp:488] Disconnected from resource provider manager I0218 11:07:43.049813 3183 status_update_manager_process.hpp:379] Pausing operation status update manager I0218 11:07:43.051014 3184 containerizer.cpp:2619] Destroying container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE in RUNNING state I0218 11:07:43.051075 3184 containerizer.cpp:3317] Transitioning the state of container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE from RUNNING to DESTROYING after 15.513672704secs I0218 11:07:43.051461 3184 launcher.cpp:161] Asked to destroy container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0218 11:07:43.052773 3183 http_connection.hpp:283] Connected with the remote endpoint at http://172.17.0.3:33135/slave(1241)/api/v1/resource_provider I0218 11:07:43.053301 3180 provider.cpp:476] Connected to resource provider manager I0218 11:07:43.053911 3176 http_connection.hpp:131] Sending SUBSCRIBE call to http://172.17.0.3:33135/slave(1241)/api/v1/resource_provider I0218 11:07:43.054708 3187 process.cpp:2781] Returning '404 Not Found' for '/slave(1241)/api/v1/resource_provider' E0218 11:07:43.055845 3178 provider.cpp:721] Failed to subscribe resource provider with type 'org.apache.mesos.rp.local.storage' and name 'test': Received '404 Not Found' () I0218 11:07:43.080974 3175 hierarchical.cpp:1853] Performed allocation for 1 agents in 185125ns I0218 11:07:43.131076 3179 containerizer.cpp:3155] Container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE has exited I0218 11:07:43.132339 3172 hierarchical.cpp:1853] Performed allocation for 1 agents in 139921ns I0218 11:07:43.132547 3179 provisioner.cpp:652] Ignoring destroy request for unknown container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0218 11:07:43.134902 3176 container_daemon.cpp:189] Invoking post-stop hook for container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0218 11:07:43.135115 3178 service_manager.cpp:723] Disconnected from endpoint 'unix:///tmp/mesos-csi-KSJJQn/endpoint.sock' of CSI plugin container org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE I0218 11:07:43.135330 3184 container_daemon.cpp:121] Launching container 'org-apache-mesos-rp-local-storage-test--org-apache-mesos-csi-test-local--CONTROLLER_SERVICE-NODE_SERVICE' I0218 11:07:43.137886 3187 process.cpp:2781] Returning '404 Not Found' for '/slave(1241)/api/v1' I0218 11:07:43.147797 3170 master.cpp:1141] Master terminating I0218 11:07:43.148180 3184 hierarchical.cpp:1132] Removed all filters for agent e84acff5-1094-4cb3-bbbd-12395494f5b5-S0 I0218 11:07:43.148211 3184 hierarchical.cpp:1008] Removed agent e84acff5-1094-4cb3-bbbd-12395494f5b5-S0 [ OK ] CSIVersion/StorageLocalResourceProviderTest.Update/v1 (780 ms) [----------] 54 tests from CSIVersion/StorageLocalResourceProviderTest (95655 ms total) [----------] Global test environment tear-down [==========] 2311 tests from 222 test cases ran. (1138561 ms total) [ PASSED ] 2310 tests. [ FAILED ] 1 test, listed below: [ FAILED ] OversubscriptionTest.FixedResourceEstimator 1 FAILED TEST YOU HAVE 34 DISABLED TESTS I0218 11:07:43.235538 3187 process.cpp:935] Stopped the socket accept loop Makefile:15957: recipe for target 'check-local' failed make[4]: *** [check-local] Error 1 make[4]: Leaving directory '/tmp/SRC/build/mesos-1.10.0/_build/sub/src' Makefile:15073: recipe for target 'check-am' failed make[3]: *** [check-am] Error 2 make[3]: Leaving directory '/tmp/SRC/build/mesos-1.10.0/_build/sub/src' Makefile:15077: recipe for target 'check' failed make[2]: *** [check] Error 2 make[2]: Leaving directory '/tmp/SRC/build/mesos-1.10.0/_build/sub/src' Makefile:791: recipe for target 'check-recursive' failed make[1]: *** [check-recursive] Error 1 make[1]: Leaving directory '/tmp/SRC/build/mesos-1.10.0/_build/sub' Makefile:997: recipe for target 'distcheck' failed make: *** [distcheck] Error 1 Untagged: mesos/mesos-build:ubuntu-16.04 Untagged: mesos/mesos-build@sha256:fa967cbcfb44f55708a3cbc87f245c6d29dd891464db558af56a03ee321526bb Deleted: sha256:e895c0531b9a9a288fabe479a49f7059aed83645351ac99ec2ea2616822c9f97 Deleted: sha256:09119b0b314a69ba6ec6251f2e89f4199fe1e874c84f9abf07dcbd23dbc3f1c1 Deleted: sha256:562fe6af5a3883058be9c784a839392215ed4185a21d21f1d99df0d17f3ae6e7 Deleted: sha256:0dcdfbe322a4f332f73ac70905d557300ec6dae3bd19586758772c750c7b4a19 Deleted: sha256:c66652d605f01094e2db53d62505dbd524e076d5aa69b89d5e620003803eb149 Deleted: sha256:a2cf79bfb9593c05fd7142ddb49afef77ea4ad5d2464e841f09fe62ffee396e0 Deleted: sha256:f7a904214b390f39d98573882f631dc908df8b2b540cf04e1062f8182c1efffd Deleted: sha256:ce1f6fcaa83dfce189d76e08f184085732eab4eeb2562d2399953958405c5bec Deleted: sha256:cce92fda689ab9033f0b8db214bc63edd1ae3e05831a0f3a9418976d7dc7ccdd Deleted: sha256:d22094bbd65447c59a42c580eaa3a44cee9cd855f00905f59409be21bcefc745 Deleted: sha256:b8976847450013f3eb5e9a81a5778f73ed7bef67e6393049712ef17102b4b7b7 Deleted: sha256:b8c891f0ffec910a12757d733b178e3f62d81dbbde2b31d3b754071c416108ed Full log: https://builds.apache.org/job/Mesos-Reviewbot-Linux/7308/console - Mesos Reviewbot On Feb. 12, 2020, 6 p.m., Andrei Sekretenko wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/72099/ > ----------------------------------------------------------- > > (Updated Feb. 12, 2020, 6 p.m.) > > > Review request for mesos, Benjamin Mahler and Greg Mann. > > > Bugs: MESOS-10056 > https://issues.apache.org/jira/browse/MESOS-10056 > > > Repository: mesos > > > Description > ------- > > Now that ACCEPT is authorized synchronously, there are no pending > tasks in-between dispatches on `Master` methods, thus the pending task > tracking code is not needed anymore. > > > Diffs > ----- > > include/mesos/master/master.proto 8c22802625c80c7fcd64d947b693ab4f5d069142 > include/mesos/v1/master/master.proto > 40de3580681fbb066d8f49c5df8d0c97cd766703 > src/master/http.cpp eeaac88c893b43170e655f8bff1d57dd0f7bbfb2 > src/master/master.hpp c813e9fc855cfb1701ec32be7f690e06b6eb203f > src/master/master.cpp d41ae724ba12b5ad1c8ae3c1f9b91a05b0e46e7e > src/master/readonly_handler.cpp 40005a2ac2cc9dd6075425c184d220f0a2fbee99 > src/master/validation.hpp b2897132a6bfaa1002663d6aea0fb87246b3d8d8 > src/master/validation.cpp 2f80536dd3810180385351765965ed6211d372c7 > src/tests/master_validation_tests.cpp > e92ff5913ea43f50b0895d7a2b2dd0efd7361083 > > > Diff: https://reviews.apache.org/r/72099/diff/2/ > > > Testing > ------- > > > Thanks, > > Andrei Sekretenko > >
