I am unable to provision instances including systemvm-templates on xenserver SR’s that are configured with the thin attribute specified. I created 2 SR’s as seen below. The thin SR produces “Invalid Session Cookie”. If I re-create the SR not thin provisioned there are no issues. This error is produced during the copy of the systemvm template from secondary storage. Is this configuration not supported? These LUN’s are on the same SAN, the only difference I can see is the sm-config:allocation=thin attribute set at the time of SR creation. Any help would be appreciated. (Cloudstack 4.4.1/Xenserver 6.2SP1)
[root@xen01 log]# xe sr-param-list uuid=5e728b55-690c-1208-d42b-3c2b5b80cc22 uuid ( RO) : 5e728b55-690c-1208-d42b-3c2b5b80cc22 name-label ( RW): VNX5400CVG_ZC_CS_XEN_1 name-description ( RW): host ( RO): xen01.z01p2.us.east.cvg.cs.zimcom.net allowed-operations (SRO): VDI.create; VDI.snapshot; PBD.create; PBD.destroy; plug; update; VDI.destroy; scan; VDI.clone; VDI.resize; unplug current-operations (SRO): VDIs (SRO): PBDs (SRO): b55ea29c-21e0-f9fa-64f5-a0422f8afa02 virtual-allocation ( RO): 0 physical-utilisation ( RO): 8388608 physical-size ( RO): 1099499044864 type ( RO): lvmohba content-type ( RO): user shared ( RW): true introduced-by ( RO): <not in database> other-config (MRW): sm-config (MRO): allocation: thin; use_vhd: true; multipathable: true; devserial: scsi-36006016057613600e17993d17f75e411 blobs ( RO): local-cache-enabled ( RO): false tags (SRW): [root@xen01 log]# xe sr-param-list uuid=76824440-4d85-227c-0f1a-3917d0a7ea36 uuid ( RO) : 76824440-4d85-227c-0f1a-3917d0a7ea36 name-label ( RW): VNX5400CVG_ZC_CS_XEN_2 name-description ( RW): Hardware HBA SR [DGC - APM00135175725] host ( RO): xen01.z01p2.us.east.cvg.cs.zimcom.net allowed-operations (SRO): VDI.create; VDI.snapshot; PBD.create; PBD.destroy; plug; update; VDI.destroy; scan; VDI.clone; VDI.resize; unplug current-operations (SRO): VDIs (SRO): PBDs (SRO): 9cab320a-fc4f-c046-7c36-0ba42eea52b1 virtual-allocation ( RO): 0 physical-utilisation ( RO): 4194304 physical-size ( RO): 1099499044864 type ( RO): lvmohba content-type ( RO): shared ( RW): true introduced-by ( RO): <not in database> other-config (MRW): auto-scan: false sm-config (MRO): allocation: thick; use_vhd: true; multipathable: true; devserial: scsi-36006016057613600ce87f64b1a77e411 blobs ( RO): local-cache-enabled ( RO): false tags (SRW): (Xenserver /var/log/messages) Nov 28 10:39:30 xen01 xapi: [ info|xen01.lab.zimcom.net<http://xen01.lab.zimcom.net>|219547 INET 0.0.0.0:80|sm_exec D:6eb88541a744|xapi] Session.create trackid=56714e29817e260dfe98bb3964ffae56 pool=false uname= is_local_superuser=true auth_user_sid= parent=trackid=9834f5af41c964e225f24279aefe4e49 Nov 28 10:39:30 xen01 vhd-util: libvhd::vhd_validate_footer: invalid footer cookie: < Nov 28 10:39:30 xen01 vhd-util: libvhd::vhd_read_footer_at: /dev/VG_XenStorage-5e728b55-690c-1208-d42b-3c2b5b80cc22/VHD-4c0d0407-326a-4a5a-bac6-04ea9ba6ea9e: reading footer at 0x007ffe00 failed: -22 Nov 28 10:39:30 xen01 vhd-util: libvhd::vhd_read: /dev/VG_XenStorage-5e728b55-690c-1208-d42b-3c2b5b80cc22/VHD-4c0d0407-326a-4a5a-bac6-04ea9ba6ea9e: read of 512 returned 0, errno: -22 Nov 28 10:39:30 xen01 vhd-util: libvhd::vhd_validate_footer: invalid footer cookie: (Management Server Log) 2014-11-28 10:39:32,648 DEBUG [c.c.a.ApiServlet] (catalina-exec-12:ctx-11bf6733) ===START=== 172.23.0.1 -- GET command=queryAsyncJobResult&jobId=8271b914-7ef4-4e2d-a20e-7cc261abed16&response=json&sessionkey=JcnsuIv5wJpH5JwQrzE7MTw7nCo%3D&_=1417189173488 2014-11-28 10:39:32,653 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (Work-Job-Executor-44:ctx-02700c7f job-13494/job-13496 ctx-77b3b664) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE 2014-11-28 10:39:32,664 DEBUG [c.c.a.t.Request] (Work-Job-Executor-44:ctx-02700c7f job-13494/job-13496 ctx-77b3b664) Seq 132-2874703937145945308: Sending { Cmd , MgmtId: 345049793560, via: 132(xen01.z01p2.us.east.cvg.cs.zimcom.net), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/2/343/9772bd4a-5a0c-4e41-a050-2daf612ad78c.vhd","uuid":"468baa4a-3de3-47d2-877e-f97d40b2b272","id":343,"format":"VHD","accountId":2,"hvm":true,"displayText":"Windows2012R2-Datacenter (Xen)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://nfs01.us.east.cvg.cs.zimcom.net/US_EAST_CVG_Z01_SEC","_role":"Image"}},"name":"9772bd4a-5a0c-4e41-a050-2daf612ad78c","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"uuid":"468baa4a-3de3-47d2-877e-f97d40b2b272","id":343,"format":"VHD","accountId":2,"hvm":true,"displayText":"Windows2012R2-Datacenter (Xen)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"VNX5400CVG_ZC_CS_XEN_1","id":106,"poolType":"PreSetup","host":"localhost","path":"/VNX5400CVG_ZC_CS_XEN_1","port":0,"url":"PreSetup://localhost/VNX5400CVG_ZC_CS_XEN_1/?ROLE=Primary&STOREUUID=VNX5400CVG_ZC_CS_XEN_1"}},"name":"9772bd4a-5a0c-4e41-a050-2daf612ad78c","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] } 2014-11-28 10:39:32,665 DEBUG [c.c.a.t.Request] (Work-Job-Executor-44:ctx-02700c7f job-13494/job-13496 ctx-77b3b664) Seq 132-2874703937145945308: Executing: { Cmd , MgmtId: 345049793560, via: 132(xen01.z01p2.us.east.cvg.cs.zimcom.net), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/2/343/9772bd4a-5a0c-4e41-a050-2daf612ad78c.vhd","uuid":"468baa4a-3de3-47d2-877e-f97d40b2b272","id":343,"format":"VHD","accountId":2,"hvm":true,"displayText":"Windows2012R2-Datacenter (Xen)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://nfs01.us.east.cvg.cs.zimcom.net/US_EAST_CVG_Z01_SEC","_role":"Image"}},"name":"9772bd4a-5a0c-4e41-a050-2daf612ad78c","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"uuid":"468baa4a-3de3-47d2-877e-f97d40b2b272","id":343,"format":"VHD","accountId":2,"hvm":true,"displayText":"Windows2012R2-Datacenter (Xen)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"VNX5400CVG_ZC_CS_XEN_1","id":106,"poolType":"PreSetup","host":"localhost","path":"/VNX5400CVG_ZC_CS_XEN_1","port":0,"url":"PreSetup://localhost/VNX5400CVG_ZC_CS_XEN_1/?ROLE=Primary&STOREUUID=VNX5400CVG_ZC_CS_XEN_1"}},"name":"9772bd4a-5a0c-4e41-a050-2daf612ad78c","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] } 2014-11-28 10:39:32,665 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-47:ctx-e8d65ad0) Seq 132-2874703937145945308: Executing request 2014-11-28 10:39:32,677 DEBUG [c.c.a.ApiServlet] (catalina-exec-12:ctx-11bf6733 ctx-d604790b) ===END=== 172.23.0.1 -- GET command=queryAsyncJobResult&jobId=8271b914-7ef4-4e2d-a20e-7cc261abed16&response=json&sessionkey=JcnsuIv5wJpH5JwQrzE7MTw7nCo%3D&_=1417189173488 2014-11-28 10:39:33,076 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-1:null) SeqA 130-105779: Processing Seq 130-105779: { Cmd , MgmtId: -1, via: 130, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":982,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] } 2014-11-28 10:39:33,083 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-1:null) SeqA 130-105779: Sending Seq 130-105779: { Ans: , MgmtId: 345049793560, via: 130, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] } 2014-11-28 10:39:35,650 DEBUG [c.c.a.ApiServlet] (catalina-exec-14:ctx-824a63f1) ===START=== 172.23.0.1 -- GET command=queryAsyncJobResult&jobId=8271b914-7ef4-4e2d-a20e-7cc261abed16&response=json&sessionkey=JcnsuIv5wJpH5JwQrzE7MTw7nCo%3D&_=1417189176490 2014-11-28 10:39:35,674 DEBUG [c.c.a.ApiServlet] (catalina-exec-14:ctx-824a63f1 ctx-40852023) ===END=== 172.23.0.1 -- GET command=queryAsyncJobResult&jobId=8271b914-7ef4-4e2d-a20e-7cc261abed16&response=json&sessionkey=JcnsuIv5wJpH5JwQrzE7MTw7nCo%3D&_=1417189176490 2014-11-28 10:39:36,136 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-47:ctx-e8d65ad0) failed to dd /var/run/cloud_mount/cde4f9eb-74b6-42c4-8855-c166a9c516a7/9772bd4a-5a0c-4e41-a050-2daf612ad78c.vhd to /dev/VG_XenStorage-5e728b55-690c-1208-d42b-3c2b5b80cc22/VHD-da3ef7b6-619f-4ba5-accc-0cfdf90eca77 2014-11-28 10:39:36,136 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-47:ctx-e8d65ad0) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: failed to dd /var/run/cloud_mount/cde4f9eb-74b6-42c4-8855-c166a9c516a7/9772bd4a-5a0c-4e41-a050-2daf612ad78c.vhd to /dev/VG_XenStorage-5e728b55-690c-1208-d42b-3c2b5b80cc22/VHD-da3ef7b6-619f-4ba5-accc-0cfdf90eca77 2014-11-28 10:39:36,137 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-47:ctx-e8d65ad0) Seq 132-2874703937145945308: Response Received: 2014-11-28 10:39:36,137 DEBUG [c.c.a.t.Request] (DirectAgent-47:ctx-e8d65ad0) Seq 132-2874703937145945308: Processing: { Ans: , MgmtId: 345049793560, via: 132, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: failed to dd /var/run/cloud_mount/cde4f9eb-74b6-42c4-8855-c166a9c516a7/9772bd4a-5a0c-4e41-a050-2daf612ad78c.vhd to /dev/VG_XenStorage-5e728b55-690c-1208-d42b-3c2b5b80cc22/VHD-da3ef7b6-619f-4ba5-accc-0cfdf90eca77","wait":0}}] } 2014-11-28 10:39:36,137 DEBUG [c.c.a.t.Request] (Work-Job-Executor-44:ctx-02700c7f job-13494/job-13496 ctx-77b3b664) Seq 132-2874703937145945308: Received: { Ans: , MgmtId: 345049793560, via: 132, Ver: v1, Flags: 10, { CopyCmdAnswer } } 2014-11-28 10:39:36,150 INFO [o.a.c.s.v.VolumeServiceImpl] (Work-Job-Executor-44:ctx-02700c7f job-13494/job-13496 ctx-77b3b664) releasing lock for VMTemplateStoragePool 203 Steven Searles, CTO | ssear...@zimcom.net<mailto:ssear...@zimcom.net> Zimcom Internet Solutions | www.zimcom.net<http://www.zimcom.net> O: 513.231.9500 | D: 513.233.4130 [cid:image001.jpg@01CF54D3.D25E1ED0]