We need to submit it on jira then. It's not affecting my host's but it's
annoying to see in the logs.
Sent on a Sprint Samsung Galaxy S® III
<div>-------- Original message --------</div><div>From: Alessandro Caviglione
<c.alessan...@gmail.com> </div><div>Date:12/07/2014 10:24 AM (GMT-05:00)
</div><div>To: users@cloudstack.apache.org </div><div>Subject: Re: Fresh 4.4.2
- Unable to get status on .... my XenServer </div><div>
</div>Yes, I do not believe that the issue is related to a host already
assigned...
Me too have this issue, CS4.4.1 and XS 6.2 hosts Zone installed from
scratch, "Unable to get status on..." error appear in management server
logs from the beginning.
However, I can work with my hosts, create instance, template, networks and
so on...
I can think that this is a bug... :-/
On Wed, Dec 3, 2014 at 4:50 PM, Matthew Midgett <
clouds...@trick-solutions.com.invalid> wrote:
> I just finished installing XenServer again and started from a setup and I'm
> still getting the same errors that I was before about not being able to get
> a status. What to do now?
>
>
> JrSm9iRGlzcGF0Y2hlcnQAGFZtV29ya0pvYkRpc3BhdGNoZXIuamF2YXQABnJ1bkpvYnNxAH4ACw
>
> AAAfd0AD9vcmcuYXBhY2hlLmNsb3Vkc3RhY2suZnJhbWV3b3JrLmpvYnMuaW1wbC5Bc3luY0pvYk
>
> 1hbmFnZXJJbXBsJDV0ABhBc3luY0pvYk1hbmFnZXJJbXBsLmphdmF0AAxydW5JbkNvbnRleHRzcQ
>
> B-AAsAAAAxdAA-b3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5NYW5hZ2VkQ2
>
> 9udGV4dFJ1bm5hYmxlJDF0ABtNYW5hZ2VkQ29udGV4dFJ1bm5hYmxlLmphdmF0AANydW5zcQB-AA
>
> sAAAA4dABCb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bH
>
> RNYW5hZ2VkQ29udGV4dCQxdAAaRGVmYXVsdE1hbmFnZWRDb250ZXh0LmphdmF0AARjYWxsc3EAfg
>
> ALAAAAZ3QAQG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdW
>
> x0TWFuYWdlZENvbnRleHRxAH4AGnQAD2NhbGxXaXRoQ29udGV4dHNxAH4ACwAAADVxAH4AHXEAfg
>
> AadAAOcnVuV2l0aENvbnRleHRzcQB-AAsAAAAudAA8b3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbm
>
> FnZWQuY29udGV4dC5NYW5hZ2VkQ29udGV4dFJ1bm5hYmxlcQB-ABZxAH4AF3NxAH4ACwAAAcxxAH
>
> 4AEXEAfgAScQB-ABdzcQB-AAsAAAHXdAAuamF2YS51dGlsLmNvbmN1cnJlbnQuRXhlY3V0b3JzJF
>
> J1bm5hYmxlQWRhcHRlcnQADkV4ZWN1dG9ycy5qYXZhcQB-ABtzcQB-AAsAAAEGdAAfamF2YS51dG
>
> lsLmNvbmN1cnJlbnQuRnV0dXJlVGFza3QAD0Z1dHVyZVRhc2suamF2YXEAfgAXc3EAfgALAAAEeX
>
> QAJ2phdmEudXRpbC5jb25jdXJyZW50LlRocmVhZFBvb2xFeGVjdXRvcnQAF1RocmVhZFBvb2xFeG
>
> VjdXRvci5qYXZhdAAJcnVuV29ya2Vyc3EAfgALAAACZ3QALmphdmEudXRpbC5jb25jdXJyZW50Ll
>
> RocmVhZFBvb2xFeGVjdXRvciRXb3JrZXJxAH4ALHEAfgAXc3EAfgALAAAC6XQAEGphdmEubGFuZy
>
> 5UaHJlYWR0AAtUaHJlYWQuamF2YXEAfgAXc3IAJmphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZG
>
> lmaWFibGVMaXN0_A8lMbXsjhACAAFMAARsaXN0cQB-AAZ4cgAsamF2YS51dGlsLkNvbGxlY3Rpb2
>
> 5zJFVubW9kaWZpYWJsZUNvbGxlY3Rpb24ZQgCAy173HgIAAUwAAWN0ABZMamF2YS91dGlsL0NvbG
>
> xlY3Rpb247eHBzcgATamF2YS51dGlsLkFycmF5TGlzdHiB0h2Zx2GdAwABSQAEc2l6ZXhwAAAAAH
> cEAAAAAHhxAH4AOHg
> 2014-12-03 10:28:23,558 WARN [o.a.c.s.SecondaryStorageManagerImpl]
> (secstorage-1:ctx-2d3ea815) Exception while trying
> to start secondary storage vm
> java.lang.RuntimeException: Job failed due to exception Resource [Host:4]
> is
> unreachable: Host 4: Unable to start instance due to DB Exception on:
> com.mysql.jdbc.JDBC4PreparedStatement@7268fbbc: UPDATE
> op_dc_link_local_ip_address_alloc SET
> op_dc_link_local_ip_address_alloc.nic_id=123,
>
> op_dc_link_local_ip_address_alloc.reservation_id=_binary'97c33776-2f60-494b-
> 8f3c-7b20a0d7881f', op_dc_link_local_ip_address_alloc.taken='2014-12-03
> 15:28:23' WHERE op_dc_link_local_ip_address_alloc.id = 1806
> 2014-12-03 10:28:23,562 INFO [o.a.c.s.SecondaryStorageManagerImpl]
> (secstorage-1:ctx-2d3ea815) Unable to start secondary storage vm for
> standby
> capacity, secStorageVm vm Id : 13, will recycle it and start a new one
> 2014-12-03 10:28:23,697 WARN [c.c.u.d.Merovingian2]
> (secstorage-1:ctx-00d2f7e3) Was unable to find lock for the key
> vm_instance13 and thread id 819805219
> 2014-12-03 10:28:37,991 WARN [c.c.a.m.DirectAgentAttache]
> (DirectAgentCronJob-15:ctx-077ec0bf) Unable to get current status on
> 1(xenhv2.pvdc.chlt.charlottecolo.com)
> 2014-12-03 10:28:56,362 WARN [c.c.a.m.DirectAgentAttache]
> (DirectAgentCronJob-30:ctx-7833f032) Unable to get current status on
> 4(xenhv1.pvdc.chlt.charlottecolo.com)
> 2014-12-03 10:29:37,990 WARN [c.c.a.m.DirectAgentAttache]
> (DirectAgentCronJob-8:ctx-40da93df) Unable to get current status on
> 1(xenhv2.pvdc.chlt.charlottecolo.com)
> 2014-12-03 10:29:52,876 WARN [o.a.c.f.j.i.AsyncJobMonitor]
> (Timer-1:ctx-db89f3ef) Task (job-393) has been pending for
> 90 seconds
> 2014-12-03 10:29:56,361 WARN [c.c.a.m.DirectAgentAttache]
> (DirectAgentCronJob-61:ctx-80573bda) Unable to get current status on
> 4(xenhv1.pvdc.chlt.charlottecolo.com)
> 2014-12-03 10:30:02,536 DEBUG [o.a.c.s.i.s.TemplateObject]
> (Work-Job-Executor-61:ctx-927aa31e job-388/job-393 ctx-21971f3e) failed to
> process event and answer
> com.cloud.utils.exception.CloudRuntimeException: DB Exception on:
> com.mysql.jdbc.JDBC4PreparedStatement@571a2d18: SELECT
> template_spool_ref.id, template_spool_ref.pool_id,
> template_spool_ref.template_id, template_spool_ref.created,
> template_spool_ref.last_updated, template_spool_ref.download_pct,
> template_spool_ref.download_state, template_spool_ref.local_path,
> template_spool_ref.error_str, template_spool_ref.job_id,
> template_spool_ref.install_path, template_spool_ref.template_size,
> template_spool_ref.marked_for_gc, template_spool_ref.update_count,
> template_spool_ref.updated, template_spool_ref.state FROM
> template_spool_ref
> WHERE template_spool_ref.pool_id = 2 AND template_spool_ref.template_id =
> 1
> ORDER BY RAND() LIMIT 1
> Caused by: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException:
> Communications link failure
> at
> com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116)
> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3520)
> Caused by: java.io.EOFException: Can not read response from server.
> Expected
> to read 4 bytes, read 0 bytes before connection was unexpectedly lost.
> 2014-12-03 10:30:02,560 DEBUG [o.a.c.s.v.VolumeServiceImpl]
> (Work-Job-Executor-61:ctx-927aa31e job-388/job-393 ctx-21971f3e) failed to
> create template on storage
> java.lang.RuntimeException: InvocationTargetException when invoking RPC
> callback for command: copyBaseImageCallback
> Caused by: java.lang.reflect.InvocationTargetException
> Caused by: com.cloud.utils.exception.CloudRuntimeException: Failed to
> process event
> Caused by: com.cloud.utils.exception.CloudRuntimeException: DB Exception
> on:
> com.mysql.jdbc.JDBC4PreparedStatement@571a2d18: SELECT
> template_spool_ref.id, template_spool_ref.pool_id,
> template_spool_ref.template_id, template_spool_ref.created,
> template_spool_ref.last_updated, template_spool_ref.download_pct,
> template_spool_ref.download_state, template_spool_ref.local_path,
> template_spool_ref.error_str, template_spool_ref.job_id,
> template_spool_ref.install_path, template_spool_ref.template_size,
> template_spool_ref.marked_for_gc, template_spool_ref.update_count,
> template_spool_ref.updated, template_spool_ref.state FROM
> template_spool_ref
> WHERE template_spool_ref.pool_id = 2 AND template_spool_ref.template_id =
> 1
> ORDER BY RAND() LIMIT 1
> Caused by: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException:
> Communications link failure
> at
> com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116)
> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3520)
> Caused by: java.io.EOFException: Can not read response from server.
> Expected
> to read 4 bytes, read 0 bytes before connection was unexpectedly lost.
> 2014-12-03 10:30:02,568 WARN [o.a.c.s.d.ObjectInDataStoreManagerImpl]
> (Work-Job-Executor-61:ctx-927aa31e job-388/job-393 ctx-21971f3e) Template 1
> is not found on storage pool 2, so no need to delete
> 2014-12-03 10:30:02,570 ERROR [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-61:ctx-927aa31e job-388/job-393 ctx-21971f3e) Failed to
> start instance VM[ConsoleProxy|v-10-VM]
> com.cloud.utils.exception.CloudRuntimeException: can't find mapping in
> ObjectInDataStore table for:
> org.apache.cloudstack.storage.image.store.TemplateObject@785de29b
> 2014-12-03 10:30:02,693 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-61:ctx-927aa31e job-388/job-393 ctx-21971f3e) VM state
> transitted from :Starting to Stopped with event: OperationFailedvm's
> original host id: null new host id: null host id before state transition: 1
> 2014-12-03 10:30:02,721 ERROR [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-61:ctx-927aa31e job-388/job-393 ctx-21971f3e) Invocation
> exception, caused by: com.cloud.exception.AgentUnavailableException:
> Resource [Host:1] is unreachable: Host 1: Unable to start instance due to
> can't find mapping in ObjectInDataStore table for:
> org.apache.cloudstack.storage.image.store.TemplateObject@785de29b
> 2014-12-03 10:30:02,721 INFO [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-61:ctx-927aa31e job-388/job-393 ctx-21971f3e) Rethrow
> exception com.cloud.exception.AgentUnavailableException: Resource [Host:1]
> is unreachable: Host 1: Unable to start instance due to can't find mapping
> in ObjectInDataStore table for:
> org.apache.cloudstack.storage.image.store.TemplateObject@785de29b
> 2014-12-03 10:30:02,722 ERROR [c.c.v.VmWorkJobDispatcher]
> (Work-Job-Executor-61:ctx-927aa31e job-388/job-393) Unable to complete
> AsyncJobVO {id:393, userId: 1, accountId: 1, instanceType: null,
> instanceId:
> null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
>
> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9p
>
> ZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAlj
>
> bHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQA
>
> EkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-
>
> AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01h
>
> cDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAE
>
> SgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAAB
>
> AAAAAAAAAAEAAAAAAAAACnQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBw
> cHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode:
> 0, result: null,
> initMsid: 223162458780723, completeMsid: null, lastUpdated: null,
> lastPolled: null, created: Wed Dec 03 10:28:21 EST 2014}, job origin:388
> com.cloud.exception.AgentUnavailableException: Resource [Host:1] is
> unreachable: Host 1: Unable to start instance due to can't find mapping in
> ObjectInDataStore table for:
> org.apache.cloudstack.storage.image.store.TemplateObject@785de29b
> Caused by: com.cloud.utils.exception.CloudRuntimeException: can't find
> mapping in ObjectInDataStore table for:
> org.apache.cloudstack.storage.image.store.TemplateObject@785de29b
> 2014-12-03 10:30:02,723 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Work-Job-Executor-61:ctx-927aa31e job-388/job-393) Complete async job-393,
> jobStatus: FAILED, resultCode: 0, result:
>
> rO0ABXNyABpqYXZhLmxhbmcuUnVudGltZUV4Y2VwdGlvbp5fBkcKNIPlAgAAeHIAE2phdmEubGFu
>
> Zy5FeGNlcHRpb27Q_R8-GjscxAIAAHhyABNqYXZhLmxhbmcuVGhyb3dhYmxl1cY1Jzl3uMsDAARM
>
> AAVjYXVzZXQAFUxqYXZhL2xhbmcvVGhyb3dhYmxlO0wADWRldGFpbE1lc3NhZ2V0ABJMamF2YS9s
>
> YW5nL1N0cmluZztbAApzdGFja1RyYWNldAAeW0xqYXZhL2xhbmcvU3RhY2tUcmFjZUVsZW1lbnQ7
>
> TAAUc3VwcHJlc3NlZEV4Y2VwdGlvbnN0ABBMamF2YS91dGlsL0xpc3Q7eHBxAH4AB3QA2kpvYiBm
>
> YWlsZWQgZHVlIHRvIGV4Y2VwdGlvbiBSZXNvdXJjZSBbSG9zdDoxXSBpcyB1bnJlYWNoYWJsZTog
>
> SG9zdCAxOiBVbmFibGUgdG8gc3RhcnQgaW5zdGFuY2UgZHVlIHRvIGNhbid0IGZpbmQgbWFwcGlu
>
> ZyBpbiBPYmplY3RJbkRhdGFTdG9yZSB0YWJsZSBmb3I6IG9yZy5hcGFjaGUuY2xvdWRzdGFjay5z
>
> dG9yYWdlLmltYWdlLnN0b3JlLlRlbXBsYXRlT2JqZWN0QDc4NWRlMjlidXIAHltMamF2YS5sYW5n
>
> LlN0YWNrVHJhY2VFbGVtZW50OwJGKjw8_SI5AgAAeHAAAAANc3IAG2phdmEubGFuZy5TdGFja1Ry
>
> YWNlRWxlbWVudGEJxZomNt2FAgAESQAKbGluZU51bWJlckwADmRlY2xhcmluZ0NsYXNzcQB-AARM
>
> AAhmaWxlTmFtZXEAfgAETAAKbWV0aG9kTmFtZXEAfgAEeHAAAABydAAgY29tLmNsb3VkLnZtLlZt
>
> V29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-
>
> AAsAAAH3dAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNK
>
> b2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0
>
> c3EAfgALAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdl
>
> ZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EA
>
> fgALAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZh
>
> dWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNx
>
> AH4ACwAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVm
>
> YXVsdE1hbmFnZWRDb250ZXh0cQB-ABp0AA9jYWxsV2l0aENvbnRleHRzcQB-AAsAAAA1cQB-AB1x
>
> AH4AGnQADnJ1bldpdGhDb250ZXh0c3EAfgALAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5t
>
> YW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAWcQB-ABdzcQB-AAsAAAHM
>
> cQB-ABFxAH4AEnEAfgAXc3EAfgALAAAB13QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9y
>
> cyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgAbc3EAfgALAAABBnQAH2phdmEu
>
> dXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AF3NxAH4ACwAA
>
> BHl0ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29s
>
> RXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4ACwAAAmd0AC5qYXZhLnV0aWwuY29uY3VycmVu
>
> dC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-ACxxAH4AF3NxAH4ACwAAAul0ABBqYXZhLmxh
>
> bmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AF3NyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5t
>
> b2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAGeHIALGphdmEudXRpbC5Db2xsZWN0
>
> aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9D
>
> b2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAA
> AAB3BAAAAAB4cQB-ADh4
> 2014-12-03 10:30:02,768 ERROR [c.c.u.d.DbUtil]
> (consoleproxy-1:ctx-8e76fad8)
> RELEASE_LOCK() throws exception
> com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
> link
> failure
> at
> com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116)
> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3520)
> Caused by: java.io.EOFException: Can not read response from server.
> Expected
> to read 4 bytes, read 0 bytes before connection was unexpectedly lost.
> 2014-12-03 10:30:02,770 WARN [c.c.v.SystemVmLoadScanner]
> (consoleproxy-1:ctx-8e76fad8) Unexpected exception Job failed due to
> exception Resource [Host:1] is unreachable: Host 1: Unable to start
> instance
> due to can't find mapping in ObjectInDataStore table for:
> org.apache.cloudstack.storage.image.store.TemplateObject@785de29b
> java.lang.RuntimeException: Job failed due to exception Resource [Host:1]
> is
> unreachable: Host 1: Unable to start instance due to can't find mapping in
> ObjectInDataStore table for:
> org.apache.cloudstack.storage.image.store.TemplateObject@785de29b
> 2014-12-03 10:30:02,861 WARN [c.c.u.d.Merovingian2]
> (consoleproxy-1:ctx-c282e93d) Was unable to find lock for the key
> vm_instance10 and thread id 117755041
> 2014-12-03 10:30:05,371 INFO [o.a.c.s.v.VolumeServiceImpl]
> (Work-Job-Executor-62:ctx-21f67d3c job-384/job-394 ctx-55123741) Unable to
> acquire lock on VMTemplateStoragePool 54
> 2014-12-03 10:30:05,375 ERROR [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-62:ctx-21f67d3c job-384/job-394 ctx-55123741) Failed to
> start instance VM[SecondaryStorageVm|s-13-VM]
> com.cloud.utils.exception.CloudRuntimeException: Unable to acquire lock on
> VMTemplateStoragePool: 54
> 2014-12-03 10:30:05,527 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-62:ctx-21f67d3c job-384/job-394 ctx-55123741) VM state
> transitted from :Starting to Stopped with event: OperationFailedvm's
> original host id: null new host id: null host id before state transition: 4
> 2014-12-03 10:30:05,551 ERROR [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-62:ctx-21f67d3c job-384/job-394 ctx-55123741) Invocation
> exception, caused by: com.cloud.exception.AgentUnavailableException:
> Resource [Host:4] is unreachable: Host 4: Unable to start instance due to
> Unable to acquire lock on VMTemplateStoragePool: 54
> 2014-12-03 10:30:05,551 INFO [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-62:ctx-21f67d3c job-384/job-394 ctx-55123741) Rethrow
> exception com.cloud.exception.AgentUnavailableException: Resource [Host:4]
> is unreachable: Host 4: Unable to start instance due to Unable to acquire
> lock on VMTemplateStoragePool: 54
> 2014-12-03 10:30:05,551 ERROR [c.c.v.VmWorkJobDispatcher]
> (Work-Job-Executor-62:ctx-21f67d3c job-384/job-394) Unable to complete
> AsyncJobVO {id:394, userId: 1, accountId: 1, instanceType: null,
> instanceId:
> null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
>
> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9p
>
> ZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAlj
>
> bHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQA
>
> EkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-
>
> AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01h
>
> cDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAE
>
> SgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAAB
>
> AAAAAAAAAAEAAAAAAAAADXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBw
> cHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode:
> 0, result: null,
> initMsid: 223162458780723, completeMsid: null, lastUpdated: null,
> lastPolled: null, created: Wed Dec 03 10:28:23 EST 2014}, job origin:384
> com.cloud.exception.AgentUnavailableException: Resource [Host:4] is
> unreachable: Host 4: Unable to start instance due to Unable to acquire lock
> on VMTemplateStoragePool: 54
> Caused by: com.cloud.utils.exception.CloudRuntimeException: Unable to
> acquire lock on VMTemplateStoragePool: 54
> 2014-12-03 10:30:05,553 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Work-Job-Executor-62:ctx-21f67d3c job-384/job-394) Complete async job-394,
> jobStatus: FAILED, resultCode: 0, result:
>
> rO0ABXNyABpqYXZhLmxhbmcuUnVudGltZUV4Y2VwdGlvbp5fBkcKNIPlAgAAeHIAE2phdmEubGFu
>
> Zy5FeGNlcHRpb27Q_R8-GjscxAIAAHhyABNqYXZhLmxhbmcuVGhyb3dhYmxl1cY1Jzl3uMsDAARM
>
> AAVjYXVzZXQAFUxqYXZhL2xhbmcvVGhyb3dhYmxlO0wADWRldGFpbE1lc3NhZ2V0ABJMamF2YS9s
>
> YW5nL1N0cmluZztbAApzdGFja1RyYWNldAAeW0xqYXZhL2xhbmcvU3RhY2tUcmFjZUVsZW1lbnQ7
>
> TAAUc3VwcHJlc3NlZEV4Y2VwdGlvbnN0ABBMamF2YS91dGlsL0xpc3Q7eHBxAH4AB3QAmUpvYiBm
>
> YWlsZWQgZHVlIHRvIGV4Y2VwdGlvbiBSZXNvdXJjZSBbSG9zdDo0XSBpcyB1bnJlYWNoYWJsZTog
>
> SG9zdCA0OiBVbmFibGUgdG8gc3RhcnQgaW5zdGFuY2UgZHVlIHRvIFVuYWJsZSB0byBhY3F1aXJl
>
> IGxvY2sgb24gVk1UZW1wbGF0ZVN0b3JhZ2VQb29sOiA1NHVyAB5bTGphdmEubGFuZy5TdGFja1Ry
>
> YWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAADXNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1l
>
> bnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAETAAIZmlsZU5h
>
> bWVxAH4ABEwACm1ldGhvZE5hbWVxAH4ABHhwAAAAcnQAIGNvbS5jbG91ZC52bS5WbVdvcmtKb2JE
>
> aXNwYXRjaGVydAAYVm1Xb3JrSm9iRGlzcGF0Y2hlci5qYXZhdAAGcnVuSm9ic3EAfgALAAAB93QA
>
> P29yZy5hcGFjaGUuY2xvdWRzdGFjay5mcmFtZXdvcmsuam9icy5pbXBsLkFzeW5jSm9iTWFuYWdl
>
> ckltcGwkNXQAGEFzeW5jSm9iTWFuYWdlckltcGwuamF2YXQADHJ1bkluQ29udGV4dHNxAH4ACwAA
>
> ADF0AD5vcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0
>
> UnVubmFibGUkMXQAG01hbmFnZWRDb250ZXh0UnVubmFibGUuamF2YXQAA3J1bnNxAH4ACwAAADh0
>
> AEJvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFn
>
> ZWRDb250ZXh0JDF0ABpEZWZhdWx0TWFuYWdlZENvbnRleHQuamF2YXQABGNhbGxzcQB-AAsAAABn
>
> dABAb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5h
>
> Z2VkQ29udGV4dHEAfgAadAAPY2FsbFdpdGhDb250ZXh0c3EAfgALAAAANXEAfgAdcQB-ABp0AA5y
>
> dW5XaXRoQ29udGV4dHNxAH4ACwAAAC50ADxvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5j
>
> b250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGVxAH4AFnEAfgAXc3EAfgALAAABzHEAfgARcQB-
>
> ABJxAH4AF3NxAH4ACwAAAdd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5FeGVjdXRvcnMkUnVubmFi
>
> bGVBZGFwdGVydAAORXhlY3V0b3JzLmphdmFxAH4AG3NxAH4ACwAAAQZ0AB9qYXZhLnV0aWwuY29u
>
> Y3VycmVudC5GdXR1cmVUYXNrdAAPRnV0dXJlVGFzay5qYXZhcQB-ABdzcQB-AAsAAAR5dAAnamF2
>
> YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9ydAAXVGhyZWFkUG9vbEV4ZWN1dG9y
>
> LmphdmF0AAlydW5Xb3JrZXJzcQB-AAsAAAJndAAuamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFk
>
> UG9vbEV4ZWN1dG9yJFdvcmtlcnEAfgAscQB-ABdzcQB-AAsAAALpdAAQamF2YS5sYW5nLlRocmVh
>
> ZHQAC1RocmVhZC5qYXZhcQB-ABdzcgAmamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJs
>
> ZUxpc3T8DyUxteyOEAIAAUwABGxpc3RxAH4ABnhyACxqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5t
>
> b2RpZmlhYmxlQ29sbGVjdGlvbhlCAIDLXvceAgABTAABY3QAFkxqYXZhL3V0aWwvQ29sbGVjdGlv
>
> bjt4cHNyABNqYXZhLnV0aWwuQXJyYXlMaXN0eIHSHZnHYZ0DAAFJAARzaXpleHAAAAAAdwQAAAAA
> eHEAfgA4eA
> 2014-12-03 10:30:05,596 WARN [o.a.c.s.SecondaryStorageManagerImpl]
> (secstorage-1:ctx-00d2f7e3) Exception while trying
> to start secondary storage vm
> java.lang.RuntimeException: Job failed due to exception Resource [Host:4]
> is
> unreachable: Host 4: Unable to start instance due to Unable to acquire lock
> on VMTemplateStoragePool: 54
> 2014-12-03 10:30:05,597 ERROR [c.c.u.d.DbUtil] (secstorage-1:ctx-00d2f7e3)
> RELEASE_LOCK() throws exception
> com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
> link
> failure
> at
> com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116)
> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3520)
> Caused by: java.io.EOFException: Can not read response from server.
> Expected
> to read 4 bytes, read 0 bytes before connection was unexpectedly lost.
> 2014-12-03 10:30:05,599 INFO [o.a.c.s.SecondaryStorageManagerImpl]
> (secstorage-1:ctx-00d2f7e3) Unable to start secondary storage vm for
> standby
> capacity, secStorageVm vm Id : 13, will recycle it and start a new one
> 2014-12-03 10:30:05,663 WARN [c.c.u.d.Merovingian2]
> (secstorage-1:ctx-00d2f7e3) Was unable to find lock for the key
> vm_instance13 and thread id 819805219
> 2014-12-03 10:30:07,062 ERROR [c.c.u.d.DbUtil] (secstorage-1:ctx-00d2f7e3)
> RELEASE_LOCK() throws exception
> com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
> link
> failure
> at
> com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116)
> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3520)
> Caused by: java.io.EOFException: Can not read response from server.
> Expected
> to read 4 bytes, read 0 bytes before connection was unexpectedly lost.
> 2014-12-03 10:30:07,459 WARN [c.c.u.d.Merovingian2]
> (secstorage-1:ctx-5b27f0f0) Was unable to find lock for the key
> vm_instance14 and thread id 819805219
> 2014-12-03 10:30:37,990 WARN [c.c.a.m.DirectAgentAttache]
> (DirectAgentCronJob-31:ctx-37ebcabd) Unable to get current status on
> 1(xenhv2.pvdc.chlt.charlottecolo.com)
> 2014-12-03 10:30:56,361 WARN [c.c.a.m.DirectAgentAttache]
> (DirectAgentCronJob-62:ctx-f52b8d19) Unable to get current status on
> 4(xenhv1.pvdc.chlt.charlottecolo.com)
> 2014-12-03 10:31:37,991 WARN [c.c.a.m.DirectAgentAttache]
> (DirectAgentCronJob-16:ctx-4133ae03) Unable to get current status on
> 1(xenhv2.pvdc.chlt.charlottecolo.com)
> 2014-12-03 10:31:46,486 DEBUG [o.a.c.s.i.s.TemplateObject]
> (Work-Job-Executor-63:ctx-d682f9f9 job-388/job-396 ctx-6d4609dc) failed to
> process event and answer
> com.cloud.utils.exception.CloudRuntimeException: DB Exception on:
> com.mysql.jdbc.JDBC4PreparedStatement@311d349d: SELECT
> template_spool_ref.id, template_spool_ref.pool_id,
> template_spool_ref.template_id, template_spool_ref.created,
> template_spool_ref.last_updated, template_spool_ref.download_pct,
> template_spool_ref.download_state, template_spool_ref.local_path,
> template_spool_ref.error_str, template_spool_ref.job_id,
> template_spool_ref.install_path, template_spool_ref.template_size,
> template_spool_ref.marked_for_gc, template_spool_ref.update_count,
> template_spool_ref.updated, template_spool_ref.state FROM
> template_spool_ref
> WHERE template_spool_ref.pool_id = 2 AND template_spool_ref.template_id =
> 1
> ORDER BY RAND() LIMIT 1
> Caused by: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException:
> Communications link failure
> at
> com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116)
> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3520)
> Caused by: java.io.EOFException: Can not read response from server.
> Expected
> to read 4 bytes, read 0 bytes before connection was unexpectedly lost.
> 2014-12-03 10:31:46,510 DEBUG [o.a.c.s.v.VolumeServiceImpl]
> (Work-Job-Executor-63:ctx-d682f9f9 job-388/job-396 ctx-6d4609dc) failed to
> create template on storage
> java.lang.RuntimeException: InvocationTargetException when invoking RPC
> callback for command: copyBaseImageCallback
> Caused by: java.lang.reflect.InvocationTargetException
> Caused by: com.cloud.utils.exception.CloudRuntimeException: Failed to
> process event
> Caused by: com.cloud.utils.exception.CloudRuntimeException: DB Exception
> on:
> com.mysql.jdbc.JDBC4PreparedStatement@311d349d: SELECT
> template_spool_ref.id, template_spool_ref.pool_id,
> template_spool_ref.template_id, template_spool_ref.created,
> template_spool_ref.last_updated, template_spool_ref.download_pct,
> template_spool_ref.download_state, template_spool_ref.local_path,
> template_spool_ref.error_str, template_spool_ref.job_id,
> template_spool_ref.install_path, template_spool_ref.template_size,
> template_spool_ref.marked_for_gc, template_spool_ref.update_count,
> template_spool_ref.updated, template_spool_ref.state FROM
> template_spool_ref
> WHERE template_spool_ref.pool_id = 2 AND template_spool_ref.template_id =
> 1
> ORDER BY RAND() LIMIT 1
> Caused by: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException:
> Communications link failure
> at
> com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116)
> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3520)
> Caused by: java.io.EOFException: Can not read response from server.
> Expected
> to read 4 bytes, read 0 bytes before connection was unexpectedly lost.
> 2014-12-03 10:31:46,517 WARN [o.a.c.s.d.ObjectInDataStoreManagerImpl]
> (Work-Job-Executor-63:ctx-d682f9f9 job-388/job-396 ctx-6d4609dc) Template 1
> is not found on storage pool 2, so no need to delete
> 2014-12-03 10:31:46,519 ERROR [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-63:ctx-d682f9f9 job-388/job-396 ctx-6d4609dc) Failed to
> start instance VM[ConsoleProxy|v-10-VM]
> com.cloud.utils.exception.CloudRuntimeException: can't find mapping in
> ObjectInDataStore table for:
> org.apache.cloudstack.storage.image.store.TemplateObject@25e84eee
> 2014-12-03 10:31:46,617 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-63:ctx-d682f9f9 job-388/job-396 ctx-6d4609dc) VM state
> transitted from :Starting to Stopped with event: OperationFailedvm's
> original host id: null new host id: null host id before state transition: 1
> 2014-12-03 10:31:46,642 ERROR [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-63:ctx-d682f9f9 job-388/job-396 ctx-6d4609dc) Invocation
> exception, caused by: com.cloud.exception.AgentUnavailableException:
> Resource [Host:1] is unreachable: Host 1: Unable to start instance due to
> can't find mapping in ObjectInDataStore table for:
> org.apache.cloudstack.storage.image.store.TemplateObject@25e84eee
> 2014-12-03 10:31:46,642 INFO [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-63:ctx-d682f9f9 job-388/job-396 ctx-6d4609dc) Rethrow
> exception com.cloud.exception.AgentUnavailableException: Resource [Host:1]
> is unreachable: Host 1: Unable to start instance due to can't find mapping
> in ObjectInDataStore table for:
> org.apache.cloudstack.storage.image.store.TemplateObject@25e84eee
> 2014-12-03 10:31:46,642 ERROR [c.c.v.VmWorkJobDispatcher]
> (Work-Job-Executor-63:ctx-d682f9f9 job-388/job-396) Unable to complete
> AsyncJobVO {id:396, userId: 1, accountId: 1, instanceType: null,
> instanceId:
> null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
>
> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9p
>
> ZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAlj
>
> bHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQA
>
> EkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-
>
> AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01h
>
> cDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAE
>
> SgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAAB
>
> AAAAAAAAAAEAAAAAAAAACnQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBw
> cHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode:
> 0, result: null,
> initMsid: 223162458780723, completeMsid: null, lastUpdated: null,
> lastPolled: null, created: Wed Dec 03 10:30:02 EST 2014}, job origin:388
> com.cloud.exception.AgentUnavailableException: Resource [Host:1] is
> unreachable: Host 1: Unable to start instance due to can't find mapping in
> ObjectInDataStore table for:
> org.apache.cloudstack.storage.image.store.TemplateObject@25e84eee
> Caused by: com.cloud.utils.exception.CloudRuntimeException: can't find
> mapping in ObjectInDataStore table for:
> org.apache.cloudstack.storage.image.store.TemplateObject@25e84eee
> 2014-12-03 10:31:46,644 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Work-Job-Executor-63:ctx-d682f9f9 job-388/job-396) Complete async job-396,
> jobStatus: FAILED, resultCode: 0, result:
>
> rO0ABXNyABpqYXZhLmxhbmcuUnVudGltZUV4Y2VwdGlvbp5fBkcKNIPlAgAAeHIAE2phdmEubGFu
>
> Zy5FeGNlcHRpb27Q_R8-GjscxAIAAHhyABNqYXZhLmxhbmcuVGhyb3dhYmxl1cY1Jzl3uMsDAARM
>
> AAVjYXVzZXQAFUxqYXZhL2xhbmcvVGhyb3dhYmxlO0wADWRldGFpbE1lc3NhZ2V0ABJMamF2YS9s
>
> YW5nL1N0cmluZztbAApzdGFja1RyYWNldAAeW0xqYXZhL2xhbmcvU3RhY2tUcmFjZUVsZW1lbnQ7
>
> TAAUc3VwcHJlc3NlZEV4Y2VwdGlvbnN0ABBMamF2YS91dGlsL0xpc3Q7eHBxAH4AB3QA2kpvYiBm
>
> YWlsZWQgZHVlIHRvIGV4Y2VwdGlvbiBSZXNvdXJjZSBbSG9zdDoxXSBpcyB1bnJlYWNoYWJsZTog
>
> SG9zdCAxOiBVbmFibGUgdG8gc3RhcnQgaW5zdGFuY2UgZHVlIHRvIGNhbid0IGZpbmQgbWFwcGlu
>
> ZyBpbiBPYmplY3RJbkRhdGFTdG9yZSB0YWJsZSBmb3I6IG9yZy5hcGFjaGUuY2xvdWRzdGFjay5z
>
> dG9yYWdlLmltYWdlLnN0b3JlLlRlbXBsYXRlT2JqZWN0QDI1ZTg0ZWVldXIAHltMamF2YS5sYW5n
>
> LlN0YWNrVHJhY2VFbGVtZW50OwJGKjw8_SI5AgAAeHAAAAANc3IAG2phdmEubGFuZy5TdGFja1Ry
>
> YWNlRWxlbWVudGEJxZomNt2FAgAESQAKbGluZU51bWJlckwADmRlY2xhcmluZ0NsYXNzcQB-AARM
>
> AAhmaWxlTmFtZXEAfgAETAAKbWV0aG9kTmFtZXEAfgAEeHAAAABydAAgY29tLmNsb3VkLnZtLlZt
>
> V29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-
>
> AAsAAAH3dAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNK
>
> b2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0
>
> c3EAfgALAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdl
>
> ZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EA
>
> fgALAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZh
>
> dWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNx
>
> AH4ACwAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVm
>
> YXVsdE1hbmFnZWRDb250ZXh0cQB-ABp0AA9jYWxsV2l0aENvbnRleHRzcQB-AAsAAAA1cQB-AB1x
>
> AH4AGnQADnJ1bldpdGhDb250ZXh0c3EAfgALAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5t
>
> YW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAWcQB-ABdzcQB-AAsAAAHM
>
> cQB-ABFxAH4AEnEAfgAXc3EAfgALAAAB13QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9y
>
> cyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgAbc3EAfgALAAABBnQAH2phdmEu
>
> dXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AF3NxAH4ACwAA
>
> BHl0ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29s
>
> RXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4ACwAAAmd0AC5qYXZhLnV0aWwuY29uY3VycmVu
>
> dC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-ACxxAH4AF3NxAH4ACwAAAul0ABBqYXZhLmxh
>
> bmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AF3NyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5t
>
> b2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAGeHIALGphdmEudXRpbC5Db2xsZWN0
>
> aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9D
>
> b2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAA
> AAB3BAAAAAB4cQB-ADh4
> 2014-12-03 10:31:46,689 ERROR [c.c.u.d.DbUtil]
> (consoleproxy-1:ctx-c282e93d)
> RELEASE_LOCK() throws exception
> com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
> link
> failure
> at
> com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116)
> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3520)
> Caused by: java.io.EOFException: Can not read response from server.
> Expected
> to read 4 bytes, read 0 bytes before connection was unexpectedly lost.
> 2014-12-03 10:31:46,691 WARN [c.c.v.SystemVmLoadScanner]
> (consoleproxy-1:ctx-c282e93d) Unexpected exception Job failed due to
> exception Resource [Host:1] is unreachable: Host 1: Unable to start
> instance
> due to can't find mapping in ObjectInDataStore table for:
> org.apache.cloudstack.storage.image.store.TemplateObject@25e84eee
> java.lang.RuntimeException: Job failed due to exception Resource [Host:1]
> is
> unreachable: Host 1: Unable to start instance due to can't find mapping in
> ObjectInDataStore table for:
> org.apache.cloudstack.storage.image.store.TemplateObject@25e84eee
> 2014-12-03 10:31:46,788 WARN [c.c.u.d.Merovingian2]
> (consoleproxy-1:ctx-5c69b42f) Was unable to find lock for the key
> vm_instance10 and thread id 117755041
> 2014-12-03 10:31:49,395 INFO [o.a.c.s.v.VolumeServiceImpl]
> (Work-Job-Executor-65:ctx-9e1b1988 job-384/job-400 ctx-2ee9073d) Unable to
> acquire lock on VMTemplateStoragePool 57
> 2014-12-03 10:31:49,399 ERROR [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-65:ctx-9e1b1988 job-384/job-400 ctx-2ee9073d) Failed to
> start instance VM[SecondaryStorageVm|s-14-VM]
> com.cloud.utils.exception.CloudRuntimeException: Unable to acquire lock on
> VMTemplateStoragePool: 57
> 2014-12-03 10:31:49,554 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-65:ctx-9e1b1988 job-384/job-400 ctx-2ee9073d) VM state
> transitted from :Starting to Stopped with event: OperationFailedvm's
> original host id: null new host id: null host id before state transition: 4
> 2014-12-03 10:31:49,578 ERROR [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-65:ctx-9e1b1988 job-384/job-400 ctx-2ee9073d) Invocation
> exception, caused by: com.cloud.exception.AgentUnavailableException:
> Resource [Host:4] is unreachable: Host 4: Unable to start instance due to
> Unable to acquire lock on VMTemplateStoragePool: 57
> 2014-12-03 10:31:49,578 INFO [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-65:ctx-9e1b1988 job-384/job-400 ctx-2ee9073d) Rethrow
> exception com.cloud.exception.AgentUnavailableException: Resource [Host:4]
> is unreachable: Host 4: Unable to start instance due to Unable to acquire
> lock on VMTemplateStoragePool: 57
> 2014-12-03 10:31:49,579 ERROR [c.c.v.VmWorkJobDispatcher]
> (Work-Job-Executor-65:ctx-9e1b1988 job-384/job-400) Unable to complete
> AsyncJobVO {id:400, userId: 1, accountId: 1, instanceType: null,
> instanceId:
> null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
>
> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9p
>
> ZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAlj
>
> bHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQA
>
> EkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-
>
> AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01h
>
> cDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAE
>
> SgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAAB
>
> AAAAAAAAAAEAAAAAAAAADnQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBw
> cHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode:
> 0, result: null,
> initMsid: 223162458780723, completeMsid: null, lastUpdated: null,
> lastPolled: null, created: Wed Dec 03 10:30:07 EST 2014}, job origin:384
> com.cloud.exception.AgentUnavailableException: Resource [Host:4] is
> unreachable: Host 4: Unable to start instance due to Unable to acquire lock
> on VMTemplateStoragePool: 57
> Caused by: com.cloud.utils.exception.CloudRuntimeException: Unable to
> acquire lock on VMTemplateStoragePool: 57
> 2014-12-03 10:31:49,580 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Work-Job-Executor-65:ctx-9e1b1988 job-384/job-400) Complete async job-400,
> jobStatus: FAILED, resultCode: 0, result:
>
> rO0ABXNyABpqYXZhLmxhbmcuUnVudGltZUV4Y2VwdGlvbp5fBkcKNIPlAgAAeHIAE2phdmEubGFu
>
> Zy5FeGNlcHRpb27Q_R8-GjscxAIAAHhyABNqYXZhLmxhbmcuVGhyb3dhYmxl1cY1Jzl3uMsDAARM
>
> AAVjYXVzZXQAFUxqYXZhL2xhbmcvVGhyb3dhYmxlO0wADWRldGFpbE1lc3NhZ2V0ABJMamF2YS9s
>
> YW5nL1N0cmluZztbAApzdGFja1RyYWNldAAeW0xqYXZhL2xhbmcvU3RhY2tUcmFjZUVsZW1lbnQ7
>
> TAAUc3VwcHJlc3NlZEV4Y2VwdGlvbnN0ABBMamF2YS91dGlsL0xpc3Q7eHBxAH4AB3QAmUpvYiBm
>
> YWlsZWQgZHVlIHRvIGV4Y2VwdGlvbiBSZXNvdXJjZSBbSG9zdDo0XSBpcyB1bnJlYWNoYWJsZTog
>
> SG9zdCA0OiBVbmFibGUgdG8gc3RhcnQgaW5zdGFuY2UgZHVlIHRvIFVuYWJsZSB0byBhY3F1aXJl
>
> IGxvY2sgb24gVk1UZW1wbGF0ZVN0b3JhZ2VQb29sOiA1N3VyAB5bTGphdmEubGFuZy5TdGFja1Ry
>
> YWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAADXNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1l
>
> bnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAETAAIZmlsZU5h
>
> bWVxAH4ABEwACm1ldGhvZE5hbWVxAH4ABHhwAAAAcnQAIGNvbS5jbG91ZC52bS5WbVdvcmtKb2JE
>
> aXNwYXRjaGVydAAYVm1Xb3JrSm9iRGlzcGF0Y2hlci5qYXZhdAAGcnVuSm9ic3EAfgALAAAB93QA
>
> P29yZy5hcGFjaGUuY2xvdWRzdGFjay5mcmFtZXdvcmsuam9icy5pbXBsLkFzeW5jSm9iTWFuYWdl
>
> ckltcGwkNXQAGEFzeW5jSm9iTWFuYWdlckltcGwuamF2YXQADHJ1bkluQ29udGV4dHNxAH4ACwAA
>
> ADF0AD5vcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0
>
> UnVubmFibGUkMXQAG01hbmFnZWRDb250ZXh0UnVubmFibGUuamF2YXQAA3J1bnNxAH4ACwAAADh0
>
> AEJvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFn
>
> ZWRDb250ZXh0JDF0ABpEZWZhdWx0TWFuYWdlZENvbnRleHQuamF2YXQABGNhbGxzcQB-AAsAAABn
>
> dABAb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5h
>
> Z2VkQ29udGV4dHEAfgAadAAPY2FsbFdpdGhDb250ZXh0c3EAfgALAAAANXEAfgAdcQB-ABp0AA5y
>
> dW5XaXRoQ29udGV4dHNxAH4ACwAAAC50ADxvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5j
>
> b250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGVxAH4AFnEAfgAXc3EAfgALAAABzHEAfgARcQB-
>
> ABJxAH4AF3NxAH4ACwAAAdd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5FeGVjdXRvcnMkUnVubmFi
>
> bGVBZGFwdGVydAAORXhlY3V0b3JzLmphdmFxAH4AG3NxAH4ACwAAAQZ0AB9qYXZhLnV0aWwuY29u
>
> Y3VycmVudC5GdXR1cmVUYXNrdAAPRnV0dXJlVGFzay5qYXZhcQB-ABdzcQB-AAsAAAR5dAAnamF2
>
> YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9ydAAXVGhyZWFkUG9vbEV4ZWN1dG9y
>
> LmphdmF0AAlydW5Xb3JrZXJzcQB-AAsAAAJndAAuamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFk
>
> UG9vbEV4ZWN1dG9yJFdvcmtlcnEAfgAscQB-ABdzcQB-AAsAAALpdAAQamF2YS5sYW5nLlRocmVh
>
> ZHQAC1RocmVhZC5qYXZhcQB-ABdzcgAmamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJs
>
> ZUxpc3T8DyUxteyOEAIAAUwABGxpc3RxAH4ABnhyACxqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5t
>
> b2RpZmlhYmxlQ29sbGVjdGlvbhlCAIDLXvceAgABTAABY3QAFkxqYXZhL3V0aWwvQ29sbGVjdGlv
>
> bjt4cHNyABNqYXZhLnV0aWwuQXJyYXlMaXN0eIHSHZnHYZ0DAAFJAARzaXpleHAAAAAAdwQAAAAA
> eHEAfgA4eA
> 2014-12-03 10:31:49,620 WARN [o.a.c.s.SecondaryStorageManagerImpl]
> (secstorage-1:ctx-5b27f0f0) Exception while trying
> to start secondary storage vm
> java.lang.RuntimeException: Job failed due to exception Resource [Host:4]
> is
> unreachable: Host 4: Unable to start instance due to Unable to acquire lock
> on VMTemplateStoragePool: 57
> 2014-12-03 10:31:49,622 ERROR [c.c.u.d.DbUtil] (secstorage-1:ctx-5b27f0f0)
> RELEASE_LOCK() throws exception
> com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
> link
> failure
> at
> com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116)
> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3520)
> Caused by: java.io.EOFException: Can not read response from server.
> Expected
> to read 4 bytes, read 0 bytes before connection was unexpectedly lost.
> 2014-12-03 10:31:49,624 INFO [o.a.c.s.SecondaryStorageManagerImpl]
> (secstorage-1:ctx-5b27f0f0) Unable to start secondary storage vm for
> standby
> capacity, secStorageVm vm Id : 14, will recycle it and start a new one
> 2014-12-03 10:31:49,624 ERROR [c.c.u.d.DbUtil] (secstorage-1:ctx-5b27f0f0)
> RELEASE_LOCK() throws exception
> com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications
> link
> failure
> at
> com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116)
> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3520)
> Caused by: java.io.EOFException: Can not read response from server.
> Expected
> to read 4 bytes, read 0 bytes before connection was unexpectedly lost.
> 2014-12-03 10:31:49,781 WARN [c.c.u.d.Merovingian2]
> (secstorage-1:ctx-bc09a930) Was unable to find lock for the key
> vm_instance14 and thread id 819805219
> 2014-12-03 10:31:56,361 WARN [c.c.a.m.DirectAgentAttache]
> (DirectAgentCronJob-32:ctx-853d1e1b) Unable to get current status on
> 4(xenhv1.pvdc.chlt.charlottecolo.com)
> 2014-12-03 10:32:37,989 WARN [c.c.a.m.DirectAgentAttache]
> (DirectAgentCronJob-3:ctx-fefa154b) Unable to get current status on
> 1(xenhv2.pvdc.chlt.charlottecolo.com)
> 2014-12-03 10:32:56,361 WARN [c.c.a.m.DirectAgentAttache]
> (DirectAgentCronJob-65:ctx-51ba659a) Unable to get current status on
> 4(xenhv1.pvdc.chlt.charlottecolo.com)
> 2014-12-03 10:33:37,990 WARN [c.c.a.m.DirectAgentAttache]
> (DirectAgentCronJob-33:ctx-e578dc8f) Unable to get current status on
> 1(xenhv2.pvdc.chlt.charlottecolo.com)
> 2014-12-03 10:33:47,948 DEBUG [o.a.c.s.i.s.TemplateObject]
> (Work-Job-Executor-66:ctx-38c8d928 job-388/job-402 ctx-c2e18fb0) failed to
> process event and answer
> com.cloud.utils.exception.CloudRuntimeException: DB Exception on:
> com.mysql.jdbc.JDBC4PreparedStatement@37aaee74: SELECT
> template_spool_ref.id, template_spool_ref.pool_id,
> template_spool_ref.template_id, template_spool_ref.created,
> template_spool_ref.last_updated, template_spool_ref.download_pct,
> template_spool_ref.download_state, template_spool_ref.local_path,
> template_spool_ref.error_str, template_spool_ref.job_id,
> template_spool_ref.install_path, template_spool_ref.template_size,
> template_spool_ref.marked_for_gc, template_spool_ref.update_count,
> template_spool_ref.updated, template_spool_ref.state FROM
> template_spool_ref
> WHERE template_spool_ref.pool_id = 2 AND template_spool_ref.template_id =
> 1
> ORDER BY RAND() LIMIT 1
> Caused by: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException:
> Communications link failure
> at
> com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116)
> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3520)
> Caused by: java.io.EOFException: Can not read response from server.
> Expected
> to read 4 bytes, read 0 bytes before connection was unexpectedly lost.
> 2014-12-03 10:33:47,970 DEBUG [o.a.c.s.v.VolumeServiceImpl]
> (Work-Job-Executor-66:ctx-38c8d928 job-388/job-402 ctx-c2e18fb0) failed to
> create template on storage
> java.lang.RuntimeException: InvocationTargetException when invoking RPC
> callback for command: copyBaseImageCallback
> Caused by: java.lang.reflect.InvocationTargetException
> Caused by: com.cloud.utils.exception.CloudRuntimeException: Failed to
> process event
> Caused by: com.cloud.utils.exception.CloudRuntimeException: DB Exception
> on:
> com.mysql.jdbc.JDBC4PreparedStatement@37aaee74: SELECT
> template_spool_ref.id, template_spool_ref.pool_id,
> template_spool_ref.template_id, template_spool_ref.created,
> template_spool_ref.last_updated, template_spool_ref.download_pct,
> template_spool_ref.download_state, template_spool_ref.local_path,
> template_spool_ref.error_str, template_spool_ref.job_id,
> template_spool_ref.install_path, template_spool_ref.template_size,
> template_spool_ref.marked_for_gc, template_spool_ref.update_count,
> template_spool_ref.updated, template_spool_ref.state FROM
> template_spool_ref
> WHERE template_spool_ref.pool_id = 2 AND template_spool_ref.template_id =
> 1
> ORDER BY RAND() LIMIT 1
> Caused by: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException:
> Communications link failure
> at
> com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116)
> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3520)
> Caused by: java.io.EOFException: Can not read response from server.
> Expected
> to read 4 bytes, read 0 bytes before connection was unexpectedly lost.
> 2014-12-03 10:33:47,976 WARN [o.a.c.s.d.ObjectInDataStoreManagerImpl]
> (Work-Job-Executor-66:ctx-38c8d928 job-388/job-402 ctx-c2e18fb0) Template 1
> is not found on storage pool 2, so no need to delete
> 2014-12-03 10:33:47,979 ERROR [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-66:ctx-38c8d928 job-388/job-402 ctx-c2e18fb0) Failed to
> start instance VM[ConsoleProxy|v-10-VM]
> com.cloud.utils.exception.CloudRuntimeException: can't find mapping in
> ObjectInDataStore table for:
> org.apache.cloudstack.storage.image.store.TemplateObject@4c7bc774
> 2014-12-03 10:33:48,085 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-66:ctx-38c8d928 job-388/job-402 ctx-c2e18fb0) VM state
> transitted from :Starting to Stopped with event: OperationFailedvm's
> original host id: null new host id: null host id before state transition: 4
> 2014-12-03 10:33:48,112 ERROR [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-66:ctx-38c8d928 job-388/job-402 ctx-c2e18fb0) Invocation
> exception, caused by: com.cloud.exception.AgentUnavailableException:
> Resource [Host:4] is unreachable: Host 4: Unable to start instance due to
> can't find mapping in ObjectInDataStore table for:
> org.apache.cloudstack.storage.image.store.TemplateObject@4c7bc774
> 2014-12-03 10:33:48,113 INFO [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-66:ctx-38c8d928 job-388/job-402 ctx-c2e18fb0) Rethrow
> exception com.cloud.exception.AgentUnavailableException: Resource [Host:4]
> is unreachable: Host 4: Unable to start instance due to can't find mapping
> in ObjectInDataStore table for:
> org.apache.cloudstack.storage.image.store.TemplateObject@4c7bc774
> 2014-12-03 10:33:48,113 ERROR [c.c.v.VmWorkJobDispatcher]
> (Work-Job-Executor-66:ctx-38c8d928 job-388/job-402) Unable to complete
> AsyncJobVO {id:402, userId: 1, accountId: 1, instanceType: null,
> instanceId:
> null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
>
> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9p
>
> ZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAlj
>
> bHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQA
>
> EkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-
>
> AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01h
>
> cDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAE
>
> SgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAAB
>
> AAAAAAAAAAEAAAAAAAAACnQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBw
> cHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode:
> 0, result: null,
> initMsid: 223162458780723, completeMsid: null, lastUpdated: null,
> lastPolled: null, created: Wed Dec 03 10:31:46 EST 2014}, job origin:388
> com.cloud.exception.AgentUnavailableException: Resource [Host:4] is
> unreachable: Host 4: Unable to start instance due to can't find mapping in
> ObjectInDataStore table for:
> org.apache.cloudstack.storage.image.store.TemplateObject@4c7bc774
> Caused by: com.cloud.utils.exception.CloudRuntimeException: can't find
> mapping in ObjectInDataStore table for:
> org.apache.cloudstack.storage.image.store.TemplateObject@4c7bc774
> 2014-12-03 10:33:48,115 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Work-Job-Executor-66:ctx-38c8d928 job-388/job-402) Complete async job-402,
> jobStatus: FAILED, resultCode: 0, result:
>
> rO0AB
