[
https://issues.apache.org/jira/browse/CLOUDSTACK-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13718242#comment-13718242
]
Nitin Mehta commented on CLOUDSTACK-3740:
-----------------------------------------
This might happen when the system vm is rebooted and the template is
downloading.
m0la5eM5c7j30SYfzqaKRx4R7wl8nAdrFHDvvBxhFFwRuoIG6cYp6K9w&command=queryAsyncJobResult&response=json&jobid=0aba2cd1-d84e-4a24-b930-6049f6f168af
2013-07-24 03:04:28,196 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl]
(consoleproxy-1:null) Zone 1 is ready to launch console proxy
2013-07-24 03:04:28,221 DEBUG [agent.transport.Request] (Job-Executor-38:job-48
= [ 0aba2cd1-d84e-4a24-b930-6049f6f168af ]) Seq 2-1547173934: Sending { Cmd ,
MgmtId: 7566222426160, via: 2, Ver: v1, Flags: 100111,
[{"com.cloud.agent.api.RebootCommand":{"vmName":"s-5-QA","wait":0}}] }
2013-07-24 03:04:28,221 DEBUG [agent.transport.Request] (Job-Executor-38:job-48
= [ 0aba2cd1-d84e-4a24-b930-6049f6f168af ]) Seq 2-1547173934: Executing: { Cmd
, MgmtId: 7566222426160, via: 2, Ver: v1, Flags: 100111,
[{"com.cloud.agent.api.RebootCommand":{"vmName":"s-5-QA","wait":0}}] }
2013-07-24 03:04:28,225 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl]
(consoleproxy-1:null) Zone 2 is ready to launch console proxy
2013-07-24 03:04:28,225 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-79:null) Seq 2-1547173934: Executing request
2013-07-24 03:04:28,359 DEBUG [xen.resource.CitrixResourceBase]
(DirectAgent-79:null) 7. The VM s-5-QA is in Starting state
2013-07-24 03:04:29,768 DEBUG
[network.router.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:null) Found 0 routers to update status.
2013-07-24 03:04:29,771 DEBUG
[network.router.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
2013-07-24 03:04:30,246 DEBUG
[network.router.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:null) Found 0 routers to update status.
2013-07-24 03:04:30,249 DEBUG
[network.router.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
2013-07-24 03:04:30,710 INFO [agent.manager.AgentMonitor] (Thread-6:null)
Found the following agents behind on ping: [8]
2013-07-24 03:04:30,714 DEBUG [cloud.host.Status] (Thread-6:null) Ping timeout
for host 8, do invstigation
2013-07-24 03:04:30,720 INFO [agent.manager.AgentManagerImpl]
(AgentTaskPool-7:null) Investigating why host 8 has disconnected with event
PingTimeout
2013-07-24 03:04:30,721 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-7:null) checking if agent (8) is alive
2013-07-24 03:04:30,727 DEBUG [agent.transport.Request] (AgentTaskPool-7:null)
Seq 8-380305439: Sending { Cmd , MgmtId: 7566222426160, via: 8, Ver: v1,
Flags: 100011, [{"com.cloud.agent.api.CheckHealthCommand":{"wait":50}}] }
2013-07-24 03:04:30,775 DEBUG [agent.transport.Request]
(AgentManager-Handler-13:null) Seq 8-380305439: Processing: { Ans: , MgmtId:
7566222426160, via: 8, Ver: v1, Flags: 10,
[{"com.cloud.agent.api.CheckHealthAnswer":{"result":true,"details":"resource is
alive","wait":0}}] }
2013-07-24 03:04:30,776 DEBUG [agent.transport.Request] (AgentTaskPool-7:null)
Seq 8-380305439: Received: { Ans: , MgmtId: 7566222426160, via: 8, Ver: v1,
Flags: 10, { CheckHealthAnswer } }
2013-07-24 03:04:30,776 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-7:null) Details from executing class
com.cloud.agent.api.CheckHealthCommand: resource is alive
2013-07-24 03:04:30,777 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-7:null) agent (8) responded to checkHeathCommand, reporting that
agent is Up
2013-07-24 03:04:30,777 INFO [agent.manager.AgentManagerImpl]
(AgentTaskPool-7:null) The state determined is Up
2013-07-24 03:04:30,777 INFO [agent.manager.AgentManagerImpl]
(AgentTaskPool-7:null) Agent is determined to be up and running
2013-07-24 03:04:30,777 DEBUG [cloud.host.Status] (AgentTaskPool-7:null)
Transition:[Resource state = Enabled, Agent event = Ping, Host id = 8, name =
s-5-QA]
2013-07-24 03:04:30,788 DEBUG [cloud.host.Status] (AgentTaskPool-7:null) Agent
status update: [id = 8; name = s-5-QA; old status = Up; event = Ping; new
status = Up; old update count = 5; new update count = 6]
2013-07-24 03:04:31,396 DEBUG [agent.manager.AgentManagerImpl]
(AgentManager-Handler-15:null) SeqA 5-54: Processing Seq 5-54: { Cmd , MgmtId:
-1, via: 5, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":3,"_loadInfo":"{\n
\"connections\": []\n}","wait":0}}] }
2013-07-24 03:04:31,407 DEBUG [agent.manager.AgentManagerImpl]
(AgentManager-Handler-15:null) SeqA 5-54: Sending Seq 5-54: { Ans: , MgmtId:
7566222426160, via: 5, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2013-07-24 03:04:31,696 DEBUG [storage.image.BaseImageStoreDriverImpl]
(RemoteHostEndPoint-1:null) Performing image store createTemplate async callback
2013-07-24 03:04:31,821 DEBUG [agent.manager.AgentManagerImpl]
(AgentManager-Handler-16:null) SeqA 8--1: Processing Seq 8--1: { Cmd , MgmtId:
-1, via: 8, Ver: v1, Flags: 111,
[{"com.cloud.agent.api.ShutdownCommand":{"reason":"sig.kill","wait":0}}] }
2013-07-24 03:04:31,822 INFO [agent.manager.AgentManagerImpl]
(AgentManager-Handler-16:null) Host 8 has informed us that it is shutting down
with reason sig.kill and detail null
2013-07-24 03:04:31,823 INFO [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Host 8 is disconnecting with event ShutdownRequested
2013-07-24 03:04:31,828 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) The next status of agent 8is Disconnected, current
status is Up
2013-07-24 03:04:31,828 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Deregistering link for 8 with state Disconnected
2013-07-24 03:04:31,828 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Remove Agent : 8
2013-07-24 03:04:31,828 DEBUG [agent.manager.ConnectedAgentAttache]
(AgentTaskPool-8:null) Processing Disconnect.
2013-07-24 03:04:31,828 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Sending Disconnect to listener:
com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer_EnhancerByCloudStack_cf01b6ae
2013-07-24 03:04:31,829 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Sending Disconnect to listener:
com.cloud.deploy.DeploymentPlanningManagerImpl_EnhancerByCloudStack_95c64124
2013-07-24 03:04:31,829 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Sending Disconnect to listener:
com.cloud.network.NetworkManagerImpl_EnhancerByCloudStack_a75752b7
2013-07-24 03:04:31,829 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Sending Disconnect to listener:
com.cloud.storage.secondary.SecondaryStorageListener
2013-07-24 03:04:31,829 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Sending Disconnect to listener:
com.cloud.hypervisor.vmware.manager.VmwareManagerImpl_EnhancerByCloudStack_3ecc51b1
2013-07-24 03:04:31,829 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Sending Disconnect to listener:
com.cloud.network.security.SecurityGroupListener
2013-07-24 03:04:31,829 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Sending Disconnect to listener:
com.cloud.storage.listener.StoragePoolMonitor
2013-07-24 03:04:31,829 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Sending Disconnect to listener:
com.cloud.vm.ClusteredVirtualMachineManagerImpl_EnhancerByCloudStack_d41803bb
2013-07-24 03:04:31,830 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Sending Disconnect to listener:
com.cloud.storage.LocalStoragePoolListener
2013-07-24 03:04:31,830 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Sending Disconnect to listener:
com.cloud.network.SshKeysDistriMonitor
2013-07-24 03:04:31,830 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Sending Disconnect to listener:
com.cloud.network.router.VirtualNetworkApplianceManagerImpl_EnhancerByCloudStack_6d89705c
2013-07-24 03:04:31,830 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Sending Disconnect to listener:
com.cloud.network.SshKeysDistriMonitor
2013-07-24 03:04:31,830 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Sending Disconnect to listener:
com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl_EnhancerByCloudStack_e86d387f
2013-07-24 03:04:31,830 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Sending Disconnect to listener:
com.cloud.storage.upload.UploadListener
2013-07-24 03:04:31,830 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Sending Disconnect to listener:
com.cloud.storage.download.DownloadListener
2013-07-24 03:04:31,830 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Sending Disconnect to listener:
com.cloud.agent.manager.AgentMonitor
2013-07-24 03:04:31,830 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Sending Disconnect to listener:
com.cloud.capacity.StorageCapacityListener
2013-07-24 03:04:31,830 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Sending Disconnect to listener:
com.cloud.capacity.ComputeCapacityListener
2013-07-24 03:04:31,830 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Sending Disconnect to listener:
com.cloud.network.NetworkUsageManagerImpl$DirectNetworkStatsListener
2013-07-24 03:04:31,830 DEBUG [cloud.network.NetworkUsageManagerImpl]
(AgentTaskPool-8:null) Disconnected called on 8 with status Disconnected
2013-07-24 03:04:31,830 DEBUG [agent.manager.AgentManagerImpl]
(AgentTaskPool-8:null) Sending Disconnect to listener:
com.cloud.consoleproxy.ConsoleProxyListener
2013-07-24 03:04:31,833 DEBUG [cloud.host.Status] (AgentTaskPool-8:null)
Transition:[Resource state = Enabled, Agent event = ShutdownRequested, Host id
= 8, name = s-5-QA]
2013-07-24 03:04:31,855 DEBUG [cloud.host.Status] (AgentTaskPool-8:null) Agent
status update: [id = 8; name = s-5-QA; old status = Up; event =
ShutdownRequested; new status = Disconnected; old update count = 6; new update
count = 7]
2013-07-24 03:04:31,855 DEBUG [agent.manager.ClusteredAgentManagerImpl]
(AgentTaskPool-8:null) Notifying other nodes of to disconnect
2013-07-24 03:04:32,216 DEBUG [storage.image.BaseImageStoreDriverImpl]
(RemoteHostEndPoint-1:null) Performing image store createTemplate async callback
2013-07-24 03:04:33,171 DEBUG [cloud.api.ApiServlet] (catalina-exec-16:null)
===START=== 10.147.38.149 -- GET
signature=FRyoJlLA992TB%2FKlqGTANZrIRCc%3D&apiKey=t3WKM0txAQwQjnLdQHsO2WDMeZPX2-m0la5eM5c7j30SYfzqaKRx4R7wl8nAdrFHDvvBxhFFwRuoIG6cYp6K9w&command=queryAsyncJobResult&response=json&jobid=0aba2cd1-d84e-4a24-b930-6049f6f168af
2013-07-24 03:04:33,215 DEBUG [cloud.api.ApiServlet] (catalina-exec-16:null)
===END=== 10.147.38.149 -- GET
signature=FRyoJlLA992TB%2FKlqGTANZrIRCc%3D&apiKey=t3WKM0txAQwQjnLdQHsO2WDMeZPX2-m0la5eM5c7j30SYfzqaKRx4R7wl8nAdrFHDvvBxhFFwRuoIG6cYp6K9w&command=queryAsyncJobResult&response=json&jobid=0aba2cd1-d84e-4a24-b930-6049f6f168af
2013-07-24 03:04:37,382 DEBUG [agent.manager.AgentManagerImpl]
(AgentManager-Handler-17:null) SeqA 7-4: Processing Seq 7-4: { Cmd , MgmtId:
-1, via: 7, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n
\"connections\": []\n}","wait":0}}] }
2013-07-24 03:04:37,394 DEBUG [agent.manager.AgentManagerImpl]
(AgentManager-Handler-17:null) SeqA 7-4: Sending Seq 7-4: { Ans: , MgmtId:
7566222426160, via: 7, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2013-07-24 03:04:38,228 DEBUG [cloud.api.ApiServlet] (catalina-exec-20:null)
===START=== 10.147.38.149 -- GET
signature=FRyoJlLA992TB%2FKlqGTANZrIRCc%3D&apiKey=t3WKM0txAQwQjnLdQHsO2WDMeZPX2-m0la5eM5c7j30SYfzqaKRx4R7wl8nAdrFHDvvBxhFFwRuoIG6cYp6K9w&command=queryAsyncJobResult&response=json&jobid=0aba2cd1-d84e-4a24-b930-6049f6f168af
2013-07-24 03:04:38,268 DEBUG [cloud.api.ApiServlet] (catalina-exec-20:null)
===END=== 10.147.38.149 -- GET
signature=FRyoJlLA992TB%2FKlqGTANZrIRCc%3D&apiKey=t3WKM0txAQwQjnLdQHsO2WDMeZPX2-m0la5eM5c7j30SYfzqaKRx4R7wl8nAdrFHDvvBxhFFwRuoIG6cYp6K9w&command=queryAsyncJobResult&response=json&jobid=0aba2cd1-d84e-4a24-b930-6049f6f168af
2013-07-24 03:04:41,397 DEBUG [agent.manager.AgentManagerImpl]
(AgentManager-Handler-18:null) SeqA 5-55: Processing Seq 5-55: { Cmd , MgmtId:
-1, via: 5, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":3,"_loadInfo":"{\n
\"connections\": []\n}","wait":0}}] }
2013-07-24 03:04:41,406 DEBUG [agent.manager.AgentManagerImpl]
(AgentManager-Handler-18:null) SeqA 5-55: Sending Seq 5-55: { Ans: , MgmtId:
7566222426160, via: 5, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2013-07-24 03:04:41,700 DEBUG [cloudstack.storage.RemoteHostEndPoint]
(Timer-11:null) Sending command
org.apache.cloudstack.storage.command.DownloadProgressCommand to host: 8
2013-07-24 03:04:41,705 DEBUG [storage.download.DownloadListener]
(Timer-11:null) Send command failed
com.cloud.utils.exception.CloudRuntimeException: Unable to send message
at
org.apache.cloudstack.storage.RemoteHostEndPoint.sendMessageAsync(RemoteHostEndPoint.java:179)
at
com.cloud.storage.download.DownloadListener.sendCommand(DownloadListener.java:187)
at
com.cloud.storage.download.DownloadListener$StatusTask.run(DownloadListener.java:82)
at java.util.TimerThread.mainLoop(Timer.java:534)
at java.util.TimerThread.run(Timer.java:484)
Caused by: com.cloud.exception.AgentUnavailableException: Resource [Host:8] is
unreachable: Host 8: Host with specified id is not in the right state:
Disconnected
at
com.cloud.agent.manager.ClusteredAgentManagerImpl.getAttache(ClusteredAgentManagerImpl.java:540)
at
com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:526)
at
org.apache.cloudstack.storage.RemoteHostEndPoint.sendMessageAsync(RemoteHostEndPoint.java:177)
... 4 more
2013-07-24 03:04:41,705 WARN [storage.download.DownloadListener]
(Timer-11:null) Unable to monitor download progress of TEMPLATE: 5 at host 8
2013-07-24 03:04:41,706 DEBUG [storage.image.BaseImageStoreDriverImpl]
(Timer-11:null) Performing image store createTemplate async callback
2013-07-24 03:04:41,713 WARN [storage.datastore.ObjectInDataStoreManagerImpl]
(Timer-11:null) Template 5 is not found on image store 1, so no need to delete
2013-07-24 03:04:42,219 DEBUG [cloudstack.storage.RemoteHostEndPoint]
(Timer-12:null) Sending command
org.apache.cloudstack.storage.command.DownloadProgressCommand to host: 8
2013-07-24 03:04:42,225 DEBUG [storage.download.DownloadListener]
(Timer-12:null) Send command failed
com.cloud.utils.exception.CloudRuntimeException: Unable to send message
at
org.apache.cloudstack.storage.RemoteHostEndPoint.sendMessageAsync(RemoteHostEndPoint.java:179)
> Default CentOS5.6 template is disappearing
> ------------------------------------------
>
> Key: CLOUDSTACK-3740
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-3740
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the
> default.)
> Components: Management Server
> Affects Versions: 4.2.0
> Environment: xenserver,
> Reporter: Srikanteswararao Talluri
> Assignee: Nitin Mehta
> Priority: Blocker
> Labels: automation
> Fix For: 4.2.0
>
> Attachments: cloudstack-bugtool_2013.07.24-04.33.52.X9I_29.zip
>
>
> Steps to reproduce:
> ==============
> I couldn't find exact steps to reproduce this issue, however, when two zones
> are setup and did some operations on SSVM like reboot, stop , default CentOS
> 5.6 template of the first is disappearing. This is happening after BVT has
> progressed for a while.
> mysql> select * from template_zone_ref;
> +----+---------+-------------+---------------------+---------------------+---------------------+
> | id | zone_id | template_id | created | last_updated |
> removed |
> +----+---------+-------------+---------------------+---------------------+---------------------+
> | 1 | 1 | 1 | 2013-07-23 21:18:41 | 2013-07-23 21:18:41 |
> NULL |
> | 2 | 1 | 2 | 2013-07-23 21:18:41 | 2013-07-23 21:18:41 |
> NULL |
> | 3 | 1 | 3 | 2013-07-23 21:18:41 | 2013-07-23 21:18:41 |
> NULL |
> | 4 | 1 | 4 | 2013-07-23 21:18:41 | 2013-07-23 21:18:41 |
> NULL |
> | 5 | 1 | 5 | 2013-07-23 21:18:41 | 2013-07-23 21:42:02 |
> NULL |
> | 6 | 1 | 7 | 2013-07-23 21:18:41 | 2013-07-23 21:18:41 |
> NULL |
> | 7 | 1 | 8 | 2013-07-23 21:18:41 | 2013-07-23 21:18:41 |
> NULL |
> | 8 | 1 | 9 | 2013-07-23 21:18:41 | 2013-07-23 21:18:41 |
> NULL |
> | 9 | 1 | 10 | 2013-07-23 21:18:41 | 2013-07-23 21:18:41 |
> NULL |
> | 10 | 2 | 1 | 2013-07-23 21:19:40 | 2013-07-23 21:19:40 |
> NULL |
> | 11 | 2 | 2 | 2013-07-23 21:19:40 | 2013-07-23 21:19:40 |
> NULL |
> | 12 | 2 | 3 | 2013-07-23 21:19:40 | 2013-07-23 21:19:40 |
> NULL |
> | 13 | 2 | 4 | 2013-07-23 21:19:40 | 2013-07-23 21:19:40 |
> NULL |
> | 14 | 2 | 5 | 2013-07-23 21:19:40 | 2013-07-23 21:25:33 |
> NULL |
> | 15 | 2 | 7 | 2013-07-23 21:19:40 | 2013-07-23 21:19:40 |
> NULL |
> | 16 | 2 | 8 | 2013-07-23 21:19:40 | 2013-07-23 21:19:40 |
> NULL |
> | 17 | 2 | 9 | 2013-07-23 21:19:40 | 2013-07-23 21:19:40 |
> NULL |
> | 18 | 2 | 10 | 2013-07-23 21:19:40 | 2013-07-23 21:19:40 |
> NULL |
> | 19 | 1 | 202 | 2013-07-23 21:43:26 | 2013-07-23 21:43:26 |
> 2013-07-23 21:44:28 |
> | 20 | 1 | 203 | 2013-07-23 21:44:33 | 2013-07-23 21:44:33 |
> 2013-07-23 21:46:35 |
> | 21 | 1 | 204 | 2013-07-23 21:45:34 | 2013-07-23 21:45:34 |
> NULL |
> | 22 | 2 | 204 | 2013-07-23 21:47:59 | 2013-07-23 21:47:59 |
> 2013-07-23 21:49:02 |
> +----+---------+-------------+---------------------+---------------------+---------------------+
> 22 rows in set (0.00 sec)
> Then i tried to copy the default CentOS5.6 template from second zone to first
> zone , then template with id=5 is marked as removed in db.
> mysql> select * from template_zone_ref;
> +----+---------+-------------+---------------------+---------------------+---------------------+
> | id | zone_id | template_id | created | last_updated |
> removed |
> +----+---------+-------------+---------------------+---------------------+---------------------+
> | 1 | 1 | 1 | 2013-07-23 21:18:41 | 2013-07-23 21:18:41 |
> NULL |
> | 2 | 1 | 2 | 2013-07-23 21:18:41 | 2013-07-23 21:18:41 |
> NULL |
> | 3 | 1 | 3 | 2013-07-23 21:18:41 | 2013-07-23 21:18:41 |
> NULL |
> | 4 | 1 | 4 | 2013-07-23 21:18:41 | 2013-07-23 21:18:41 |
> NULL |
> | 5 | 1 | 5 | 2013-07-23 21:18:41 | 2013-07-23 22:50:47 |
> 2013-07-23 22:47:50 |
> | 6 | 1 | 7 | 2013-07-23 21:18:41 | 2013-07-23 21:18:41 |
> NULL |
> | 7 | 1 | 8 | 2013-07-23 21:18:41 | 2013-07-23 21:18:41 |
> NULL |
> | 8 | 1 | 9 | 2013-07-23 21:18:41 | 2013-07-23 21:18:41 |
> NULL |
> | 9 | 1 | 10 | 2013-07-23 21:18:41 | 2013-07-23 21:18:41 |
> NULL |
> | 10 | 2 | 1 | 2013-07-23 21:19:40 | 2013-07-23 21:19:40 |
> NULL |
> | 11 | 2 | 2 | 2013-07-23 21:19:40 | 2013-07-23 21:19:40 |
> NULL |
> | 12 | 2 | 3 | 2013-07-23 21:19:40 | 2013-07-23 21:19:40 |
> NULL |
> | 13 | 2 | 4 | 2013-07-23 21:19:40 | 2013-07-23 21:19:40 |
> NULL |
> | 14 | 2 | 5 | 2013-07-23 21:19:40 | 2013-07-23 21:25:33 |
> NULL |
> | 15 | 2 | 7 | 2013-07-23 21:19:40 | 2013-07-23 21:19:40 |
> NULL |
> | 16 | 2 | 8 | 2013-07-23 21:19:40 | 2013-07-23 21:19:40 |
> NULL |
> | 17 | 2 | 9 | 2013-07-23 21:19:40 | 2013-07-23 21:19:40 |
> NULL |
> | 18 | 2 | 10 | 2013-07-23 21:19:40 | 2013-07-23 21:19:40 |
> NULL |
> | 19 | 1 | 202 | 2013-07-23 21:43:26 | 2013-07-23 21:43:26 |
> 2013-07-23 21:44:28 |
> | 20 | 1 | 203 | 2013-07-23 21:44:33 | 2013-07-23 21:44:33 |
> 2013-07-23 21:46:35 |
> | 21 | 1 | 204 | 2013-07-23 21:45:34 | 2013-07-23 21:45:34 |
> NULL |
> | 22 | 2 | 204 | 2013-07-23 21:47:59 | 2013-07-23 21:47:59 |
> 2013-07-23 21:49:02 |
> +----+---------+-------------+---------------------+---------------------+---------------------+
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
