Abhinav Roy created CLOUDSTACK-4113:
---------------------------------------
Summary: [Upgrade][3.0.7 to 4.2][AWS Style Health Checks]Health
check policies are not getting created on an upgraded setup
Key: CLOUDSTACK-4113
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4113
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Components: API, Network Controller, Upgrade
Affects Versions: 4.2.0
Environment: Upgraded from 3.0.7 to 4.2
NS : NetScaler NS9.3: Build 63.4.nc, Date: Jul 3 2013, 14:57:34
Reporter: Abhinav Roy
Assignee: Rajesh Battala
Priority: Blocker
Fix For: 4.2.0
Steps :
==========================
1. Create an advanced zone setup with Cs 3.0.7
2. Add NS device, NetScaler NS9.3: Build 63.4.nc, Date: Jul 3 2013, 14:57:34.
3. do some configurations on the setup
4. Upgrade to 4.2
5. Create a NS lb rule, attach VMs and then try to create a health check policy
for that LB rule
Expected behaviour :
=========================
The health check policy should be successfully created.
Observed behaviour :
========================
The creation of health check policy fails with
(DirectAgent-113:null) Seq 5-2026438658: Processing: { Ans: , MgmtId:
7067804893289, via: 5, Ver: v1, Flags: 10,
[{"com.cloud.agent.api.UnsupportedAnswer":{"result":false,"details":"Unsupported
command issued:com.cloud.agent.api.CleanupNetworkRulesCmd. Are you sure you
got the right type of server?","wait":0}}] }
2013-08-06 22:10:24,348 DEBUG [network.resource.NetscalerResource]
(DirectAgent-209:null) Trying to bind the monitor :Cloud-Hc-10.147.47.5-22 to
the service :Cloud-Service-10.0.49.39-22
2013-08-06 22:10:24,400 ERROR [network.resource.NetscalerResource]
(DirectAgent-209:null) Failed to execute LoadBalancerConfigCommand due to
com.cloud.utils.exception.ExecutionException: Failed to create new monitor
:Cloud-Hc-10.147.47.5-22 due to Invalid argument [monitor_name]
at
com.cloud.network.resource.NetscalerResource.bindServiceToMonitor(NetscalerResource.java:2447)
at
com.cloud.network.resource.NetscalerResource.execute(NetscalerResource.java:585)
at
com.cloud.network.resource.NetscalerResource.executeRequest(NetscalerResource.java:351)
at
com.cloud.network.resource.NetscalerResource.retry(NetscalerResource.java:3227)
at
com.cloud.network.resource.NetscalerResource.execute(NetscalerResource.java:692)
at
com.cloud.network.resource.NetscalerResource.executeRequest(NetscalerResource.java:351)
at
com.cloud.network.resource.NetscalerResource.retry(NetscalerResource.java:3227)
at
com.cloud.network.resource.NetscalerResource.execute(NetscalerResource.java:692)
at
com.cloud.network.resource.NetscalerResource.executeRequest(NetscalerResource.java:351)
at
com.cloud.network.resource.NetscalerResource.executeRequest(NetscalerResource.java:340)
at
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
2013-08-06 22:10:24,442 DEBUG [agent.transport.Request] (Timer-9:null) Seq
12-602996868: Sending { Cmd , MgmtId: 7067804893289, via: 12, Ver: v1, Flags:
100011,
[{"org.apache.cloudstack.storage.command.DownloadProgressCommand":{"jobId":"a6f1fe56-3f34-4669-a024-7fec6bc7f56e","request":"GET_STATUS","hvm":true,"description":"Win8Serv","maxDownloadSizeInBytes":53687091200,"id":210,"resourceType":"TEMPLATE","installPath":"template/tmpl/1/210","_store":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.147.28.7/export/home/manasa/secondaryxen","_role":"Image"}},"url":"http://10.147.28.7/templates/Windows2012/WindowsServer2012.vhd","format":"VHD","accountId":1,"name":"210-1-cdcf9608-7e70-3e2b-b73f-a39c1921ae79","secUrl":"nfs://10.147.28.7/export/home/manasa/secondaryxen","wait":0}}]
}
2013-08-06 22:10:24,454 DEBUG [storage.download.DownloadListener]
(Timer-9:null) Scheduling timeout at 30000 ms, TEMPLATE: 210 at host 12
2013-08-06 22:10:24,553 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-209:null) Seq 11-859504655: Response Received:
2013-08-06 22:10:24,555 DEBUG [agent.transport.Request] (DirectAgent-209:null)
Seq 11-859504655: Processing: { Ans: , MgmtId: 7067804893289, via: 11, Ver:
v1, Flags: 10,
[{"com.cloud.agent.api.Answer":{"result":false,"details":"Exception:
com.cloud.utils.exception.ExecutionException\nMessage: Failed to create new
monitor :Cloud-Hc-10.147.47.5-22 due to Invalid argument [monitor_name]\nStack:
com.cloud.utils.exception.ExecutionException: Failed to create new monitor
:Cloud-Hc-10.147.47.5-22 due to Invalid argument [monitor_name]\n\tat
com.cloud.network.resource.NetscalerResource.bindServiceToMonitor(NetscalerResource.java:2447)\n\tat
com.cloud.network.resource.NetscalerResource.execute(NetscalerResource.java:585)\n\tat
com.cloud.network.resource.NetscalerResource.executeRequest(NetscalerResource.java:351)\n\tat
com.cloud.network.resource.NetscalerResource.retry(NetscalerResource.java:3227)\n\tat
com.cloud.network.resource.NetscalerResource.execute(NetscalerResource.java:692)\n\tat
com.cloud.network.resource.NetscalerResource.executeRequest(NetscalerResource.java:351)\n\tat
com.cloud.network.resource.NetscalerResource.retry(NetscalerResource.java:3227)\n\tat
com.cloud.network.resource.NetscalerResource.execute(NetscalerResource.java:692)\n\tat
com.cloud.network.resource.NetscalerResource.executeRequest(NetscalerResource.java:351)\n\tat
com.cloud.network.resource.NetscalerResource.executeRequest(NetscalerResource.java:340)\n\tat
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)\n\tat
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)\n\tat
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)\n\tat
java.util.concurrent.FutureTask.run(FutureTask.java:166)\n\tat
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)\n\tat
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)\n\tat
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat
java.lang.Thread.run(Thread.java:679)\n","wait":0}}] }
2013-08-06 22:10:24,606 DEBUG [agent.transport.Request]
(Job-Executor-71:job-133 = [ cb6bb441-9ca1-44dc-84fe-ef5811c8afc9 ]) Seq
11-859504655: Received: { Ans: , MgmtId: 7067804893289, via: 11, Ver: v1,
Flags: 10, { Answer } }
2013-08-06 22:10:24,607 DEBUG [agent.manager.AgentManagerImpl]
(Job-Executor-71:job-133 = [ cb6bb441-9ca1-44dc-84fe-ef5811c8afc9 ]) Details
from executing class com.cloud.agent.api.routing.LoadBalancerConfigCommand:
Exception: com.cloud.utils.exception.ExecutionException
Message: Failed to create new monitor :Cloud-Hc-10.147.47.5-22 due to Invalid
argument [monitor_name]
Stack: com.cloud.utils.exception.ExecutionException: Failed to create new
monitor :Cloud-Hc-10.147.47.5-22 due to Invalid argument [monitor_name]
at
com.cloud.network.resource.NetscalerResource.bindServiceToMonitor(NetscalerResource.java:2447)
at
com.cloud.network.resource.NetscalerResource.execute(NetscalerResource.java:585)
at
com.cloud.network.resource.NetscalerResource.executeRequest(NetscalerResource.java:351)
at
com.cloud.network.resource.NetscalerResource.retry(NetscalerResource.java:3227)
at
com.cloud.network.resource.NetscalerResource.execute(NetscalerResource.java:692)
at
com.cloud.network.resource.NetscalerResource.executeRequest(NetscalerResource.java:351)
at
com.cloud.network.resource.NetscalerResource.retry(NetscalerResource.java:3227)
at
com.cloud.network.resource.NetscalerResource.execute(NetscalerResource.java:692)
at
com.cloud.network.resource.NetscalerResource.executeRequest(NetscalerResource.java:351)
at
com.cloud.network.resource.NetscalerResource.executeRequest(NetscalerResource.java:340)
at
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
2013-08-06 22:10:24,607 ERROR
[cloud.network.ExternalLoadBalancerDeviceManagerImpl] (Job-Executor-71:job-133
= [ cb6bb441-9ca1-44dc-84fe-ef5811c8afc9 ]) Unable to apply load balancer rules
to the external load balancer appliance in zone zoneXen due to: Exception:
com.cloud.utils.exception.ExecutionException
Message: Failed to create new monitor :Cloud-Hc-10.147.47.5-22 due to Invalid
argument [monitor_name]
Stack: com.cloud.utils.exception.ExecutionException: Failed to create new
monitor :Cloud-Hc-10.147.47.5-22 due to Invalid argument [monitor_name]
at
com.cloud.network.resource.NetscalerResource.bindServiceToMonitor(NetscalerResource.java:2447)
at
com.cloud.network.resource.NetscalerResource.execute(NetscalerResource.java:585)
at
com.cloud.network.resource.NetscalerResource.executeRequest(NetscalerResource.java:351)
at
com.cloud.network.resource.NetscalerResource.retry(NetscalerResource.java:3227)
at
com.cloud.network.resource.NetscalerResource.execute(NetscalerResource.java:692)
at
com.cloud.network.resource.NetscalerResource.executeRequest(NetscalerResource.java:351)
at
com.cloud.network.resource.NetscalerResource.retry(NetscalerResource.java:3227)
at
com.cloud.network.resource.NetscalerResource.execute(NetscalerResource.java:692)
at
com.cloud.network.resource.NetscalerResource.executeRequest(NetscalerResource.java:351)
at
com.cloud.network.resource.NetscalerResource.executeRequest(NetscalerResource.java:340)
at
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
.
2013-08-06 22:10:24,612 WARN [network.lb.LoadBalancingRulesManagerImpl]
(Job-Executor-71:job-133 = [ cb6bb441-9ca1-44dc-84fe-ef5811c8afc9 ]) Unable to
apply healthcheck policy to the lb rule: 13 because resource is unavaliable:
com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is
unreachable: Resource [DataCenter:1] is unreachable: Unable to apply load
balancer rules to the external load balancer appliance in zone zoneXen due to:
Exception: com.cloud.utils.exception.ExecutionException
Message: Failed to create new monitor :Cloud-Hc-10.147.47.5-22 due to Invalid
argument [monitor_name]
Stack: com.cloud.utils.exception.ExecutionException: Failed to create new
monitor :Cloud-Hc-10.147.47.5-22 due to Invalid argument [monitor_name]
at
com.cloud.network.resource.NetscalerResource.bindServiceToMonitor(NetscalerResource.java:2447)
at
com.cloud.network.resource.NetscalerResource.execute(NetscalerResource.java:585)
at
com.cloud.network.resource.NetscalerResource.executeRequest(NetscalerResource.java:351)
at
com.cloud.network.resource.NetscalerResource.retry(NetscalerResource.java:3227)
at
com.cloud.network.resource.NetscalerResource.execute(NetscalerResource.java:692)
at
com.cloud.network.resource.NetscalerResource.executeRequest(NetscalerResource.java:351)
at
com.cloud.network.resource.NetscalerResource.retry(NetscalerResource.java:3227)
at
com.cloud.network.resource.NetscalerResource.execute(NetscalerResource.java:692)
at
com.cloud.network.resource.NetscalerResource.executeRequest(NetscalerResource.java:351)
at
com.cloud.network.resource.NetscalerResource.executeRequest(NetscalerResource.java:340)
at
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
.
at
com.cloud.network.ExternalLoadBalancerDeviceManagerImpl.applyLoadBalancerRules(ExternalLoadBalancerDeviceManagerImpl.java:927)
at
com.cloud.network.element.NetscalerElement.applyLBRules(NetscalerElement.java:250)
at
com.cloud.network.lb.LoadBalancingRulesManagerImpl.applyLbRules(LoadBalancingRulesManagerImpl.java:1549)
at
com.cloud.network.lb.LoadBalancingRulesManagerImpl.applyLbRules(LoadBalancingRulesManagerImpl.java:2089)
at
com.cloud.network.lb.LoadBalancingRulesManagerImpl.applyLoadBalancerRules(LoadBalancingRulesManagerImpl.java:1586)
at
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at
com.cloud.network.lb.LoadBalancingRulesManagerImpl.applyLoadBalancerConfig(LoadBalancingRulesManagerImpl.java:1506)
at
com.cloud.network.lb.LoadBalancingRulesManagerImpl.applyLBHealthCheckPolicy(LoadBalancingRulesManagerImpl.java:720)
at
com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at
org.apache.cloudstack.api.command.user.loadbalancer.CreateLBHealthCheckPolicyCmd.execute(CreateLBHealthCheckPolicyCmd.java:131)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
at
com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
