Sowmya Krishnan created CLOUDSTACK-1537:
-------------------------------------------
Summary: Restart network with clean up set to true causes
Autoscaled LB rule to get mangled and unusable
Key: CLOUDSTACK-1537
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-1537
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Components: Network Controller, Network Devices
Affects Versions: 4.1.0
Environment: Ubuntu 11.04, NetScaler NS10.0: Build 73.500202.e.nc
Reporter: Sowmya Krishnan
Assignee: Vijay Venkatachalam
Priority: Critical
Fix For: 4.1.0
Attachments: mslog
Restarting a network (with clean up set to true) which has Autoscale LB rules
configured causes the rules to get mangled and unusable after the restart.
Autoscale configs are not properly restored back during restart and VMs part of
the rule are destroyed and not restored back.
Expected Result:
==============
lb vserver, service group and other autoscale configs should be removed and
recreated and the rule should be functional (scale up/scale down should work
normally) after restart.
Following is the extract of ns.log:
Mar 6 07:27:20 <local0.info> 10.102.192.50 03/06/2013:07:27:20 GMT 0-PPE-0 :
UI CMD_EXECUTED 1652 0 : User nsroot - Remote_ip 10.102.192.238 - Command "rm
lb vserver Cloud-VirtualServer-10.102.196.237-22" - Status "Success"
Mar 6 07:27:20 <local0.info> 10.102.192.50 03/06/2013:07:27:20 GMT 0-PPE-0 :
EVENT STARTSAVECONFIG 1653 0 : SAVECONFIG start
Mar 6 07:27:20 <local0.info> 10.102.192.50 03/06/2013:07:27:20 GMT 0-PPE-0 :
ROUTING ZEBOS_CMD_EXECUTED 1654 0 : Command "write memory" mode(4)
Mar 6 07:27:21 <local0.debug> ns provserverd[43261]: New Connection...
Mar 6 07:27:21 <local0.debug> ns provserverd[43261]: Got EOF ... closing
socket 10
Mar 6 07:27:23 <local0.info> 10.102.192.50 03/06/2013:07:27:23 GMT 0-PPE-0 :
EVENT STOPSAVECONFIG 1655 0 : SAVECONFIG completed
Mar 6 07:27:24 <local0.info> 10.102.192.50 03/06/2013:07:27:24 GMT 0-PPE-0 :
UI CMD_EXECUTED 1656 0 : User nsroot - Remote_ip 10.102.192.238 - Command
"save ns config" - Status "Success"
Mar 6 07:27:26 <local0.debug> ns provserverd[43261]: New Connection...
Mar 6 07:27:26 <local0.debug> ns provserverd[43261]: Got EOF ... closing
socket 10
Mar 6 07:27:27 <local0.debug> ns provserverd[43261]: Sending Heartbeat
Mar 6 07:27:31 <local0.debug> ns provserverd[43261]: New Connection...
Mar 6 07:27:31 <local0.debug> ns provserverd[43261]: Got EOF ... closing
socket 10
Mar 6 07:27:36 <local0.debug> ns provserverd[43261]: New Connection...
Mar 6 07:27:36 <local0.debug> ns provserverd[43261]: Got EOF ... closing
socket 10
Mar 6 07:27:37 <local0.debug> ns provserverd[43261]: Sending Heartbeat
Mar 6 07:27:39 <local0.info> 10.102.192.50 03/06/2013:07:27:39 GMT 0-PPE-0 :
UI CMD_EXECUTED 1657 0 : User nsroot - Remote_ip 10.102.192.238 - Command
"show server" - Status "Success"
Mar 6 07:27:39 <local0.info> 10.102.192.50 03/06/2013:07:27:39 GMT 0-PPE-0 :
UI CMD_EXECUTED 1658 0 : User nsroot - Remote_ip 10.102.192.238 - Command
"show service" - Status "Success"
Mar 6 07:27:39 <local0.info> 10.102.192.50 03/06/2013:07:27:39 GMT 0-PPE-0 :
UI CMD_EXECUTED 1659 0 : User nsroot - Remote_ip 10.102.192.238 - Command "rm
server autoscale-internal_server_Cloudd4337c16d95b41048d3db8102faf89ce" -
Status "Success"
Mar 6 07:27:39 <local0.info> 10.102.192.50 03/06/2013:07:27:39 GMT 0-PPE-0 :
UI CMD_EXECUTED 1660 0 : User nsroot - Remote_ip 10.102.192.238 - Command
"unbind vlan 844 -ifnum 1/4 -tagged" - Status "Success"
Mar 6 07:27:39 <local0.info> 10.102.192.50 03/06/2013:07:27:39 GMT 0-PPE-0 :
UI CMD_EXECUTED 1661 0 : User nsroot - Remote_ip 10.102.192.238 - Command
"unbind vlan 844 -IPAddress 10.0.75.168 255.255.240.0" - Status "Success"
Mar 6 07:27:39 <local0.info> 10.102.192.50 03/06/2013:07:27:39 GMT 0-PPE-0 :
UI CMD_EXECUTED 1662 0 : User nsroot - Remote_ip 10.102.192.238 - Command
"show ns ip 10.0.75.168" - Status "Success"
Mar 6 07:27:39 <local0.info> 10.102.192.50 03/06/2013:07:27:39 GMT 0-PPE-0 :
EVENT ROUTEDOWN 1663 0 : Route route(10.0.64.0_255.255.240.0) - State DOWN
Mar 6 07:27:39 <local0.info> 10.102.192.50 03/06/2013:07:27:39 GMT 0-PPE-0 :
UI CMD_EXECUTED 1664 0 : User nsroot - Remote_ip 10.102.192.238 - Command "rm
ns ip 10.0.75.168" - Status "Success"
Mar 6 07:27:39 <local0.info> 10.102.192.50 03/06/2013:07:27:39 GMT 0-PPE-0 :
UI CMD_EXECUTED 1665 0 : User nsroot - Remote_ip 10.102.192.238 - Command
"show vlan 844" - Status "Success"
Mar 6 07:27:39 <local0.info> 10.102.192.50 03/06/2013:07:27:39 GMT 0-PPE-0 :
UI CMD_EXECUTED 1666 0 : User nsroot - Remote_ip 10.102.192.238 - Command "rm
vlan 844" - Status "Success"
Mar 6 07:27:39 <local0.info> 10.102.192.50 03/06/2013:07:27:39 GMT 0-PPE-0 :
EVENT STARTSAVECONFIG 1667 0 : SAVECONFIG start
Mar 6 07:27:39 <local0.info> 10.102.192.50 03/06/2013:07:27:39 GMT 0-PPE-0 :
ROUTING ZEBOS_CMD_EXECUTED 1668 0 : Command "write memory" mode(4)
Mar 6 07:27:41 <local0.debug> ns provserverd[43261]: New Connection...
Mar 6 07:27:41 <local0.debug> ns provserverd[43261]: Got EOF ... closing
socket 10
Mar 6 07:27:42 <local0.info> 10.102.192.50 03/06/2013:07:27:42 GMT 0-PPE-0 :
EVENT STOPSAVECONFIG 1669 0 : SAVECONFIG completed
Mar 6 07:27:43 <local0.info> 10.102.192.50 03/06/2013:07:27:43 GMT 0-PPE-0 :
UI CMD_EXECUTED 1670 0 : User nsroot - Remote_ip 10.102.192.238 - Command
"save ns config" - Status "Success"
....
Mar 6 07:27:57 <local0.debug> ns provserverd[43261]: Incarnation no old= 547
new=556 config changed?
Mar 6 07:27:57 <local0.debug> ns provserverd[43261]: Checking if autoscale
service groups are deleted
Mar 6 07:27:57 <local0.debug> ns provserverd[43261]: DATABASE: select
statement is ****select svcgrp, domainname, apikey, secretkey, url from
servicegroup_info****
Mar 6 07:27:57 <local0.debug> ns provserverd[43261]: Checking if svcgrp
(Cloudd4337c16d95b41048d3db8102faf89ce) is present
Mar 6 07:27:57 <local0.debug> ns provserverd[43261]: DATABASE: get statement
is ****select apikey, secretkey, url from vms_to_delete where vmid like
"%%"****
...
Mar 6 07:28:54 <local0.info> 10.102.192.50 03/06/2013:07:28:54 GMT 0-PPE-0 :
UI CMD_EXECUTED 1671 0 : User nsroot - Remote_ip 10.102.192.238 - Command
"show vlan 844" - Status "ERROR: No such resource"
Mar 6 07:28:54 <local0.info> 10.102.192.50 03/06/2013:07:28:54 GMT 0-PPE-0 :
UI CMD_EXECUTED 1672 0 : User nsroot - Remote_ip 10.102.192.238 - Command "add
vlan 844 -ipv6DynamicRouting DISABLED -devno 13369344" - Status "Success"
Mar 6 07:28:54 <local0.info> 10.102.192.50 03/06/2013:07:28:54 GMT 0-PPE-0 :
UI CMD_EXECUTED 1673 0 : User nsroot - Remote_ip 10.102.192.238 - Command
"show ns ip 10.0.71.200" - Status "ERROR: No such resource"
Mar 6 07:28:54 <local0.info> 10.102.192.50 03/06/2013:07:28:54 GMT 0-PPE-0 :
EVENT ROUTEUP 1674 0 : Route route(10.0.64.0_255.255.240.0) - State UP
Mar 6 07:28:54 <local0.info> 10.102.192.50 03/06/2013:07:28:54 GMT 0-PPE-0 :
UI CMD_EXECUTED 1675 0 : User nsroot - Remote_ip 10.102.192.238 - Command "add
ns ip 10.0.71.200 255.255.240.0 -type SNIP -arp ENABLED -icmp ENABLED -vServer
ENABLED -telnet ENABLED -ftp ENABLED -gui ENABLED -ssh ENABLED -snmp ENABLED
-mgmtAccess DISABLED -restrictAccess DISABLED -dynamicRouting DISABLED -state
ENABLED -icmpResponse NONE -ownerNode 255 -arpResponse NONE -devno 13402112" -
Status "Success"
Mar 6 07:28:55 <local0.info> 10.102.192.50 03/06/2013:07:28:55 GMT 0-PPE-0 :
UI CMD_EXECUTED 1676 0 : User nsroot - Remote_ip 10.102.192.238 - Command
"show vlan 844" - Status "Success"
Mar 6 07:28:55 <local0.info> 10.102.192.50 03/06/2013:07:28:55 GMT 0-PPE-0 :
UI CMD_EXECUTED 1677 0 : User nsroot - Remote_ip 10.102.192.238 - Command
"bind vlan 844 -IPAddress 10.0.71.200 255.255.240.0 -devno 13434880" - Status
"Success"
Mar 6 07:28:55 <local0.info> 10.102.192.50 03/06/2013:07:28:55 GMT 0-PPE-0 :
UI CMD_EXECUTED 1678 0 : User nsroot - Remote_ip 10.102.192.238 - Command
"bind vlan 844 -ifnum 1/4 -tagged -devno 13467648" - Status "Success"
Mar 6 07:28:55 <local0.info> 10.102.192.50 03/06/2013:07:28:55 GMT 0-PPE-0 :
EVENT STARTSAVECONFIG 1679 0 : SAVECONFIG start
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
