Yes I do. Anything in particular I should look for? 2014-09-29 09:56:03,115 INFO [c.c.u.d.T.Transaction] (main:null) Is Data Base High Availiability enabled? Ans : false 2014-09-29 09:56:03,381 DEBUG [c.c.u.d.ConnectionConcierge] (main:null) Registering a database connection for LockMaster1 2014-09-29 09:56:03,381 INFO [c.c.u.d.Merovingian2] (main:null) Cleaning up locks for 233845174730255 2014-09-29 09:56:03,393 INFO [c.c.u.d.Merovingian2] (main:null) Released 0 locks for 233845174730255 2014-09-29 09:56:03,430 INFO [o.a.c.s.l.CloudStackExtendedLifeCycle] (main:null) Running system integrity checker com.cloud.upgrade.DatabaseUpgradeChecker@55ea8912 2014-09-29 09:56:03,431 INFO [c.c.u.DatabaseUpgradeChecker] (main:null) Grabbing lock to check for database upgrade. 2014-09-29 09:56:03,474 DEBUG [c.c.u.d.VersionDaoImpl] (main:null) Checking to see if the database is at a version before it was the version table is created 2014-09-29 09:56:03,515 INFO [c.c.u.DatabaseUpgradeChecker] (main:null) DB version = 4.3.0 Code Version = 4.3.1 2014-09-29 09:56:03,517 INFO [c.c.u.DatabaseUpgradeChecker] (main:null) Database upgrade must be performed from 4.3.0 to 4.3.1 2014-09-29 09:56:03,518 DEBUG [c.c.u.DatabaseUpgradeChecker] (main:null) Running upgrade Upgrade430to431 to upgrade from 4.3.0-4.3.1 to 4.3.1 2014-09-29 09:56:03,519 DEBUG [c.c.u.d.Upgrade430to431] (main:null) updating vlan URIs 2014-09-29 09:56:03,523 DEBUG [c.c.u.d.Upgrade430to431] (main:null) Done updateing vlan URIs 2014-09-29 09:56:03,542 INFO [c.c.u.DatabaseUpgradeChecker] (main:null) Cleaning upgrades because all management server are now at the same version 2014-09-29 09:56:03,545 DEBUG [c.c.u.DatabaseUpgradeChecker] (main:null) Upgrading to version 4.3.1... 2014-09-29 09:56:03,545 INFO [c.c.u.DatabaseUpgradeChecker] (main:null) Cleanup upgrade Upgrade430to431 to upgrade from 4.3.0-4.3.1 to 4.3.1 2014-09-29 09:56:03,564 DEBUG [c.c.u.DatabaseUpgradeChecker] (main:null) Upgrade completed for version 4.3.1 2014-09-29 09:56:03,568 INFO [o.a.c.s.l.CloudStackExtendedLifeCycle] (main:null) Configuring CloudStack Components 2014-09-29 09:56:03,570 INFO [o.a.c.s.l.CloudStackExtendedLifeCycle] (main:null) Done Configuring CloudStack Components 2014-09-29 09:56:03,570 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) Loaded module context [system] in 2268 ms
On Oct 6, 2014, at 1:53 AM, Daan Hoogland <daan.hoogl...@gmail.com> wrote: > I am not sure Carlos, but I think it was due to a fix of some other network > related issue in 4.3.1. I thought we wrote an update/fix for it. So I am > looking at how your env missed out. > > On Sun, Oct 5, 2014 at 1:10 AM, Carlos Reátegui <create...@gmail.com> wrote: > Sure, but I am not sure if the problem happened when I upgraded to 4.3.0 or > 4.3.1. When (what version) did the broadcast_uri in the network table > require an entry for Guest networks and not able to be null? > > > On Oct 4, 2014, at 4:15 AM, Daan Hoogland <daan.hoogl...@gmail.com> wrote: > >> Carlos, I think you found a bug in our upgrade scripts. Can you describe the >> scenario in a ticket? >> >> On Sat, Oct 4, 2014 at 1:48 AM, Carlos Reátegui <create...@gmail.com> wrote: >> Hmm. I just checked another deployment I did with 4.4.0 using the same zone >> type and network offering and it has the broadcast_uri set to >> vlan://untagged. >> >> I also checked previous backups from older versions (4.10 and 4.2.1) and in >> all of those the broadcast_uri was blank. I am wondering if this is a bug >> in the upgrade scripts. >> >> I updated network 204 and set the broadcast_uri and now I am able to start >> new instances. >> >> thank you for your help! >> >> I am including my nics table just in case you spot something else out of the >> ordinary. >> >> mysql> select id, instance_id, network_id, netmask, gateway, ip4_address, >> broadcast_uri, mode, state, strategy from nics where network_id=204 order by >> ip4_address; >> +-----+-------------+------------+---------------+-------------+---------------+-----------------+------+--------------+-------------+ >> | id | instance_id | network_id | netmask | gateway | ip4_address >> | broadcast_uri | mode | state | strategy | >> +-----+-------------+------------+---------------+-------------+---------------+-----------------+------+--------------+-------------+ >> | 60 | 52 | 204 | NULL | NULL | NULL >> | NULL | Dhcp | Deallocating | Start | >> | 64 | 53 | 204 | NULL | NULL | NULL >> | NULL | Dhcp | Deallocating | Start | >> | 68 | 54 | 204 | NULL | NULL | NULL >> | NULL | Dhcp | Deallocating | Start | >> | 72 | 55 | 204 | NULL | NULL | NULL >> | NULL | Dhcp | Deallocating | Start | >> | 76 | 56 | 204 | NULL | NULL | NULL >> | NULL | Dhcp | Deallocating | Start | >> | 30 | 21 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.100 | vlan://untagged | Dhcp | Deallocating | Start | >> | 32 | 23 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.100 | vlan://untagged | Dhcp | Deallocating | Start | >> | 43 | 34 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.100 | vlan://untagged | Dhcp | Deallocating | Start | >> | 47 | 38 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.100 | vlan://untagged | Dhcp | Reserved | Start | >> | 1 | 1 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.101 | vlan://untagged | Dhcp | Deallocating | Start | >> | 13 | 5 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.101 | vlan://untagged | Dhcp | Deallocating | Start | >> | 87 | 59 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.101 | vlan://untagged | Dhcp | Deallocating | Start | >> | 116 | NULL | 204 | NULL | 172.30.45.1 | >> 172.30.45.101 | NULL | NULL | Reserved | PlaceHolder | >> | 120 | 91 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.101 | vlan://untagged | Dhcp | Reserved | Start | >> | 23 | 14 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.102 | vlan://untagged | Dhcp | Reserved | Start | >> | 21 | 12 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.103 | vlan://untagged | Dhcp | Deallocating | Start | >> | 109 | 81 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.103 | vlan://untagged | Dhcp | Deallocating | Start | >> | 4 | 2 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.104 | vlan://untagged | Dhcp | Deallocating | Start | >> | 84 | 58 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.104 | vlan://untagged | Dhcp | Deallocating | Start | >> | 89 | 60 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.104 | vlan://untagged | Dhcp | Deallocating | Start | >> | 117 | 90 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.104 | vlan://untagged | Dhcp | Reserved | Start | >> | 19 | 10 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.105 | vlan://untagged | Dhcp | Reserved | Start | >> | 34 | 25 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.106 | vlan://untagged | Dhcp | Deallocating | Start | >> | 38 | 29 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.106 | vlan://untagged | Dhcp | Reserved | Start | >> | 8 | 3 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.107 | vlan://untagged | Dhcp | Deallocating | Start | >> | 95 | 64 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.107 | vlan://untagged | Dhcp | Deallocating | Start | >> | 27 | 18 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.108 | vlan://untagged | Dhcp | Deallocating | Start | >> | 28 | 19 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.108 | vlan://untagged | Dhcp | Deallocating | Start | >> | 37 | 28 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.108 | vlan://untagged | Dhcp | Reserved | Start | >> | 36 | 27 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.109 | vlan://untagged | Dhcp | Deallocating | Start | >> | 45 | 36 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.109 | vlan://untagged | Dhcp | Deallocating | Start | >> | 48 | 39 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.109 | vlan://untagged | Dhcp | Allocated | Start | >> | 29 | 20 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.110 | vlan://untagged | Dhcp | Deallocating | Start | >> | 44 | 35 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.110 | vlan://untagged | Dhcp | Deallocating | Start | >> | 50 | 41 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.110 | vlan://untagged | Dhcp | Deallocating | Start | >> | 55 | 46 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.110 | vlan://untagged | Dhcp | Reserved | Start | >> | 56 | 47 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.111 | vlan://untagged | Dhcp | Allocated | Start | >> | 31 | 22 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.112 | vlan://untagged | Dhcp | Deallocating | Start | >> | 39 | 30 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.112 | vlan://untagged | Dhcp | Allocated | Start | >> | 51 | 42 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.113 | vlan://untagged | Dhcp | Deallocating | Start | >> | 92 | 61 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.113 | vlan://untagged | Dhcp | Reserved | Start | >> | 54 | 45 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.114 | vlan://untagged | Dhcp | Allocated | Start | >> | 96 | 65 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.115 | vlan://untagged | Dhcp | Deallocating | Start | >> | 100 | 70 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.115 | vlan://untagged | Dhcp | Deallocating | Start | >> | 110 | 82 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.115 | vlan://untagged | Dhcp | Deallocating | Start | >> | 57 | 48 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.116 | vlan://untagged | Dhcp | Deallocating | Start | >> | 104 | 76 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.116 | vlan://untagged | Dhcp | Deallocating | Start | >> | 113 | 87 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.116 | vlan://untagged | Dhcp | Reserved | Start | >> | 26 | 17 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.117 | vlan://untagged | Dhcp | Deallocating | Start | >> | 58 | 50 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.117 | vlan://untagged | Dhcp | Deallocating | Start | >> | 108 | 80 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.117 | vlan://untagged | Dhcp | Deallocating | Start | >> | 115 | 89 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.117 | vlan://untagged | Dhcp | Deallocating | Start | >> | 93 | 62 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.118 | vlan://untagged | Dhcp | Deallocating | Start | >> | 98 | 67 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.118 | vlan://untagged | Dhcp | Deallocating | Start | >> | 102 | 72 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.118 | vlan://untagged | Dhcp | Deallocating | Start | >> | 94 | 63 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.119 | vlan://untagged | Dhcp | Deallocating | Start | >> | 99 | 69 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.119 | vlan://untagged | Dhcp | Allocated | Start | >> | 103 | 73 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.120 | vlan://untagged | Dhcp | Deallocating | Start | >> | 112 | 86 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.120 | vlan://untagged | Dhcp | Deallocating | Start | >> | 97 | 66 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.121 | vlan://untagged | Dhcp | Deallocating | Start | >> | 126 | 97 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.121 | NULL | Dhcp | Deallocating | Start | >> | 111 | 83 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.122 | vlan://untagged | Dhcp | Deallocating | Start | >> | 12 | 4 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.123 | vlan://untagged | Dhcp | Reserved | Start | >> | 105 | 77 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.124 | vlan://untagged | Dhcp | Deallocating | Start | >> | 114 | 88 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.124 | vlan://untagged | Dhcp | Deallocating | Start | >> | 49 | 40 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.125 | vlan://untagged | Dhcp | Allocated | Start | >> | 33 | 24 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.126 | vlan://untagged | Dhcp | Deallocating | Start | >> | 17 | 8 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.130 | vlan://untagged | Dhcp | Deallocating | Start | >> | 52 | 43 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.131 | vlan://untagged | Dhcp | Deallocating | Start | >> | 53 | 44 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.132 | vlan://untagged | Dhcp | Deallocating | Start | >> | 124 | 94 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.132 | vlan://untagged | Dhcp | Allocated | Start | >> | 16 | 7 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.134 | vlan://untagged | Dhcp | Deallocating | Start | >> | 15 | 6 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.135 | vlan://untagged | Dhcp | Reserved | Start | >> | 59 | 51 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.137 | vlan://untagged | Dhcp | Deallocating | Start | >> | 40 | 31 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.138 | vlan://untagged | Dhcp | Reserved | Start | >> | 41 | 32 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.139 | vlan://untagged | Dhcp | Deallocating | Start | >> | 123 | 93 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.139 | vlan://untagged | Dhcp | Reserved | Start | >> | 25 | 16 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.141 | vlan://untagged | Dhcp | Deallocating | Start | >> | 127 | 98 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.143 | NULL | Dhcp | Deallocating | Start | >> | 80 | 57 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.144 | vlan://untagged | Dhcp | Reserved | Start | >> | 35 | 26 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.145 | vlan://untagged | Dhcp | Deallocating | Start | >> | 42 | 33 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.145 | vlan://untagged | Dhcp | Reserved | Start | >> | 106 | 78 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.148 | vlan://untagged | Dhcp | Allocated | Start | >> | 24 | 15 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.149 | vlan://untagged | Dhcp | Deallocating | Start | >> | 107 | 79 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.155 | vlan://untagged | Dhcp | Reserved | Start | >> | 20 | 11 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.157 | vlan://untagged | Dhcp | Reserved | Start | >> | 122 | 92 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.159 | vlan://untagged | Dhcp | Deallocating | Start | >> | 101 | 71 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.163 | vlan://untagged | Dhcp | Deallocating | Start | >> | 46 | 37 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.167 | vlan://untagged | Dhcp | Deallocating | Start | >> | 22 | 13 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.168 | vlan://untagged | Dhcp | Reserved | Start | >> | 18 | 9 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.170 | vlan://untagged | Dhcp | Reserved | Start | >> | 125 | 95 | 204 | 255.255.255.0 | 172.30.45.1 | >> 172.30.45.173 | NULL | Dhcp | Deallocating | Start | >> +-----+-------------+------------+---------------+-------------+---------------+-----------------+------+--------------+-------------+ >> 92 rows in set (0.00 sec) >> >> >> >> >> On Oct 3, 2014, at 2:55 PM, Chiradeep Vittal <chiradeep.vit...@citrix.com> >> wrote: >> >>> Not really sure. Check your nics table as well >>> select id, instance_id, network_id, netmask, gateway, ip4_address, >>> broadcast_uri, mode, state, strategy from nics where network_id=204 >>> >>> It looks like the broadcast_uri is null? Should be vlan://untagged >>> >>> >>> From: Carlos Reátegui <create...@gmail.com> >>> Reply-To: "dev@cloudstack.apache.org" <dev@cloudstack.apache.org> >>> Date: Friday, October 3, 2014 at 12:48 PM >>> To: "dev@cloudstack.apache.org" <dev@cloudstack.apache.org> >>> Cc: Daan Hoogland <daan.hoogl...@gmail.com> >>> Subject: Re: Can't launch VMs >>> >>> >>> Don’t know how to “check your Œnetworks¹ table and see if the URI is >>> correct." >>> >>> Here is my networks table: >>> >>> mysql> select * from networks; >>> +-----+--------------------------+--------------------------------------+-- >>> ------------------------+--------------+-----------------------+----------- >>> ----+-------------+----------------+--------+---------------------+-------- >>> -------------+----------------+---------------------------+-------+-------- >>> -+-----------+------------+------+------+-----------+------------+--------- >>> -+-------------------+----------------+------------+------------------+---- >>> -----------------+---------+-------------------+--------+-------------+---- >>> ------+--------------+-----------------+----------------+ >>> | id | name | uuid | >>> display_text | traffic_type | broadcast_domain_type | >>> broadcast_uri | gateway | cidr | mode | >>> network_offering_id | physical_network_id | data_center_id | guru_name >>> | state | related | domain_id | account_id | dns1 | dns2 | >>> guru_data | set_fields | acl_type | network_domain | reservation_id | >>> guest_type | restart_required | created | removed | >>> specify_ip_ranges | vpc_id | ip6_gateway | ip6_cidr | network_cidr | >>> display_network | network_acl_id | >>> +-----+--------------------------+--------------------------------------+-- >>> ------------------------+--------------+-----------------------+----------- >>> ----+-------------+----------------+--------+---------------------+-------- >>> -------------+----------------+---------------------------+-------+-------- >>> -+-----------+------------+------+------+-----------+------------+--------- >>> -+-------------------+----------------+------------+------------------+---- >>> -----------------+---------+-------------------+--------+-------------+---- >>> ------+--------------+-----------------+----------------+ >>> | 200 | NULL | e5a63a7e-69a2-467f-8a5f-9be907c75473 | >>> NULL | Public | Vlan | NULL >>> | NULL | NULL | Static | 1 | >>> NULL | 1 | PublicNetworkGuru | Setup | >>> 200 | 1 | 1 | NULL | NULL | NULL | 0 | NULL >>> | NULL | NULL | NULL | 0 | >>> 2013-04-30 21:25:41 | NULL | 1 | NULL | NULL | >>> NULL | NULL | 1 | NULL | >>> | 201 | NULL | 62146c15-3981-486d-a404-91bd264a2c0b | >>> NULL | Management | Native | NULL >>> | NULL | NULL | Static | 2 | >>> NULL | 1 | PodBasedNetworkGuru | Setup | >>> 201 | 1 | 1 | NULL | NULL | NULL | 0 | NULL >>> | NULL | NULL | NULL | 0 | >>> 2013-04-30 21:25:41 | NULL | 0 | NULL | NULL | >>> NULL | NULL | 1 | NULL | >>> | 202 | NULL | 45e65367-6945-40eb-a650-345bc5696eb1 | >>> NULL | Control | LinkLocal | NULL >>> | 169.254.0.1 | 169.254.0.0/16 | Static | 3 | >>> NULL | 1 | ControlNetworkGuru | Setup | >>> 202 | 1 | 1 | NULL | NULL | NULL | 0 | NULL >>> | NULL | NULL | NULL | 0 | >>> 2013-04-30 21:25:41 | NULL | 0 | NULL | NULL | >>> NULL | NULL | 1 | NULL | >>> | 203 | NULL | fd59f2b4-7db1-4383-9aea-b6ee361f8863 | >>> NULL | Storage | Native | NULL >>> | NULL | NULL | Static | 4 | >>> NULL | 1 | StorageNetworkGuru | Setup | >>> 203 | 1 | 1 | NULL | NULL | NULL | 0 | NULL >>> | NULL | NULL | NULL | 0 | >>> 2013-04-30 21:25:41 | NULL | 1 | NULL | NULL | >>> NULL | NULL | 1 | NULL | >>> | 204 | guestNetworkForBasicZone | 97ad8dd0-3617-44fa-aa9e-e43c27e0ff79 | >>> guestNetworkForBasicZone | Guest | Vlan | NULL >>> | 172.30.45.1 | NULL | Dhcp | 7 | >>> 200 | 1 | DirectPodBasedNetworkGuru | Setup | >>> 204 | 1 | 1 | NULL | NULL | NULL | 0 | >>> Domain | cs1cloud.internal | NULL | Shared | >>> 0 | 2013-04-30 21:25:58 | NULL | 1 | NULL | NULL >>> | NULL | NULL | 1 | NULL | >>> +-----+--------------------------+--------------------------------------+-- >>> ------------------------+--------------+-----------------------+----------- >>> ----+-------------+----------------+--------+---------------------+-------- >>> -------------+----------------+---------------------------+-------+-------- >>> -+-----------+------------+------+------+-----------+------------+--------- >>> -+-------------------+----------------+------------+------------------+---- >>> -----------------+---------+-------------------+--------+-------------+---- >>> ------+--------------+-----------------+----------------+ >>> 5 rows in set (0.00 sec) >>> >>> >>> >>> >>> On Oct 3, 2014, at 12:39 PM, Chiradeep Vittal >>> <chiradeep.vit...@citrix.com> wrote: >>> >>>> Wonder if Daan is talking about >>>> https://issues.apache.org/jira/browse/CLOUDSTACK-4346 >>>> >>>> >>>> As you can see from >>>> >>>> https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=blob;f=plugins/ >>>> h >>>> >>>> ypervisors/xenserver/src/com/cloud/hypervisor/xenserver/resource/CitrixRes >>>> o >>>> urceBase.java;h=9313e5673f30e6a70f915258ee78c7e5832399d4;hb=HEAD#l1019 , >>>> the first check for ³untagged² should¹ve gone through, except that it >>>> goes >>>> through and either hits line 1025 instead. >>>> So, check your Œnetworks¹ table and see if the URI is correct. >>>> >>>> >>>> From: Carlos Reátegui <create...@gmail.com> >>>> Reply-To: "dev@cloudstack.apache.org" <dev@cloudstack.apache.org> >>>> Date: Friday, October 3, 2014 at 12:15 PM >>>> To: "dev@cloudstack.apache.org" <dev@cloudstack.apache.org> >>>> Subject: Re: Can't launch VMs >>>> >>>> >>>> Thanks for having a look. Inline... >>>> >>>> On Oct 3, 2014, at 11:38 AM, Chiradeep Vittal >>>> <chiradeep.vit...@citrix.com> wrote: >>>> >>>>> Not sure what is a ³basic zone no security groups². >>>> Basic Zone type with the following Network Offering: >>>> DefaultSharedNetworkOffering as opposed to the default/first option >>>> DefaultSharedNetworkOfferingWithSGService. >>>> >>>>> Check your vlan table to see if there has been any allocation of vlans? >>>> mysql> select * from vlan; >>>> >>>> +----+--------------------------------------+-----------------+----------- >>>> - >>>> >>>> --+---------------+-----------------------------+----------------+-------- >>>> - >>>> >>>> -------+------------+---------------------+-------------+----------+------ >>>> - >>>> ----+ >>>> | id | uuid | vlan_id | >>>> vlan_gateway | vlan_netmask | description | vlan_type >>>> | data_center_id | network_id | physical_network_id | ip6_gateway | >>>> ip6_cidr | ip6_range | >>>> >>>> +----+--------------------------------------+-----------------+----------- >>>> - >>>> >>>> --+---------------+-----------------------------+----------------+-------- >>>> - >>>> >>>> -------+------------+---------------------+-------------+----------+------ >>>> - >>>> ----+ >>>> | 1 | 5ebc3075-2946-4be4-9e7a-f32a86e7edfc | vlan://untagged | >>>> 172.30.45.1 | 255.255.255.0 | 172.30.45.100-172.30.45.174 | >>>> DirectAttached | 1 | 204 | 200 | NULL >>>> | NULL | NULL | >>>> >>>> +----+--------------------------------------+-----------------+----------- >>>> - >>>> >>>> --+---------------+-----------------------------+----------------+-------- >>>> - >>>> >>>> -------+------------+---------------------+-------------+----------+------ >>>> - >>>> ----+ >>>> 1 row in set (0.00 sec) >>>> >>>> >>>> >>>>> >>>>> From: Carlos Reategui <create...@gmail.com<mailto:create...@gmail.com>> >>>>> Reply-To: "dev@cloudstack.apache.org<mailto:dev@cloudstack.apache.org>" >>>>> <dev@cloudstack.apache.org<mailto:dev@cloudstack.apache.org>>, >>>>> "car...@reategui.com<mailto:car...@reategui.com>" >>>>> <car...@reategui.com<mailto:car...@reategui.com>> >>>>> Date: Thursday, October 2, 2014 at 3:48 PM >>>>> To: "dev@cloudstack.apache.org<mailto:dev@cloudstack.apache.org>" >>>>> <dev@cloudstack.apache.org<mailto:dev@cloudstack.apache.org>> >>>>> Subject: Fwd: Can't launch VMs >>>>> >>>>> Hi devs, >>>>> Daan suggested I check with you all regarding this email I sent to the >>>>> users list. >>>>> >>>>> He said "the line of code that breaks expects a uri for a vlan", However >>>>> I >>>>> am using basic networking and I don't know where to add a vlan in that >>>>> setup. >>>>> He also said this was a known issue. Hopefully one of you all knows a >>>>> fix. >>>>> >>>>> This deployment had been working fine. Originally a 4.1, upgraded to >>>>> 4.2.1 >>>>> and more recently to 4.3 and 4.3.1. It was definitely working under >>>>> 4.2.1 >>>>> and I though it had been working under 4.3 as well but I am not sure >>>>> now. >>>>> There is no problem with existing instances. The problem is when trying >>>>> to >>>>> launch new ones. >>>>> >>>>> Let me know what additional info would be useful. >>>>> >>>>> thank you, >>>>> Carlos >>>>> >>>>> >>>>> >>>>> ---------- Forwarded message ---------- >>>>> From: Carlos Reategui <create...@gmail.com<mailto:create...@gmail.com>> >>>>> Date: Mon, Sep 29, 2014 at 4:53 PM >>>>> Subject: Can't launch VMs >>>>> To: "us...@cloudstack.apache.org<mailto:us...@cloudstack.apache.org>" >>>>> <us...@cloudstack.apache.org<mailto:us...@cloudstack.apache.org>> >>>>> >>>>> >>>>> Following up on my earlier email regarding errors in my logs it appears >>>>> things are not as great as I thought. Trying to launch instances is not >>>>> working. Please help. >>>>> thanks, >>>>> Carlos >>>>> >>>>> ACS: 4.3.1 >>>>> Hosts: XenServer 6.2 >>>>> Network: Basic Shared Network no SG >>>>> >>>>> Things appear ok up until it tries to create the VIF. Here are the >>>>> logs: >>>>> >>>>> 2014-09-29 16:26:24,816 DEBUG [c.c.a.m.DirectAgentAttache] >>>>> (DirectAgent-235:ctx-7f8db7ac) Seq 2-868943178: Executing request >>>>> >>>>> 2014-09-29 16:26:25,003 DEBUG [c.c.h.x.r.CitrixResourceBase] >>>>> (DirectAgent-235:ctx-7f8db7ac) 1. The VM i-3-98-VM is in Starting state. >>>>> >>>>> 2014-09-29 16:26:25,174 DEBUG [c.c.h.x.r.CitrixResourceBase] >>>>> (DirectAgent-235:ctx-7f8db7ac) Created VM >>>>> 71314961-a1bf-689e-eaec-73b9e3639db8 for i-3-98-VM >>>>> >>>>> 2014-09-29 16:26:25,405 DEBUG [c.c.h.x.r.CitrixResourceBase] >>>>> (DirectAgent-235:ctx-7f8db7ac) VBD 9297b527-7b1f-600c-0d55-8486a8bd35d7 >>>>> created for com.cloud.agent.api.to.DiskTO@53d6031b >>>>> >>>>> 2014-09-29 16:26:25,509 DEBUG [c.c.a.m.DirectAgentAttache] >>>>> (DirectAgent-399:ctx-73a60525) Seq 2-868943177: Response Received: >>>>> >>>>> 2014-09-29 16:26:25,509 DEBUG [c.c.a.t.Request] >>>>> (StatsCollector-3:ctx-13616221) Seq 2-868943177: Received: { Ans: , >>>>> MgmtId: 233845174730255, via: 2, Ver: v1, Flags: 10, { >>>>> GetStorageStatsAnswer } } >>>>> >>>>> 2014-09-29 16:26:25,512 DEBUG [c.c.a.m.DirectAgentAttache] >>>>> (DirectAgent-392:ctx-401c432d) Seq 2-868943179: Executing request >>>>> >>>>> 2014-09-29 16:26:25,618 DEBUG [c.c.h.x.r.CitrixResourceBase] >>>>> (DirectAgent-235:ctx-7f8db7ac) VBD 6609b989-ec81-10c1-8b00-b1fb1eb3885f >>>>> created for com.cloud.agent.api.to.DiskTO@7fbb227a >>>>> >>>>> 2014-09-29 16:26:25,658 DEBUG [c.c.a.ApiServlet] >>>>> (catalina-exec-12:ctx-a4bf4221) ===START=== 172.30.36.159 -- GET >>>>> >>>>> >>>>> command=queryAsyncJobResult&jobId=f38a8e56-9a85-48aa-9da2-d498d3179634&re >>>>> s >>>>> ponse=json&sessionkey=UWhJaGdVTH3zXZ9WFdv4EwAlqA4%3D&_=1412033185658 >>>>> >>>>> 2014-09-29 16:26:25,679 DEBUG [c.c.a.ApiServlet] >>>>> (catalina-exec-12:ctx-a4bf4221 ctx-d566be7f) ===END=== 172.30.36.159 -- >>>>> GET >>>>> >>>>> >>>>> command=queryAsyncJobResult&jobId=f38a8e56-9a85-48aa-9da2-d498d3179634&re >>>>> s >>>>> ponse=json&sessionkey=UWhJaGdVTH3zXZ9WFdv4EwAlqA4%3D&_=1412033185658 >>>>> >>>>> 2014-09-29 16:26:25,735 DEBUG [c.c.h.x.r.CitrixResourceBase] >>>>> (DirectAgent-235:ctx-7f8db7ac) VBD d47f3673-7dc8-68ff-7eb7-fcd6ba8b0c41 >>>>> created for com.cloud.agent.api.to.DiskTO@194e84ba >>>>> >>>>> 2014-09-29 16:26:25,735 DEBUG [c.c.h.x.r.CitrixResourceBase] >>>>> (DirectAgent-235:ctx-7f8db7ac) Creating VIF for i-3-98-VM on nic >>>>> [Nic:Guest-172.30.45.143-null] >>>>> >>>>> 2014-09-29 16:26:25,834 WARN [c.c.h.x.r.CitrixResourceBase] >>>>> (DirectAgent-235:ctx-7f8db7ac) Catch Exception: class >>>>> java.lang.NullPointerException due to java.lang.NullPointerException >>>>> >>>>> java.lang.NullPointerException >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.network.Networks$BroadcastDomainType.getSchemeValue(Networks.ja >>>>> v >>>>> a:173) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.network.Networks$BroadcastDomainType.getValue(Networks.java:228 >>>>> ) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.getNetwork(CitrixRes >>>>> o >>>>> urceBase.java:1035) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.createVif(CitrixReso >>>>> u >>>>> rceBase.java:1088) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResour >>>>> c >>>>> eBase.java:1718) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(Citri >>>>> x >>>>> ResourceBase.java:545) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenS >>>>> e >>>>> rver56Resource.java:59) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentA >>>>> t >>>>> tache.java:216) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Manage >>>>> d >>>>> ContextRunnable.java:49) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(D >>>>> e >>>>> faultManagedContext.java:56) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWith >>>>> C >>>>> ontext(DefaultManagedContext.java:103) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithC >>>>> o >>>>> ntext(DefaultManagedContext.java:53) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedC >>>>> o >>>>> ntextRunnable.java:46) >>>>> >>>>> at >>>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) >>>>> >>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) >>>>> >>>>> at >>>>> >>>>> >>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.acce >>>>> s >>>>> s$201(ScheduledThreadPoolExecutor.java:178) >>>>> >>>>> at >>>>> >>>>> >>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run( >>>>> S >>>>> cheduledThreadPoolExecutor.java:292) >>>>> >>>>> at >>>>> >>>>> >>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java >>>>> : >>>>> 1145) >>>>> >>>>> at >>>>> >>>>> >>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav >>>>> a >>>>> :615) >>>>> >>>>> at java.lang.Thread.run(Thread.java:745) >>>>> >>>>> 2014-09-29 16:26:25,835 WARN [c.c.h.x.r.CitrixResourceBase] >>>>> (DirectAgent-235:ctx-7f8db7ac) Unable to start i-3-98-VM due to >>>>> >>>>> java.lang.NullPointerException >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.network.Networks$BroadcastDomainType.getSchemeValue(Networks.ja >>>>> v >>>>> a:173) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.network.Networks$BroadcastDomainType.getValue(Networks.java:228 >>>>> ) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.getNetwork(CitrixRes >>>>> o >>>>> urceBase.java:1035) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.createVif(CitrixReso >>>>> u >>>>> rceBase.java:1088) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResour >>>>> c >>>>> eBase.java:1718) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(Citri >>>>> x >>>>> ResourceBase.java:545) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenS >>>>> e >>>>> rver56Resource.java:59) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentA >>>>> t >>>>> tache.java:216) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Manage >>>>> d >>>>> ContextRunnable.java:49) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(D >>>>> e >>>>> faultManagedContext.java:56) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWith >>>>> C >>>>> ontext(DefaultManagedContext.java:103) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithC >>>>> o >>>>> ntext(DefaultManagedContext.java:53) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedC >>>>> o >>>>> ntextRunnable.java:46) >>>>> >>>>> at >>>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) >>>>> >>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) >>>>> >>>>> at >>>>> >>>>> >>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.acce >>>>> s >>>>> s$201(ScheduledThreadPoolExecutor.java:178) >>>>> >>>>> at >>>>> >>>>> >>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run( >>>>> S >>>>> cheduledThreadPoolExecutor.java:292) >>>>> >>>>> at >>>>> >>>>> >>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java >>>>> : >>>>> 1145) >>>>> >>>>> at >>>>> >>>>> >>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav >>>>> a >>>>> :615) >>>>> >>>>> at java.lang.Thread.run(Thread.java:745) >>>>> >>>>> 2014-09-29 16:26:26,052 WARN [c.c.h.x.r.CitrixResourceBase] >>>>> (DirectAgent-235:ctx-7f8db7ac) Unable to clean up VBD due to >>>>> >>>>> You gave an invalid object reference. The object may have recently been >>>>> deleted. The class parameter gives the type of reference given, and the >>>>> handle parameter echoes the bad value given. >>>>> >>>>> at com.xensource.xenapi.Types.checkResponse(Types.java:209) >>>>> >>>>> at com.xensource.xenapi.Connection.dispatch(Connection.java:368) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnec >>>>> t >>>>> ion.dispatch(XenServerConnectionPool.java:909) >>>>> >>>>> at com.xensource.xenapi.VBD.unplug(VBD.java:1059) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure >>>>> ( >>>>> CitrixResourceBase.java:1462) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResour >>>>> c >>>>> eBase.java:1800) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(Citri >>>>> x >>>>> ResourceBase.java:545) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenS >>>>> e >>>>> rver56Resource.java:59) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentA >>>>> t >>>>> tache.java:216) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Manage >>>>> d >>>>> ContextRunnable.java:49) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(D >>>>> e >>>>> faultManagedContext.java:56) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWith >>>>> C >>>>> ontext(DefaultManagedContext.java:103) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithC >>>>> o >>>>> ntext(DefaultManagedContext.java:53) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedC >>>>> o >>>>> ntextRunnable.java:46) >>>>> >>>>> at >>>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) >>>>> >>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) >>>>> >>>>> at >>>>> >>>>> >>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.acce >>>>> s >>>>> s$201(ScheduledThreadPoolExecutor.java:178) >>>>> >>>>> at >>>>> >>>>> >>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run( >>>>> S >>>>> cheduledThreadPoolExecutor.java:292) >>>>> >>>>> at >>>>> >>>>> >>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java >>>>> : >>>>> 1145) >>>>> >>>>> at >>>>> >>>>> >>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav >>>>> a >>>>> :615) >>>>> >>>>> at java.lang.Thread.run(Thread.java:745) >>>>> >>>>> 2014-09-29 16:26:26,092 WARN [c.c.h.x.r.CitrixResourceBase] >>>>> (DirectAgent-235:ctx-7f8db7ac) Unable to clean up VBD due to >>>>> >>>>> You gave an invalid object reference. The object may have recently been >>>>> deleted. The class parameter gives the type of reference given, and the >>>>> handle parameter echoes the bad value given. >>>>> >>>>> at com.xensource.xenapi.Types.checkResponse(Types.java:209) >>>>> >>>>> at com.xensource.xenapi.Connection.dispatch(Connection.java:368) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnec >>>>> t >>>>> ion.dispatch(XenServerConnectionPool.java:909) >>>>> >>>>> at com.xensource.xenapi.VBD.unplug(VBD.java:1059) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure >>>>> ( >>>>> CitrixResourceBase.java:1462) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResour >>>>> c >>>>> eBase.java:1800) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(Citri >>>>> x >>>>> ResourceBase.java:545) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenS >>>>> e >>>>> rver56Resource.java:59) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentA >>>>> t >>>>> tache.java:216) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Manage >>>>> d >>>>> ContextRunnable.java:49) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(D >>>>> e >>>>> faultManagedContext.java:56) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWith >>>>> C >>>>> ontext(DefaultManagedContext.java:103) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithC >>>>> o >>>>> ntext(DefaultManagedContext.java:53) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedC >>>>> o >>>>> ntextRunnable.java:46) >>>>> >>>>> at >>>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) >>>>> >>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) >>>>> >>>>> at >>>>> >>>>> >>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.acce >>>>> s >>>>> s$201(ScheduledThreadPoolExecutor.java:178) >>>>> >>>>> at >>>>> >>>>> >>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run( >>>>> S >>>>> cheduledThreadPoolExecutor.java:292) >>>>> >>>>> at >>>>> >>>>> >>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java >>>>> : >>>>> 1145) >>>>> >>>>> at >>>>> >>>>> >>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav >>>>> a >>>>> :615) >>>>> >>>>> at java.lang.Thread.run(Thread.java:745) >>>>> >>>>> 2014-09-29 16:26:26,137 WARN [c.c.h.x.r.CitrixResourceBase] >>>>> (DirectAgent-235:ctx-7f8db7ac) Unable to clean up VBD due to >>>>> >>>>> You gave an invalid object reference. The object may have recently been >>>>> deleted. The class parameter gives the type of reference given, and the >>>>> handle parameter echoes the bad value given. >>>>> >>>>> at com.xensource.xenapi.Types.checkResponse(Types.java:209) >>>>> >>>>> at com.xensource.xenapi.Connection.dispatch(Connection.java:368) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnec >>>>> t >>>>> ion.dispatch(XenServerConnectionPool.java:909) >>>>> >>>>> at com.xensource.xenapi.VBD.unplug(VBD.java:1059) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure >>>>> ( >>>>> CitrixResourceBase.java:1462) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResour >>>>> c >>>>> eBase.java:1800) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(Citri >>>>> x >>>>> ResourceBase.java:545) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenS >>>>> e >>>>> rver56Resource.java:59) >>>>> >>>>> at >>>>> >>>>> >>>>> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentA >>>>> t >>>>> tache.java:216) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Manage >>>>> d >>>>> ContextRunnable.java:49) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(D >>>>> e >>>>> faultManagedContext.java:56) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWith >>>>> C >>>>> ontext(DefaultManagedContext.java:103) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithC >>>>> o >>>>> ntext(DefaultManagedContext.java:53) >>>>> >>>>> at >>>>> >>>>> >>>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedC >>>>> o >>>>> ntextRunnable.java:46) >>>>> >>>>> at >>>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) >>>>> >>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) >>>>> >>>>> at >>>>> >>>>> >>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.acce >>>>> s >>>>> s$201(ScheduledThreadPoolExecutor.java:178) >>>>> >>>>> at >>>>> >>>>> >>>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run( >>>>> S >>>>> cheduledThreadPoolExecutor.java:292) >>>>> >>>>> at >>>>> >>>>> >>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java >>>>> : >>>>> 1145) >>>>> >>>>> at >>>>> >>>>> >>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav >>>>> a >>>>> :615) >>>>> >>>>> at java.lang.Thread.run(Thread.java:745) >>>>> >>>>> 2014-09-29 16:26:26,138 DEBUG [c.c.h.x.r.CitrixResourceBase] >>>>> (DirectAgent-235:ctx-7f8db7ac) The VM is in stopped state, detected >>>>> problem >>>>> during startup : i-3-98-VM >>>>> >>>>> 2014-09-29 16:26:26,138 DEBUG [c.c.a.m.DirectAgentAttache] >>>>> (DirectAgent-235:ctx-7f8db7ac) Seq 2-868943178: Response Received: >>>>> >>>>> 2014-09-29 16:26:26,141 DEBUG [c.c.a.t.Request] >>>>> (DirectAgent-235:ctx-7f8db7ac) Seq 2-868943178: Processing: { Ans: , >>>>> MgmtId: 233845174730255, via: 2, Ver: v1, Flags: 10, >>>>> >>>>> >>>>> [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":98,"name":"i-3-98-VM","bo >>>>> o >>>>> >>>>> tloader":"PyGrub","type":"User","cpus":1,"minSpeed":2000,"maxSpeed":2000, >>>>> " >>>>> minRam":1782579200,"maxRam":1782579200,"arch":"x86_64","os":"CentOS >>>>> 5.7 >>>>> >>>>> >>>>> (64-bit)","bootArgs":"","rebootOnCrash":false,"enableHA":false,"limitCpuU >>>>> s >>>>> >>>>> e":true,"enableDynamicallyScaleVm":false,"vncPassword":"a19a39dac48334d5" >>>>> , >>>>> >>>>> "params":{"hypervisortoolsversion":"xenserver56"},"uuid":"c474454f-4772-4 >>>>> 4 >>>>> >>>>> 79-b9a5-3829c97006e0","disks":[{"data":{"org.apache.cloudstack.storage.to >>>>> . >>>>> >>>>> VolumeObjectTO":{"uuid":"d348a1d2-18ea-4043-b868-18d3cf8ce21f","volumeTyp >>>>> e >>>>> >>>>> ":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreT >>>>> O >>>>> >>>>> ":{"uuid":"17b0a8a5-2376-3d11-b60e-31eebeafb217","id":202,"poolType":"Net >>>>> w >>>>> >>>>> orkFilesystem","host":"172.30.19.1","path":"/export/primary","port":2049, >>>>> " >>>>> url":"NetworkFilesystem:// >>>>> >>>>> >>>>> 172.30.19.1//export/primary/?ROLE=Primary&STOREUUID=17b0a8a5-2376-3d11-b6 >>>>> 0 >>>>> e-31eebeafb217 >>>>> >>>>> >>>>> "}},"name":"ROOT-98","size":10737418240,"path":"18801349-c195-468a-99db-6 >>>>> 7 >>>>> 534434d137","volumeId":124,"vmName":"i-3- >>>>> 98-VM >>>>> >>>>> >>>>> ","accountId":3,"format":"VHD","id":124,"deviceId":0,"hypervisorType":"Xe >>>>> n >>>>> >>>>> Server"}},"diskSeq":0,"path":"18801349-c195-468a-99db-67534434d137","type >>>>> " >>>>> >>>>> :"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost": >>>>> " >>>>> >>>>> 172.30.19.1","volumeSize":"10737418240"}},{"data":{"org.apache.cloudstack >>>>> . >>>>> >>>>> storage.to.VolumeObjectTO":{"uuid":"9d70a3ed-9737-4a34-8a87-048c067deae0" >>>>> , >>>>> >>>>> "volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.Pr >>>>> i >>>>> >>>>> maryDataStoreTO":{"uuid":"17b0a8a5-2376-3d11-b60e-31eebeafb217","id":202, >>>>> " >>>>> >>>>> poolType":"NetworkFilesystem","host":"172.30.19.1","path":"/export/primar >>>>> y >>>>> ","port":2049,"url":"NetworkFilesystem:// >>>>> >>>>> >>>>> 172.30.19.1//export/primary/?ROLE=Primary&STOREUUID=17b0a8a5-2376-3d11-b6 >>>>> 0 >>>>> e-31eebeafb217 >>>>> >>>>> >>>>> "}},"name":"DATA-98","size":5368709120,"path":"a343a4a0-1a7c-45b6-8e64-1e >>>>> 1 >>>>> ed1bdfd48","volumeId":125,"vmName":"i-3- >>>>> >>>>> >>>>> 98-VM","accountId":3,"format":"VHD","id":125,"deviceId":1,"hypervisorType >>>>> " >>>>> >>>>> :"XenServer"}},"diskSeq":1,"path":"a343a4a0-1a7c-45b6-8e64-1e1ed1bdfd48", >>>>> " >>>>> >>>>> type":"DATADISK","_details":{"managed":"false","storagePort":"2049","stor >>>>> a >>>>> >>>>> geHost":"172.30.19.1","volumeSize":"5368709120"}},{"data":{"org.apache.cl >>>>> o >>>>> >>>>> udstack.storage.to.TemplateObjectTO":{"id":0,"format":"ISO","accountId":0 >>>>> , >>>>> >>>>> "hvm":false}},"diskSeq":3,"type":"ISO"}],"nics":[{"deviceId":0,"networkRa >>>>> t >>>>> >>>>> eMbps":200,"defaultNic":true,"uuid":"a98bcc83-4cbe-41e3-a992-1bd162883816 >>>>> " >>>>> >>>>> ,"ip":"172.30.45.143","netmask":"255.255.255.0","gateway":"172.30.45.1"," >>>>> m >>>>> >>>>> ac":"06:4f:1e:00:00:41","dns1":"172.30.20.176","dns2":"172.30.20.175","br >>>>> o >>>>> >>>>> adcastType":"Vlan","type":"Guest","isSecurityGroupEnabled":false}],"vcpuM >>>>> a >>>>> xLimit":16},"_iqnToPath":{},"result":false,"details":"Unable >>>>> to start i-3-98-VM due to ","wait":0}}] } >>>>> >>>>> 2014-09-29 16:26:26,141 DEBUG [c.c.a.t.Request] >>>>> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Seq 2-868943178: Received: >>>>> { >>>>> Ans: , MgmtId: 233845174730255, via: 2, Ver: v1, Flags: 10, { >>>>> StartAnswer } >>>>> } >>>>> >>>>> 2014-09-29 16:26:26,144 INFO [c.c.v.VirtualMachineManagerImpl] >>>>> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Unable to start VM on >>>>> Host[-2-Routing] due to Unable to start i-3-98-VM due to >>>>> >>>>> 2014-09-29 16:26:26,147 DEBUG [c.c.v.VirtualMachineManagerImpl] >>>>> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Cleaning up resources for >>>>> the >>>>> vm VM[User|sununxcld19] in Starting state >>>>> >>>>> 2014-09-29 16:26:26,150 DEBUG [c.c.a.t.Request] >>>>> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Seq 2-868943180: Sending { >>>>> Cmd >>>>> , MgmtId: 233845174730255, via: 2(srvengxen02), Ver: v1, Flags: 100011, >>>>> >>>>> >>>>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence": >>>>> f >>>>> alse,"vmName":"i-3- >>>>> 98-VM","wait":0}}] } >>>>> >>>>> 2014-09-29 16:26:26,150 DEBUG [c.c.a.t.Request] >>>>> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Seq 2-868943180: Executing: >>>>> { >>>>> Cmd , MgmtId: 233845174730255, via: 2(srvengxen02), Ver: v1, Flags: >>>>> 100011, >>>>> >>>>> >>>>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence": >>>>> f >>>>> alse,"vmName":"i-3- >>>>> 98-VM","wait":0}}] } >>>>> >>>>> 2014-09-29 16:26:26,150 DEBUG [c.c.a.m.DirectAgentAttache] >>>>> (DirectAgent-236:ctx-234da2e1) Seq 2-868943180: Executing request >>>>> >>>>> 2014-09-29 16:26:26,310 INFO [c.c.h.x.r.CitrixResourceBase] >>>>> (DirectAgent-236:ctx-234da2e1) VM does not exist on >>>>> XenServer63befa52-4c03-460a-9557-9100d51cedaf >>>>> >>>>> 2014-09-29 16:26:26,310 DEBUG [c.c.a.m.DirectAgentAttache] >>>>> (DirectAgent-236:ctx-234da2e1) Seq 2-868943180: Response Received: >>>>> >>>>> 2014-09-29 16:26:26,310 DEBUG [c.c.a.t.Request] >>>>> (DirectAgent-236:ctx-234da2e1) Seq 2-868943180: Processing: { Ans: , >>>>> MgmtId: 233845174730255, via: 2, Ver: v1, Flags: 10, >>>>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not >>>>> exist","wait":0}}] } >>>>> >>>>> 2014-09-29 16:26:26,310 DEBUG [c.c.a.t.Request] >>>>> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Seq 2-868943180: Received: >>>>> { >>>>> Ans: , MgmtId: 233845174730255, via: 2, Ver: v1, Flags: 10, { StopAnswer >>>>> } } >>>>> >>>>> 2014-09-29 16:26:26,319 DEBUG [c.c.n.NetworkModelImpl] >>>>> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Service SecurityGroup is not >>>>> supported in the network id=204 >>>>> >>>>> 2014-09-29 16:26:26,321 DEBUG [o.a.c.e.o.NetworkOrchestrator] >>>>> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Changing active number of >>>>> nics >>>>> for network id=204 on -1 >>>>> >>>>> 2014-09-29 16:26:26,326 DEBUG [o.a.c.e.o.NetworkOrchestrator] >>>>> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Asking VirtualRouter to >>>>> release >>>>> >>>>> NicProfile[127-98-c794b1fc-374c-4d69-a469-5ec708074d02-172.30.45.143-null >>>>> >>>>> 2014-09-29 16:26:26,326 DEBUG [c.c.v.VirtualMachineManagerImpl] >>>>> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Successfully released >>>>> network >>>>> resources for the vm VM[User|sununxcld19] >>>>> >>>>> 2014-09-29 16:26:26,326 DEBUG [c.c.v.VirtualMachineManagerImpl] >>>>> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Successfully cleanued up >>>>> resources for the vm VM[User|sununxcld19] in Starting state >>>>> >>>>> 2014-09-29 16:26:26,330 DEBUG [c.c.v.VirtualMachineManagerImpl] >>>>> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Root volume is ready, need >>>>> to >>>>> place VM in volume's cluster >>>>> >>>> >>>> >>> >>> >> >> >> >> >> -- >> Daan > > > > > -- > Daan