subject:"\[Openstack\] Terminating instance stuck at deleting \- Openstack on Fedora Core 17"

[Openstack] Terminating instance stuck at deleting - Openstack on Fedora Core 17

2012-09-26 Thread Nandakumar Pezhery

Hi Everyone,
I've been working on the FC 17 version of Openstack for few days - single
box implementation.

Request help to fix the below problem which seems to have started after I
configured floating IPs.

In nova.conf,
auto_assign_floating_ip=True

I get the below error in compute.log while terminating an instance (Status
= Active, Task = deleting, Power state = running).

2012-09-26 23:11:11 INFO nova.compute.manager [-] Updating host status
2012-09-26 23:11:58 INFO nova.compute.manager
[req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607
86f7c6c14bc4bc2134ccedae5c77] check_instance_lock: decorating:
|function terminate_instance at 0x1725a28|
2012-09-26 23:11:58 INFO nova.compute.manager
[req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607
86f7c6c14bc4bc2134ccedae5c77] check_instance_lock: arguments:
|nova.compute.manager.ComputeManager object at 0xc93bd0|
|nova.rpc.amqp.RpcContext object at 0x323bc90|
|072fe1b9-904e-4dd9-8624-2860c2e7bef6|
2012-09-26 23:11:58 INFO nova.compute.manager
[req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607
86f7c6c14bc4bc2134ccedae5c77] check_instance_lock: locked: |False|
2012-09-26 23:11:58 INFO nova.compute.manager
[req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607
86f7c6c14bc4bc2134ccedae5c77] check_instance_lock: admin: |True|
2012-09-26 23:11:58 INFO nova.compute.manager
[req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607
86f7c6c14bc4bc2134ccedae5c77] check_instance_lock: executing:
|function terminate_instance at 0x1725a28|
2012-09-26 23:11:58 AUDIT nova.compute.manager
[req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607
86f7c6c14bc4bc2134ccedae5c77] [instance:
072fe1b9-904e-4dd9-8624-2860c2e7bef6] Terminating instance
2012-09-26 23:11:58 ERROR nova.rpc.amqp
[req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607
86f7c6c14bc4bc2134ccedae5c77] Exception during message handling
2012-09-26 23:11:58 TRACE nova.rpc.amqp Traceback (most recent call last):
2012-09-26 23:11:58 TRACE nova.rpc.amqp   File
/usr/lib/python2.7/site-packages/nova/rpc/amqp.py, line 253, in
_process_data
2012-09-26 23:11:58 TRACE nova.rpc.amqp rval = node_func(context=ctxt,
**node_args)
2012-09-26 23:11:58 TRACE nova.rpc.amqp   File
/usr/lib/python2.7/site-packages/nova/exception.py, line 114, in wrapped
2012-09-26 23:11:58 TRACE nova.rpc.amqp return f(*args, **kw)
2012-09-26 23:11:58 TRACE nova.rpc.amqp   File
/usr/lib/python2.7/site-packages/nova/compute/manager.py, line 159, in
decorated_function
2012-09-26 23:11:58 TRACE nova.rpc.amqp function(self, context,
instance_uuid, *args, **kwargs)
2012-09-26 23:11:58 TRACE nova.rpc.amqp   File
/usr/lib/python2.7/site-packages/nova/compute/manager.py, line 183, in
decorated_function
2012-09-26 23:11:58 TRACE nova.rpc.amqp sys.exc_info())
2012-09-26 23:11:58 TRACE nova.rpc.amqp   File
/usr/lib64/python2.7/contextlib.py, line 24, in __exit__
2012-09-26 23:11:58 TRACE nova.rpc.amqp self.gen.next()
2012-09-26 23:11:58 TRACE nova.rpc.amqp   File
/usr/lib/python2.7/site-packages/nova/compute/manager.py, line 177, in
decorated_function
2012-09-26 23:11:58 TRACE nova.rpc.amqp return function(self, context,
instance_uuid, *args, **kwargs)
2012-09-26 23:11:58 TRACE nova.rpc.amqp   File
/usr/lib/python2.7/site-packages/nova/compute/manager.py, line 771, in
terminate_instance
2012-09-26 23:11:58 TRACE nova.rpc.amqp do_terminate_instance()
2012-09-26 23:11:58 TRACE nova.rpc.amqp   File
/usr/lib/python2.7/site-packages/nova/utils.py, line 946, in inner
2012-09-26 23:11:58 TRACE nova.rpc.amqp retval = f(*args, **kwargs)
2012-09-26 23:11:58 TRACE nova.rpc.amqp   File
/usr/lib/python2.7/site-packages/nova/compute/manager.py, line 764, in
do_terminate_instance
2012-09-26 23:11:58 TRACE nova.rpc.amqp self._delete_instance(context,
instance)
2012-09-26 23:11:58 TRACE nova.rpc.amqp   File
/usr/lib/python2.7/site-packages/nova/compute/manager.py, line 742, in
_delete_instance
2012-09-26 23:11:58 TRACE nova.rpc.amqp
self._shutdown_instance(context, instance, 'Terminating')
2012-09-26 23:11:58 TRACE nova.rpc.amqp   File
/usr/lib/python2.7/site-packages/nova/compute/manager.py, line 704, in
_shutdown_instance
2012-09-26 23:11:58 TRACE nova.rpc.amqp
self._deallocate_network(context, instance)
2012-09-26 23:11:58 TRACE nova.rpc.amqp   File
/usr/lib/python2.7/site-packages/nova/compute/manager.py, line 636, in
_deallocate_network
2012-09-26 23:11:58 TRACE nova.rpc.amqp
self.network_api.deallocate_for_instance(context, instance)
2012-09-26 23:11:58 TRACE nova.rpc.amqp   File
/usr/lib/python2.7/site-packages/nova/network/api.py, line 190, in
deallocate_for_instance
2012-09-26 23:11:58 TRACE nova.rpc.amqp 'args': args})
2012-09-26 23:11:58 TRACE nova.rpc.amqp   File

Re: [Openstack] Terminating instance stuck at deleting - Openstack on Fedora Core 17

2012-09-26 Thread Vishvananda Ishaya

Not sure how current the f17 repos are. There was an issue related to this that 
was fixed about a month ago, but it would be great to see if this is 
reproducible on trunk.

Vish

On Sep 26, 2012, at 12:43 PM, Nandakumar Pezhery nandakuma...@gmail.com wrote:

 Hi Everyone,
 I've been working on the FC 17 version of Openstack for few days - single box 
 implementation.
 
 Request help to fix the below problem which seems to have started after I 
 configured floating IPs. 
 
 In nova.conf, 
 auto_assign_floating_ip=True
 
 I get the below error in compute.log while terminating an instance (Status = 
 Active, Task = deleting, Power state = running).
 
 2012-09-26 23:11:11 INFO nova.compute.manager [-] Updating host status
 2012-09-26 23:11:58 INFO nova.compute.manager 
 [req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607 
 86f7c6c14bc4bc2134ccedae5c77] check_instance_lock: decorating: |function 
 terminate_instance at 0x1725a28|
 2012-09-26 23:11:58 INFO nova.compute.manager 
 [req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607 
 86f7c6c14bc4bc2134ccedae5c77] check_instance_lock: arguments: 
 |nova.compute.manager.ComputeManager object at 0xc93bd0| 
 |nova.rpc.amqp.RpcContext object at 0x323bc90| 
 |072fe1b9-904e-4dd9-8624-2860c2e7bef6|
 2012-09-26 23:11:58 INFO nova.compute.manager 
 [req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607 
 86f7c6c14bc4bc2134ccedae5c77] check_instance_lock: locked: |False|
 2012-09-26 23:11:58 INFO nova.compute.manager 
 [req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607 
 86f7c6c14bc4bc2134ccedae5c77] check_instance_lock: admin: |True|
 2012-09-26 23:11:58 INFO nova.compute.manager 
 [req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607 
 86f7c6c14bc4bc2134ccedae5c77] check_instance_lock: executing: |function 
 terminate_instance at 0x1725a28|
 2012-09-26 23:11:58 AUDIT nova.compute.manager 
 [req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607 
 86f7c6c14bc4bc2134ccedae5c77] [instance: 
 072fe1b9-904e-4dd9-8624-2860c2e7bef6] Terminating instance
 2012-09-26 23:11:58 ERROR nova.rpc.amqp 
 [req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607 
 86f7c6c14bc4bc2134ccedae5c77] Exception during message handling
 2012-09-26 23:11:58 TRACE nova.rpc.amqp Traceback (most recent call last):
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib/python2.7/site-packages/nova/rpc/amqp.py, line 253, in 
 _process_data
 2012-09-26 23:11:58 TRACE nova.rpc.amqp rval = node_func(context=ctxt, 
 **node_args)
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib/python2.7/site-packages/nova/exception.py, line 114, in wrapped
 2012-09-26 23:11:58 TRACE nova.rpc.amqp return f(*args, **kw)
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib/python2.7/site-packages/nova/compute/manager.py, line 159, in 
 decorated_function
 2012-09-26 23:11:58 TRACE nova.rpc.amqp function(self, context, 
 instance_uuid, *args, **kwargs)
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib/python2.7/site-packages/nova/compute/manager.py, line 183, in 
 decorated_function
 2012-09-26 23:11:58 TRACE nova.rpc.amqp sys.exc_info())
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib64/python2.7/contextlib.py, line 24, in __exit__
 2012-09-26 23:11:58 TRACE nova.rpc.amqp self.gen.next()
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib/python2.7/site-packages/nova/compute/manager.py, line 177, in 
 decorated_function
 2012-09-26 23:11:58 TRACE nova.rpc.amqp return function(self, context, 
 instance_uuid, *args, **kwargs)
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib/python2.7/site-packages/nova/compute/manager.py, line 771, in 
 terminate_instance
 2012-09-26 23:11:58 TRACE nova.rpc.amqp do_terminate_instance()
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib/python2.7/site-packages/nova/utils.py, line 946, in inner
 2012-09-26 23:11:58 TRACE nova.rpc.amqp retval = f(*args, **kwargs)
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib/python2.7/site-packages/nova/compute/manager.py, line 764, in 
 do_terminate_instance
 2012-09-26 23:11:58 TRACE nova.rpc.amqp self._delete_instance(context, 
 instance)
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib/python2.7/site-packages/nova/compute/manager.py, line 742, in 
 _delete_instance
 2012-09-26 23:11:58 TRACE nova.rpc.amqp self._shutdown_instance(context, 
 instance, 'Terminating')
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib/python2.7/site-packages/nova/compute/manager.py, line 704, in 
 _shutdown_instance
 2012-09-26 23:11:58 TRACE nova.rpc.amqp self._deallocate_network(context, 
 instance)
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib/python2.7/site-packages/nova/compute/manager.py, line 636, in

Re: [Openstack] Terminating instance stuck at deleting - Openstack on Fedora Core 17

2012-09-26 Thread Vishvananda Ishaya

FYI, I just tested on devstack and it looks like it works fine. If you are on 
older code you may be running into this bug:

https://bugs.launchpad.net/nova/+bug/1038266

If you can't update your code, you could check to see if there are deleted 
floating ips in your database:

'SELECT count(*) FROM floating_ips WHERE deleted=1';

and remove them via:

'DELETE FROM floating_ips WHERE deleted=1';

Vish


On Sep 26, 2012, at 3:21 PM, Vishvananda Ishaya vishvana...@gmail.com wrote:

 Not sure how current the f17 repos are. There was an issue related to this 
 that was fixed about a month ago, but it would be great to see if this is 
 reproducible on trunk.
 
 Vish
 
 On Sep 26, 2012, at 12:43 PM, Nandakumar Pezhery nandakuma...@gmail.com 
 wrote:
 
 Hi Everyone,
 I've been working on the FC 17 version of Openstack for few days - single 
 box implementation.
 
 Request help to fix the below problem which seems to have started after I 
 configured floating IPs. 
 
 In nova.conf, 
 auto_assign_floating_ip=True
 
 I get the below error in compute.log while terminating an instance (Status = 
 Active, Task = deleting, Power state = running).
 
 2012-09-26 23:11:11 INFO nova.compute.manager [-] Updating host status
 2012-09-26 23:11:58 INFO nova.compute.manager 
 [req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607 
 86f7c6c14bc4bc2134ccedae5c77] check_instance_lock: decorating: 
 |function terminate_instance at 0x1725a28|
 2012-09-26 23:11:58 INFO nova.compute.manager 
 [req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607 
 86f7c6c14bc4bc2134ccedae5c77] check_instance_lock: arguments: 
 |nova.compute.manager.ComputeManager object at 0xc93bd0| 
 |nova.rpc.amqp.RpcContext object at 0x323bc90| 
 |072fe1b9-904e-4dd9-8624-2860c2e7bef6|
 2012-09-26 23:11:58 INFO nova.compute.manager 
 [req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607 
 86f7c6c14bc4bc2134ccedae5c77] check_instance_lock: locked: |False|
 2012-09-26 23:11:58 INFO nova.compute.manager 
 [req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607 
 86f7c6c14bc4bc2134ccedae5c77] check_instance_lock: admin: |True|
 2012-09-26 23:11:58 INFO nova.compute.manager 
 [req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607 
 86f7c6c14bc4bc2134ccedae5c77] check_instance_lock: executing: |function 
 terminate_instance at 0x1725a28|
 2012-09-26 23:11:58 AUDIT nova.compute.manager 
 [req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607 
 86f7c6c14bc4bc2134ccedae5c77] [instance: 
 072fe1b9-904e-4dd9-8624-2860c2e7bef6] Terminating instance
 2012-09-26 23:11:58 ERROR nova.rpc.amqp 
 [req-0076990a-3037-483b-a60f-9dee2cff362a 53f453879d1245159592afb8380d8607 
 86f7c6c14bc4bc2134ccedae5c77] Exception during message handling
 2012-09-26 23:11:58 TRACE nova.rpc.amqp Traceback (most recent call last):
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib/python2.7/site-packages/nova/rpc/amqp.py, line 253, in 
 _process_data
 2012-09-26 23:11:58 TRACE nova.rpc.amqp rval = node_func(context=ctxt, 
 **node_args)
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib/python2.7/site-packages/nova/exception.py, line 114, in wrapped
 2012-09-26 23:11:58 TRACE nova.rpc.amqp return f(*args, **kw)
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib/python2.7/site-packages/nova/compute/manager.py, line 159, in 
 decorated_function
 2012-09-26 23:11:58 TRACE nova.rpc.amqp function(self, context, 
 instance_uuid, *args, **kwargs)
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib/python2.7/site-packages/nova/compute/manager.py, line 183, in 
 decorated_function
 2012-09-26 23:11:58 TRACE nova.rpc.amqp sys.exc_info())
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib64/python2.7/contextlib.py, line 24, in __exit__
 2012-09-26 23:11:58 TRACE nova.rpc.amqp self.gen.next()
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib/python2.7/site-packages/nova/compute/manager.py, line 177, in 
 decorated_function
 2012-09-26 23:11:58 TRACE nova.rpc.amqp return function(self, context, 
 instance_uuid, *args, **kwargs)
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib/python2.7/site-packages/nova/compute/manager.py, line 771, in 
 terminate_instance
 2012-09-26 23:11:58 TRACE nova.rpc.amqp do_terminate_instance()
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib/python2.7/site-packages/nova/utils.py, line 946, in inner
 2012-09-26 23:11:58 TRACE nova.rpc.amqp retval = f(*args, **kwargs)
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File 
 /usr/lib/python2.7/site-packages/nova/compute/manager.py, line 764, in 
 do_terminate_instance
 2012-09-26 23:11:58 TRACE nova.rpc.amqp self._delete_instance(context, 
 instance)
 2012-09-26 23:11:58 TRACE nova.rpc.amqp   File

Re: [Openstack] Terminating instance stuck at deleting - Openstack on Fedora Core 17

2012-09-26 Thread Pádraig Brady


On 09/26/2012 11:35 PM, Vishvananda Ishaya wrote:

FYI, I just tested on devstack and it looks like it works fine. If you are on 
older code you may be running into this bug:

https://bugs.launchpad.net/nova/+bug/1038266


To confirm.
The last Fedora 17 essex update just missed the above fix.
The next Fedora 17 update is planned for this week.

cheers,
Pádraig.

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp

Re: [Openstack] Terminating instance stuck at deleting - Openstack on Fedora Core 17

2012-09-26 Thread Nandakumar Pezhery

Vishva...that worked. thanks.
Pádraig...thanks for the update.Will test the update.


On Thu, Sep 27, 2012 at 2:58 AM, Pádraig Brady p...@draigbrady.com wrote:

 On 09/26/2012 11:35 PM, Vishvananda Ishaya wrote:

 FYI, I just tested on devstack and it looks like it works fine. If you
 are on older code you may be running into this bug:

 https://bugs.launchpad.net/**nova/+bug/1038266https://bugs.launchpad.net/nova/+bug/1038266


 To confirm.
 The last Fedora 17 essex update just missed the above fix.
 The next Fedora 17 update is planned for this week.

 cheers,
 Pádraig.

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp

[Openstack] Terminating instance stuck at deleting - Openstack on Fedora Core 17

Re: [Openstack] Terminating instance stuck at deleting - Openstack on Fedora Core 17

Re: [Openstack] Terminating instance stuck at deleting - Openstack on Fedora Core 17

Re: [Openstack] Terminating instance stuck at deleting - Openstack on Fedora Core 17

Re: [Openstack] Terminating instance stuck at deleting - Openstack on Fedora Core 17

5 matches

Site Navigation

Mail list logo

Footer information