On Sun, Jan 25, 2015 at 6:33 AM, Keerthiraja SJ <sjkeer...@gmail.com> wrote:
> its my production environment. I am facing critical issue when if any
> xenserver reboots or if I try to patch up the xenserver  VM's will not
> start. In that case I have to create new instances and do all the setup
> from the scratch, So the downtime will be more than 5 hours.
>
> Is there a way we can resolve this issue.

I would guess the following would help:

UPDATE volumes set state = 'Expunged', removed =  '2015-01-08
20:40:00' WHERE instance_id='1381' AND state = 'Expunging';

Note that somehow some call to the backend didn't return and some
volume dbeb4cf4-0673-48be-b474-ebc5a73d08c7 might still exist
somewhere (in some primary storage). give it some rest to settle after
issuing the statement and then check if it helpen by rebooting the vm.

>
> Thanks,
> Keerthi
>
> On Sat, Jan 24, 2015 at 6:09 PM, Daan Hoogland <daan.hoogl...@gmail.com>
> wrote:
>
>> see inline
>>
>> On Sat, Jan 24, 2015 at 6:00 AM, Keerthiraja SJ <sjkeer...@gmail.com>
>> wrote:
>> > Below are the query ran for the instances which have many root disk.
>> >
>> > mysql> select * from volumes where instance_id='1381';
>> >
>> +------+------------+-----------+---------+--------------+-------------+-----------+-----------+--------------------------------------+-------------+-------------------------+--------------------------------------+--------+----------------+------------+---------+-------------+-----------+------------------+-------------+----------------------------+-------------+---------------------+----------+---------------------+---------+-----------+------------+--------------+-----------+------------------------+--------+----------------+--------+----------+----------+
>> > | id   | account_id | domain_id | pool_id | last_pool_id | instance_id |
>> > device_id | name      | uuid                                 | size
>> > | folder                  | path                                 |
>> pod_id |
>> > data_center_id | iscsi_name | host_ip | volume_type | pool_type |
>> > disk_offering_id | template_id | first_snapshot_backup_uuid |
>> recreatable |
>> > created             | attached | updated             | removed | state
>> > | chain_info | update_count | disk_type | vm_snapshot_chain_size |
>> iso_id |
>> > display_volume | format | min_iops | max_iops |
>> >
>> +------+------------+-----------+---------+--------------+-------------+-----------+-----------+--------------------------------------+-------------+-------------------------+--------------------------------------+--------+----------------+------------+---------+-------------+-----------+------------------+-------------+----------------------------+-------------+---------------------+----------+---------------------+---------+-----------+------------+--------------+-----------+------------------------+--------+----------------+--------+----------+----------+
>> > | 1572 |          2 |         1 |     249 |         NULL |        1381
>> > |         0 | ROOT-1381 | 9ee67199-7af8-4a47-8886-016cfff26b5c |
>> > 21474836480 | NULL                    |
>> > 06a3b4c9-6cfe-45c8-8640-7f562b11e2cb |   NULL |              5 | NULL
>> > | NULL    | ROOT        | NULL      |              125 |         347 |
>> > NULL                       |           0 | 2015-01-08 14:19:27 | NULL
>>  |
>> > 2015-01-08 20:39:59 | NULL    | Ready     | NULL       |            4 |
>> > NULL      |                   NULL |   NULL |              0 | VHD    |
>> > NULL |     NULL |
>> > | 1575 |          2 |         1 |     259 |          249 |        1381
>> > |         0 | ROOT-1381 | dbeb4cf4-0673-48be-b474-ebc5a73d08c7 |
>> > 21474836480 | /vol/cldswp_orprimary03 |
>> > 06a3b4c9-6cfe-45c8-8640-7f562b11e2cb |      5 |              5 | NULL
>> > | NULL    | ROOT        | NULL      |              125 |         347 |
>> > NULL                       |           0 | 2015-01-08 20:25:29 | NULL
>>  |
>> > 2015-01-08 20:39:59 | NULL    | Expunging | NULL       |            6 |
>>
>> here is the problem; the 'Expunging'  value indicates that it is in
>> transit from marked for deletion to actual deletion. I am not sure
>> what caused this but it is not good. The field should contain the
>> value 'Expunged' and the field before should contain the time-stamp of
>> the moment this happened.
>>
>> If this is production, investigate before following my advice blindly.
>> It is code analysis that brought me to this conclusion, not
>> experience.
>>
>> > NULL      |                   NULL |   NULL |              0 | VHD    |
>> > NULL |     NULL |
>> >
>> +------+------------+-----------+---------+--------------+-------------+-----------+-----------+--------------------------------------+-------------+-------------------------+--------------------------------------+--------+----------------+------------+---------+-------------+-----------+------------------+-------------+----------------------------+-------------+---------------------+----------+---------------------+---------+-----------+------------+--------------+-----------+------------------------+--------+----------------+--------+----------+----------+
>> > 2 rows in set (0.00 sec)
>> >
>> >
>> >
>> >
>> > On Fri, Jan 23, 2015 at 5:00 PM, Prashant Kumar Mishra <
>> > prashantkumar.mis...@citrix.com> wrote:
>> >
>> >> Can you check state of these Disks in DB( volumes table for give
>> >> instance_id).
>> >>
>> >> On 1/23/15, 4:46 PM, "Daan Hoogland" <daan.hoogl...@gmail.com> wrote:
>> >>
>> >> >Keerthi,
>> >> >
>> >> >This doesn't ring a bell directly but to investigate further;
>> >> >
>> >> >Did you check in the database whether these are pointing to the same
>> >> >image? This seems like a data corruption, to me.
>> >> >
>> >> >When you say stop/start the vm, do you mean from cloudstack/xenserver
>> >> >or within the vm?
>> >> >
>> >> >On Fri, Jan 23, 2015 at 5:47 AM, Keerthiraja SJ <sjkeer...@gmail.com>
>> >> >wrote:
>> >> >> Anyone can help on this.
>> >> >>
>> >> >> Thanks,
>> >> >> Keerthi
>> >> >>
>> >> >> On Thu, Jan 22, 2015 at 11:46 AM, Keerthiraja SJ <
>> sjkeer...@gmail.com>
>> >> >> wrote:
>> >> >>
>> >> >>> Hi
>> >> >>>
>> >> >>> For one of my Instances I could see many multiple of RootDisk.
>> >> >>>
>> >> >>> Because of this when xenserver reboots or if I stop and start the
>> >> >>> instances my VM is not responding.
>> >> >>>
>> >> >>> How can I fix this issue.
>> >> >>>
>> >> >>> I could see this issue almost out 173 VM's 5 are like this.
>> >> >>>
>> >> >>> *Below are the one pasted from the Storage CS GUI*
>> >> >>>
>> >> >>> ROOT-868ROOTXenServer
>> >> >>>  ROOT-868ROOTXenServeror004-test.net ROOT-868ROOTXenServer
>> >> >>>  ROOT-868ROOTXenServer
>> >> >>>  ROOT-868ROOTXenServer
>> >> >>>  ROOT-868ROOTXenServer
>> >> >>>  ROOT-868ROOTXenServeror004-test.net
>> >> >>> ROOT-868ROOTXenServer
>> >> >>>  ROOT-868ROOTXenServer
>> >> >>>  ROOT-868ROOTXenServer
>> >> >>>  ROOT-868ROOTXenServer
>> >> >>> Thanks,
>> >> >>> Keerthi
>> >> >>>
>> >> >>>
>> >> >
>> >> >
>> >> >
>> >> >--
>> >> >Daan
>> >>
>> >>
>>
>>
>>
>> --
>> Daan
>>



-- 
Daan

Reply via email to