[ovirt-users] VM migration failed after upgrade to 4.4

2023-06-05 Thread joris dedieu 
Hi list,
I'm troubleshooting an issue with live migration on an upgrade context.
I have a 4.3 cluster that I try to upgrade in 4.4. The engine is OK in
4.4  and I already have upgraded a single host which had kindly
reintegrated the cluster.

The host is OK. I can start vms on it and migrate vms from it to other hosts.

But, if I try to migrate a vm from a 4.3 host to the 4.4 host, it failed with :

* on the host :  qemu-kvm: terminating on signal 15 from pid 
()
* on the engine : VM 'VM_UUID' was unexpectedly detected as 'Down' on
VDS 'HOST_UUID'

Does anyone here can help me to find what's goning on ? I will be greate

regards
Joris
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/ATVRQDSPG3N7SJSDTZWALJ7L657YMZ45/

[ovirt-users] VM migration failed

2023-03-13 Thread dobrodej88 
Hi, when i tried to migrate vm between hardwarehosts? i got an error like

 ERROR (migsrc/53accc0c) [virt.vm] 
(vmId='53accc0c-15c6-4917-a9c9-5237f7f358b1') Cannot access backing file 
'/rhev/data-center/mnt/blockSD/30b8a383-f390-405f-ac0c-4ef7a19207fe/images/ca67b349-5a51-43de-96f0-592db000de05/360f96d3-f63f-43c4-bfd5-3a8fb43bd007'
 of storage file 
'/rhev/data-center/mnt/blockSD/30b8a383-f390-405f-ac0c-4ef7a19207fe/images/ca67b349-5a51-43de-96f0-592db000de05/f3a72252-904c-48b1-8591-f2dabd343b8e'
 (as uid:107, gid:107): No such file or directory (migration:282)


but file are exist 

PROD [root@olvm1 vdsm]# ll 
/rhev/data-center/mnt/blockSD/30b8a383-f390-405f-ac0c-4ef7a19207fe/images/ca67b349-5a51-43de-96f0-592db000de05/360f96d3-f63f-43c4-bfd5-3a8fb43bd007
lrwxrwxrwx. 1 vdsm kvm 78 Mar 10 14:59 
/rhev/data-center/mnt/blockSD/30b8a383-f390-405f-ac0c-4ef7a19207fe/images/ca67b349-5a51-43de-96f0-592db000de05/360f96d3-f63f-43c4-bfd5-3a8fb43bd007
 -> 
/dev/30b8a383-f390-405f-ac0c-4ef7a19207fe/360f96d3-f63f-43c4-bfd5-3a8fb43bd007
PROD [root@olvm1 vdsm]# qemu-img check 
/rhev/data-center/mnt/blockSD/30b8a383-f390-405f-ac0c-4ef7a19207fe/images/ca67b349-5a51-43de-96f0-592db000de05/360f96d3-f63f-43c4-bfd5-3a8fb43bd007
No errors were found on the image.
14/1638400 = 0.00% allocated, 57.14% fragmented, 0.00% compressed clusters
Image end offset: 1310720
PROD [root@olvm1 vdsm]# qemu-img info 
/rhev/data-center/mnt/blockSD/30b8a383-f390-405f-ac0c-4ef7a19207fe/images/ca67b349-5a51-43de-96f0-592db000de05/360f96d3-f63f-43c4-bfd5-3a8fb43bd007
image: 
/rhev/data-center/mnt/blockSD/30b8a383-f390-405f-ac0c-4ef7a19207fe/images/ca67b349-5a51-43de-96f0-592db000de05/360f96d3-f63f-43c4-bfd5-3a8fb43bd007
file format: qcow2
virtual size: 100 GiB (107374182400 bytes)
disk size: 0 B
cluster_size: 65536
backing file: b7c03917-6fd4-4c88-98e3-e8fcdb3955bd (actual path: 
/rhev/data-center/mnt/blockSD/30b8a383-f390-405f-ac0c-4ef7a19207fe/images/ca67b349-5a51-43de-96f0-592db000de05/b7c03917-6fd4-4c88-98e3-e8fcdb3955bd)
backing file format: qcow2
Format specific information:
compat: 1.1
lazy refcounts: false
refcount bits: 16
corrupt: false


Please tell me what the reason could be, thank you
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/Z3ND3RUXHVDB4UIXXRCQC6P5LUMNI45S/

[ovirt-users] vm migration failed with certifacate issue

2022-09-08 Thread parallax 
ovirt 4.4.4.7

not able to migrate VMs between hosts with following vdsm error:

operation failed: Failed to connect to remote libvirt URI
qemu+tls://kvm4.imp.loc/system: authentication failed: Failed to verify
peer's certificate

hosts certificates was renewed recently but hosts hasn't been reloaded
how to fix this issue
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/STDVYZZM3E6Z3W7BSOBEUVVPDKOGEGAI/

[ovirt-users] VM Migration Failed

2022-07-13 Thread KSNull Zero 
Running oVirt 4.4.5
VM cannot migrate between hosts.

vdsm.log contains the following error:
libvirt.libvirtError: operation failed: Failed to connect to remote libvirt URI 
qemu+tls://ovhost01.local/system: authentication failed: Failed to verify 
peer's certificate

Certificates on hosts was renewed some time ago. How this issue can be fixed ?
Thank you.
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/NP3LFDDV32UCE35SUKTJEM3GBWY37IMN/

Re: [ovirt-users] VM Migration Failed

2016-12-16 Thread Michal Skrivanek 
> On 16 Dec 2016, at 19:21, Michael Watters  wrote:
>
> I am running ovirt 3.6 on our cluster

What exact versions of engine, hosts, and cluster level?

> and VM migration is failing.  The
> VDSM logs show an error as follows.
>
> jsonrpc.Executor/7::ERROR::2016-12-16 
> 08:41:04,398::vm::4714::virt.vm::(_updateDevicesDomxmlCache) 
> vmId=`dc419d2b-522a-4e96-b06a-243ec8ede44e`::Alias not found for device type 
> redir during migration at destination host

Where/when was the VM started. Did you upgrade anything while VM was running?

>
> Does anybody know what would cause this?  Both hosts are online and have VMs 
> running.

Are they same versions?

Thanks,
michal

> ___
> Users mailing list
> Users@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
>
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

[ovirt-users] VM Migration Failed

2016-12-16 Thread Michael Watters 
I am running ovirt 3.6 on our cluster and VM migration is failing.  The
VDSM logs show an error as follows.

jsonrpc.Executor/7::ERROR::2016-12-16 
08:41:04,398::vm::4714::virt.vm::(_updateDevicesDomxmlCache) 
vmId=`dc419d2b-522a-4e96-b06a-243ec8ede44e`::Alias not found for device type 
redir during migration at destination host

Does anybody know what would cause this?  Both hosts are online and have VMs 
running.
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [Users] VM Migration failed

2014-01-20 Thread Dafna Ron 
 mailto:users@ovirt.org
mailto:users@ovirt.org, Michal
Skrivanek mskri...@redhat.com
mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
Sent: Friday, January 17, 2014 9:47:11 PM
Subject: Re: [Users] VM Migration failed

On 01/17/2014 06:25 PM, Edgars M. wrote:

Hi Meital

I tried to migrate another VM and
it also failed.

This is what I get in UI:


Migration started (VM: nophpapp01,
Source:
novmnode1, Destination:
novmnode2, User: edgarsm).
Migration failed due to Error:
Fatal error during
migration. Trying to
migrate to another Host (VM:
nophpapp01, Source:
novmnode1, Destination:
novmnode2).
Migration failed due to Error:
Fatal error during
migration (VM:
nophpapp01, Source: novmnode1,
Destination: novmnode2).

There is nothing in
/var/log/messages, neither on
engine server nor nodes.


See attachments for engine and
vdsm logs. (I am
migrating from vmnode1
to vmnode2)


whatever the issue is here, can you
please open a bug on
trying to
return more info to user on the
migration error itself
(for easier
troubleshooting).

thanks,
  Itamar


Thanks for the help
Edgars







On Fri, Jan 17, 2014 at 4:46 PM,
Meital Bourvine
mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com wrote:

  Which error are you getting
in the UI?
  Can you please attach the
full engine and vdsm
logs?
  Also, please check if there
is a relevant
error in /var/log/messages


   
--__--__



  *From: *Edgars M.
edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com
 
mailto:edgars.mazurs@gmail.

mailto:edgars.mazurs@gmail.__com
mailto:edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com
  *To: *users@ovirt.org
mailto:users@ovirt.org
mailto:users@ovirt.org
mailto:users@ovirt.org mailto:users@ovirt.org
mailto:users@ovirt.org
mailto:users@ovirt.org
mailto:users@ovirt.org
  *Sent: *Friday, January
17, 2014 3:42:37 PM
  *Subject: *[Users] VM
Migration failed


  Hi

  I am experiencing issues
with manual VM
migration. VM fails to
  migrate to other node in
the same Cluster.
Here are some

Re: [Users] VM Migration failed

2014-01-20 Thread Dafna Ron 
 17:01:28,917::sampling::355::__vm.Vm::(collect)
 vmId=`b8787906-187a-4234-a0c9-__58fc4ddf2a57`::Stats
function failed:
AdvancedStatsFunction
_highWrite at 0x26efb58

The problem is that it doesn't say
which
process...


this looks like noise post the migration
failing, with probably
a more relevant error in libvirt log


- Original Message -

From: Itamar Heim
ih...@redhat.com mailto:ih...@redhat.com
mailto:ih...@redhat.com
mailto:ih...@redhat.com
mailto:ih...@redhat.com
mailto:ih...@redhat.com

mailto:ih...@redhat.com
mailto:ih...@redhat.com
To: Edgars M.
edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com mailto:edgars.maz...@gmail.com
   
mailto:edgars.maz...@gmail.com mailto:edgars.maz...@gmail.com


mailto:edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com, Meital Bourvine
mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
Cc: users@ovirt.org
mailto:users@ovirt.org
mailto:users@ovirt.org
mailto:users@ovirt.org mailto:users@ovirt.org
mailto:users@ovirt.org

mailto:users@ovirt.org
mailto:users@ovirt.org, Michal
Skrivanek
mskri...@redhat.com mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
mailto:mskri...@redhat.com

mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
Sent: Friday, January 17, 2014
9:47:11 PM
Subject: Re: [Users] VM
Migration failed

On 01/17/2014 06:25 PM, Edgars
M. wrote:

Hi Meital

I tried to migrate another
VM and
it also failed.

This is what I get in UI:


Migration started (VM:
nophpapp01,
Source:
novmnode1, Destination:
novmnode2, User: edgarsm).
Migration failed due to Error:
Fatal error during
migration. Trying to
migrate to another Host (VM:
nophpapp01, Source:
novmnode1, Destination:
novmnode2).
Migration failed due to Error:
Fatal error during
migration (VM:
nophpapp01, Source: novmnode1,
Destination: novmnode2).

There is nothing in
/var/log/messages, neither on
engine server nor nodes.


See attachments for engine and
vdsm logs. (I am
migrating from vmnode1
to vmnode2)


whatever the issue is here,
can you
please open a bug on
trying to
return more info to user on the
migration error itself
(for easier
troubleshooting).

thanks,
  Itamar


Thanks for the help

Re: [Users] VM Migration failed

2014-01-20 Thread Dafna Ron 
...@redhat.com
mailto:mbour...@redhat.com mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
Cc: users@ovirt.org
mailto:users@ovirt.org
mailto:users@ovirt.org mailto:users@ovirt.org
mailto:users@ovirt.org
mailto:users@ovirt.org
mailto:users@ovirt.org mailto:users@ovirt.org
mailto:users@ovirt.org mailto:users@ovirt.org
mailto:users@ovirt.org mailto:users@ovirt.org

mailto:users@ovirt.org
mailto:users@ovirt.org

mailto:users@ovirt.org mailto:users@ovirt.org,
Michal
Skrivanek
mskri...@redhat.com mailto:mskri...@redhat.com
mailto:mskri...@redhat.com mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
mailto:mskri...@redhat.com mailto:mskri...@redhat.com
   
mailto:mskri...@redhat.com mailto:mskri...@redhat.com

mailto:mskri...@redhat.com mailto:mskri...@redhat.com

mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
Sent: Friday, January
17, 2014
9:47:11 PM
Subject: Re: [Users] VM
Migration failed

On 01/17/2014 06:25
PM, Edgars
M. wrote:

Hi Meital

I tried to migrate
another
VM and
it also failed.

This is what I get
in UI:


Migration started (VM:
nophpapp01,
Source:
novmnode1,
Destination:
novmnode2, User:
edgarsm).
Migration failed
due to Error:
Fatal error during
migration. Trying to
migrate to another
Host (VM:
nophpapp01, Source:
novmnode1,
Destination:
novmnode2).
Migration failed
due to Error:
Fatal error during
migration (VM:
nophpapp01, Source: novmnode1,
Destination: novmnode2).

There is nothing in
/var/log/messages, neither on
engine server nor
nodes.


See attachments
for engine and
vdsm logs. (I am
migrating from vmnode1
to vmnode2)


whatever the issue is
here,
can you
please open a bug on
trying to
return more info to
user on the
migration error itself
(for easier
troubleshooting).

thanks,
  Itamar


Thanks for the help
Edgars







On Fri, Jan 17,
2014 at
4:46 PM,
Meital Bourvine

Re: [Users] VM Migration failed

2014-01-20 Thread Dafna Ron 
the migration
failing, with probably
a more relevant error in
libvirt log


- Original Message
-

From: Itamar Heim
ih...@redhat.com mailto:ih...@redhat.com
mailto:ih...@redhat.com mailto:ih...@redhat.com
mailto:ih...@redhat.com
mailto:ih...@redhat.com
mailto:ih...@redhat.com mailto:ih...@redhat.com
mailto:ih...@redhat.com mailto:ih...@redhat.com
mailto:ih...@redhat.com mailto:ih...@redhat.com

mailto:ih...@redhat.com
mailto:ih...@redhat.com
mailto:ih...@redhat.com mailto:ih...@redhat.com
To: Edgars M.
edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com
 mailto:edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com

mailto:edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com, Meital Bourvine
   
mbour...@redhat.com mailto:mbour...@redhat.com

mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
Cc:
users@ovirt.org mailto:users@ovirt.org
mailto:users@ovirt.org mailto:users@ovirt.org
mailto:users@ovirt.org
mailto:users@ovirt.org
mailto:users@ovirt.org mailto:users@ovirt.org
mailto:users@ovirt.org mailto:users@ovirt.org
mailto:users@ovirt.org mailto:users@ovirt.org

mailto:users@ovirt.org
mailto:users@ovirt.org

mailto:users@ovirt.org
mailto:users@ovirt.org, Michal
Skrivanek
mskri...@redhat.com mailto:mskri...@redhat.com
mailto:mskri...@redhat.com mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
mailto:mskri...@redhat.com mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
mailto:mskri...@redhat.com

mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
Sent: Friday, January 17, 2014
9:47:11 PM
Subject: Re: [Users] VM
Migration failed

On 01/17/2014
06:25 PM, Edgars
M. wrote:

Hi Meital

I tried to migrate another
VM and
it also failed.

This is what I get in UI:


Migration started (VM:
nophpapp01,
Source:
novmnode1, Destination:
novmnode2, User: edgarsm).
Migration failed due to Error:
Fatal error during
migration. Trying to
migrate to another Host (VM:
nophpapp01, Source:
novmnode1, Destination:
novmnode2).
Migration failed due to Error:
Fatal error during
migration (VM:
nophpapp01, Source: novmnode1,
Destination: novmnode2).

There is nothing in
/var/log/messages, neither

Re: [Users] VM Migration failed

2014-01-20 Thread Dafna Ron 
...@redhat.com
mailto:mskri...@redhat.com

   
mailto:mskri...@redhat.com mailto:mskri...@redhat.com

mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
mailto:mskri...@redhat.com
Sent: Friday, January 17, 2014
9:47:11 PM
Subject: Re: [Users] VM
Migration failed

On 01/17/2014
06:25 PM, Edgars
M. wrote:

Hi Meital

I tried to migrate another
VM and
it also failed.

This is what I get in UI:


Migration started (VM:
nophpapp01,
Source:
novmnode1, Destination:
novmnode2, User: edgarsm).
Migration failed due to Error:
Fatal error during
migration. Trying to
migrate to another Host (VM:
nophpapp01, Source:
novmnode1, Destination:
novmnode2).
Migration failed due to Error:
Fatal error during
migration (VM:
nophpapp01, Source: novmnode1,
Destination: novmnode2).

There is nothing in
/var/log/messages, neither on
engine server nor nodes.


See attachments for engine and
vdsm logs. (I am
migrating from vmnode1
to vmnode2)


whatever the issue is here,
can you
please open a bug on
trying to
return more info to user on the
migration error itself
(for easier
troubleshooting).

thanks,
  Itamar


Thanks for the help
Edgars







On Fri, Jan 17, 2014 at
4:46 PM,
Meital Bourvine
mbour...@redhat.com mailto:mbour...@redhat.com
mailto:mbour...@redhat.com mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
   
mailto:mbour...@redhat.com mailto:mbour...@redhat.com

mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
   
mailto:mbour...@redhat.com mailto:mbour...@redhat.com

mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
   mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
   
mailto:mbour...@redhat.com mailto:mbour...@redhat.com

mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
   mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com mailto:mbour...@redhat.com

Re: [Users] VM Migration failed

2014-01-18 Thread Dafna Ron 
I looked at the logs log and only vdsm from node2 (which appears to be 
the src node) seems to have full info.


Please attach the following complete logs:
vdsm log from dst node
engine log
libvirt logs from both nodes.

Also, can you please answer the following?
libvirt and vdsm you are using?
what is selinux status on both hosts (enforcing/permissive)?
do you have snapshots on the vm or does it happen on a newly created disk?
when you create the disk, is it from a template or is it a new image?

Thanks,

Dafna



On 01/17/2014 10:21 PM, Itamar Heim wrote:

On 01/18/2014 12:07 AM, Meital Bourvine wrote:

I opened a bug about missing info in UI:
https://bugzilla.redhat.com/show_bug.cgi?id=1054994

It actually failed with this error:
Thread-1417::DEBUG::2014-01-17 17:01:28,344::vm::768::vm.Vm::(run) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::starting migration 
monitor thread
Thread-1415::DEBUG::2014-01-17 
17:01:28,409::libvirtconnection::108::libvirtconnection::(wrapper) 
Unknown libvirterror: ecode: 38 edom: 42 level: 2 message: Failed to 
inquire lock: No such process
Thread-1415::DEBUG::2014-01-17 17:01:28,409::vm::745::vm.Vm::(cancel) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::canceling migration 
downtime thread
Thread-1415::DEBUG::2014-01-17 17:01:28,409::vm::815::vm.Vm::(stop) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::stopping migration 
monitor thread
Thread-1416::DEBUG::2014-01-17 17:01:28,409::vm::742::vm.Vm::(run) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::migration downtime 
thread exiting
Thread-1415::ERROR::2014-01-17 
17:01:28,410::vm::238::vm.Vm::(_recover) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::Failed to inquire lock: 
No such process
Thread-1415::ERROR::2014-01-17 17:01:28,619::vm::337::vm.Vm::(run) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::Failed to migrate

Traceback (most recent call last):
   File /usr/share/vdsm/vm.py, line 323, in run
 self._startUnderlyingMigration()
   File /usr/share/vdsm/vm.py, line 400, in _startUnderlyingMigration
 None, maxBandwidth)
   File /usr/share/vdsm/vm.py, line 838, in f
 ret = attr(*args, **kwargs)
   File 
/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py, line 
76, in wrapper

 ret = f(*args, **kwargs)
   File /usr/lib64/python2.6/site-packages/libvirt.py, line 1178, 
in migrateToURI2
 if ret == -1: raise libvirtError ('virDomainMigrateToURI2() 
failed', dom=self)

libvirtError: Failed to inquire lock: No such process
Thread-26::ERROR::2014-01-17 
17:01:28,917::sampling::355::vm.Vm::(collect) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::Stats function failed: 
AdvancedStatsFunction _highWrite at 0x26efb58


The problem is that it doesn't say which process...


this looks like noise post the migration failing, with probably a more 
relevant error in libvirt log




- Original Message -

From: Itamar Heim ih...@redhat.com
To: Edgars M. edgars.maz...@gmail.com, Meital Bourvine 
mbour...@redhat.com

Cc: users@ovirt.org, Michal Skrivanek mskri...@redhat.com
Sent: Friday, January 17, 2014 9:47:11 PM
Subject: Re: [Users] VM Migration failed

On 01/17/2014 06:25 PM, Edgars M. wrote:

Hi Meital

I tried to migrate another VM and it also failed.

This is what I get in UI:


Migration started (VM: nophpapp01, Source: novmnode1, Destination:
novmnode2, User: edgarsm).
Migration failed due to Error: Fatal error during migration. Trying to
migrate to another Host (VM: nophpapp01, Source: novmnode1, 
Destination:

novmnode2).
Migration failed due to Error: Fatal error during migration (VM:
nophpapp01, Source: novmnode1, Destination: novmnode2).

There is nothing in /var/log/messages, neither on engine server nor 
nodes.



See attachments for engine and vdsm logs. (I am migrating from vmnode1
to vmnode2)


whatever the issue is here, can you please open a bug on trying to
return more info to user on the migration error itself (for easier
troubleshooting).

thanks,
 Itamar



Thanks for the help
Edgars







On Fri, Jan 17, 2014 at 4:46 PM, Meital Bourvine mbour...@redhat.com
mailto:mbour...@redhat.com wrote:

 Which error are you getting in the UI?
 Can you please attach the full engine and vdsm logs?
 Also, please check if there is a relevant error in 
/var/log/messages



 



 *From: *Edgars M. edgars.maz...@gmail.com
 mailto:edgars.maz...@gmail.com
 *To: *users@ovirt.org mailto:users@ovirt.org
 *Sent: *Friday, January 17, 2014 3:42:37 PM
 *Subject: *[Users] VM Migration failed


 Hi

 I am experiencing issues with manual VM migration. VM 
fails to

 migrate to other node in the same Cluster. Here are some
 relevant engine.log entries:

 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo]
 (DefaultQuartzScheduler_Worker-73) Rerun vm
 a31cfd62-26fc-4396-8a83-1aed68c7fd39. Called from vds 
novmnode1

Re: [Users] VM Migration failed

2014-01-18 Thread Edgars M. 
Hi

Thanks for your help. I will provide all log files a little bit later, but
so far I have noticed some pattern when migration fails. Those particular
VMs, which fails to migrate, were installed from ISO image, usual
installation. So, I believe you can reproduce the issue by this:

1. Upload ISO image to ISO domain
2. Install new OS by booting from ISO image and check Attach CD in Boot
Options
3. Delete ISO image from ISO domain
4. Try to migrate VM to another host.


I have not tried this yet, but I have noticed that only those VMs fails
which had been install from ISO image which is not in ISO domain anymore. I
have also VMs created from templates and those VMs I can migrate just fine.

I will provide more log files later.

BR
Edgars


On Sat, Jan 18, 2014 at 1:05 PM, Dafna Ron d...@redhat.com wrote:

 I looked at the logs log and only vdsm from node2 (which appears to be the
 src node) seems to have full info.

 Please attach the following complete logs:
 vdsm log from dst node
 engine log
 libvirt logs from both nodes.

 Also, can you please answer the following?
 libvirt and vdsm you are using?
 what is selinux status on both hosts (enforcing/permissive)?
 do you have snapshots on the vm or does it happen on a newly created disk?
 when you create the disk, is it from a template or is it a new image?

 Thanks,

 Dafna




 On 01/17/2014 10:21 PM, Itamar Heim wrote:

 On 01/18/2014 12:07 AM, Meital Bourvine wrote:

 I opened a bug about missing info in UI:
 https://bugzilla.redhat.com/show_bug.cgi?id=1054994

 It actually failed with this error:
 Thread-1417::DEBUG::2014-01-17 17:01:28,344::vm::768::vm.Vm::(run)
 vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::starting migration monitor
 thread
 Thread-1415::DEBUG::2014-01-17 
 17:01:28,409::libvirtconnection::108::libvirtconnection::(wrapper)
 Unknown libvirterror: ecode: 38 edom: 42 level: 2 message: Failed to
 inquire lock: No such process
 Thread-1415::DEBUG::2014-01-17 17:01:28,409::vm::745::vm.Vm::(cancel)
 vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::canceling migration
 downtime thread
 Thread-1415::DEBUG::2014-01-17 17:01:28,409::vm::815::vm.Vm::(stop)
 vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::stopping migration monitor
 thread
 Thread-1416::DEBUG::2014-01-17 17:01:28,409::vm::742::vm.Vm::(run)
 vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::migration downtime thread
 exiting
 Thread-1415::ERROR::2014-01-17 17:01:28,410::vm::238::vm.Vm::(_recover)
 vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::Failed to inquire lock: No
 such process
 Thread-1415::ERROR::2014-01-17 17:01:28,619::vm::337::vm.Vm::(run)
 vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::Failed to migrate
 Traceback (most recent call last):
File /usr/share/vdsm/vm.py, line 323, in run
  self._startUnderlyingMigration()
File /usr/share/vdsm/vm.py, line 400, in _startUnderlyingMigration
  None, maxBandwidth)
File /usr/share/vdsm/vm.py, line 838, in f
  ret = attr(*args, **kwargs)
File /usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py,
 line 76, in wrapper
  ret = f(*args, **kwargs)
File /usr/lib64/python2.6/site-packages/libvirt.py, line 1178, in
 migrateToURI2
  if ret == -1: raise libvirtError ('virDomainMigrateToURI2()
 failed', dom=self)
 libvirtError: Failed to inquire lock: No such process
 Thread-26::ERROR::2014-01-17 17:01:28,917::sampling::355::vm.Vm::(collect)
 vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::Stats function failed:
 AdvancedStatsFunction _highWrite at 0x26efb58

 The problem is that it doesn't say which process...


 this looks like noise post the migration failing, with probably a more
 relevant error in libvirt log


 - Original Message -

 From: Itamar Heim ih...@redhat.com
 To: Edgars M. edgars.maz...@gmail.com, Meital Bourvine 
 mbour...@redhat.com
 Cc: users@ovirt.org, Michal Skrivanek mskri...@redhat.com
 Sent: Friday, January 17, 2014 9:47:11 PM
 Subject: Re: [Users] VM Migration failed

 On 01/17/2014 06:25 PM, Edgars M. wrote:

 Hi Meital

 I tried to migrate another VM and it also failed.

 This is what I get in UI:


 Migration started (VM: nophpapp01, Source: novmnode1, Destination:
 novmnode2, User: edgarsm).
 Migration failed due to Error: Fatal error during migration. Trying to
 migrate to another Host (VM: nophpapp01, Source: novmnode1,
 Destination:
 novmnode2).
 Migration failed due to Error: Fatal error during migration (VM:
 nophpapp01, Source: novmnode1, Destination: novmnode2).

 There is nothing in /var/log/messages, neither on engine server nor
 nodes.


 See attachments for engine and vdsm logs. (I am migrating from vmnode1
 to vmnode2)


 whatever the issue is here, can you please open a bug on trying to
 return more info to user on the migration error itself (for easier
 troubleshooting).

 thanks,
  Itamar


 Thanks for the help
 Edgars







 On Fri, Jan 17, 2014 at 4:46 PM, Meital Bourvine mbour...@redhat.com
 mailto:mbour...@redhat.com wrote:

  Which error are you

Re: [Users] VM Migration failed

2014-01-18 Thread Itamar Heim 
...@redhat.com
Cc: users@ovirt.org mailto:users@ovirt.org, Michal
Skrivanek mskri...@redhat.com
mailto:mskri...@redhat.com
Sent: Friday, January 17, 2014 9:47:11 PM
Subject: Re: [Users] VM Migration failed

On 01/17/2014 06:25 PM, Edgars M. wrote:

Hi Meital

I tried to migrate another VM and it also failed.

This is what I get in UI:


Migration started (VM: nophpapp01, Source:
novmnode1, Destination:
novmnode2, User: edgarsm).
Migration failed due to Error: Fatal error during
migration. Trying to
migrate to another Host (VM: nophpapp01, Source:
novmnode1, Destination:
novmnode2).
Migration failed due to Error: Fatal error during
migration (VM:
nophpapp01, Source: novmnode1, Destination: novmnode2).

There is nothing in /var/log/messages, neither on
engine server nor nodes.


See attachments for engine and vdsm logs. (I am
migrating from vmnode1
to vmnode2)


whatever the issue is here, can you please open a bug on
trying to
return more info to user on the migration error itself
(for easier
troubleshooting).

thanks,
  Itamar


Thanks for the help
Edgars







On Fri, Jan 17, 2014 at 4:46 PM, Meital Bourvine
mbour...@redhat.com mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com wrote:

  Which error are you getting in the UI?
  Can you please attach the full engine and vdsm
logs?
  Also, please check if there is a relevant
error in /var/log/messages



--__--__


  *From: *Edgars M.
edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com
  mailto:edgars.mazurs@gmail.__com
mailto:edgars.maz...@gmail.com
  *To: *users@ovirt.org
mailto:users@ovirt.org mailto:users@ovirt.org
mailto:users@ovirt.org
  *Sent: *Friday, January 17, 2014 3:42:37 PM
  *Subject: *[Users] VM Migration failed


  Hi

  I am experiencing issues with manual VM
migration. VM fails to
  migrate to other node in the same Cluster.
Here are some
  relevant engine.log entries:

  ERROR
[org.ovirt.engine.core.__vdsbroker.__VdsUpdateRunTimeInfo]
  (DefaultQuartzScheduler___Worker-73) Rerun vm
  a31cfd62-26fc-4396-8a83-__1aed68c7fd39.
Called from vds novmnode1

  ERROR

[org.ovirt.engine.core.__vdsbroker.vdsbroker.__MigrateStatusVDSCommand]
  (pool-6-thread-49) Failed in
MigrateStatusVDS method

  ERROR

[org.ovirt.engine.core.__vdsbroker.vdsbroker.__MigrateStatusVDSCommand]
  (pool-6-thread-49) Error code migrateErr
and error message
  VDSGenericException: VDSErrorException:
Failed to
  MigrateStatusVDS, error = Fatal error
during migration

  ERROR

[org.ovirt.engine.core.__vdsbroker.vdsbroker.__MigrateStatusVDSCommand]
  (pool-6-thread-49) Command
MigrateStatusVDS execution failed.
  Exception: VDSErrorException:
VDSGenericException:
  VDSErrorException: Failed to
MigrateStatusVDS, error = Fatal
  error during migration

  Both Engine and Node are running CentOS
6.5 x64. oVirt Engine
  Version: 3.3.2-1.el6. VDSM version
4.13.2-1. I restarted engine
  and vdsm, that did not help

Re: [Users] VM Migration failed

2014-01-18 Thread Michal Skrivanek 
 relevant error in libvirt log
 
 
- Original Message -
 
From: Itamar Heim ih...@redhat.com
mailto:ih...@redhat.com
To: Edgars M. edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com, Meital Bourvine
mbour...@redhat.com mailto:mbour...@redhat.com
Cc: users@ovirt.org mailto:users@ovirt.org, Michal
Skrivanek mskri...@redhat.com
mailto:mskri...@redhat.com
Sent: Friday, January 17, 2014 9:47:11 PM
Subject: Re: [Users] VM Migration failed
 
On 01/17/2014 06:25 PM, Edgars M. wrote:
 
Hi Meital
 
I tried to migrate another VM and it also failed.
 
This is what I get in UI:
 
 
Migration started (VM: nophpapp01, Source:
novmnode1, Destination:
novmnode2, User: edgarsm).
Migration failed due to Error: Fatal error during
migration. Trying to
migrate to another Host (VM: nophpapp01, Source:
novmnode1, Destination:
novmnode2).
Migration failed due to Error: Fatal error during
migration (VM:
nophpapp01, Source: novmnode1, Destination: novmnode2).
 
There is nothing in /var/log/messages, neither on
engine server nor nodes.
 
 
See attachments for engine and vdsm logs. (I am
migrating from vmnode1
to vmnode2)
 
 
whatever the issue is here, can you please open a bug on
trying to
return more info to user on the migration error itself
(for easier
troubleshooting).
 
thanks,
  Itamar
 
 
Thanks for the help
Edgars
 
 
 
 
 
 
 
On Fri, Jan 17, 2014 at 4:46 PM, Meital Bourvine
mbour...@redhat.com mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com wrote:
 
  Which error are you getting in the UI?
  Can you please attach the full engine and vdsm
logs?
  Also, please check if there is a relevant
error in /var/log/messages
 
 

 --__--__
 
 
  *From: *Edgars M.
edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com
  mailto:edgars.mazurs@gmail.__com
mailto:edgars.maz...@gmail.com
  *To: *users@ovirt.org
mailto:users@ovirt.org mailto:users@ovirt.org
mailto:users@ovirt.org
  *Sent: *Friday, January 17, 2014 3:42:37 PM
  *Subject: *[Users] VM Migration failed
 
 
  Hi
 
  I am experiencing issues with manual VM
migration. VM fails to
  migrate to other node in the same Cluster.
Here are some
  relevant engine.log entries:
 
  ERROR
[org.ovirt.engine.core.__vdsbroker.__VdsUpdateRunTimeInfo]
  (DefaultQuartzScheduler___Worker-73) Rerun vm
  a31cfd62-26fc-4396-8a83-__1aed68c7fd39.
Called from vds novmnode1
 
  ERROR

 [org.ovirt.engine.core.__vdsbroker.vdsbroker.__MigrateStatusVDSCommand]
  (pool-6-thread-49) Failed in
MigrateStatusVDS method
 
  ERROR

 [org.ovirt.engine.core.__vdsbroker.vdsbroker.__MigrateStatusVDSCommand]
  (pool-6-thread-49) Error code migrateErr
and error message
  VDSGenericException: VDSErrorException:
Failed to
  MigrateStatusVDS, error = Fatal error
during migration
 
  ERROR

 [org.ovirt.engine.core.__vdsbroker.vdsbroker.__MigrateStatusVDSCommand]
  (pool-6-thread-49) Command
MigrateStatusVDS execution failed.
  Exception: VDSErrorException:
VDSGenericException:
  VDSErrorException: Failed to
MigrateStatusVDS, error

Re: [Users] VM Migration failed

2014-01-18 Thread Dafna Ron 
function failed: AdvancedStatsFunction _highWrite at 0x26efb58

The problem is that it doesn't say which process...


this looks like noise post the migration failing, with probably
a more relevant error in libvirt log


- Original Message -

From: Itamar Heim ih...@redhat.com
mailto:ih...@redhat.com
To: Edgars M. edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com, Meital Bourvine
mbour...@redhat.com mailto:mbour...@redhat.com
Cc: users@ovirt.org mailto:users@ovirt.org, Michal
Skrivanek mskri...@redhat.com
mailto:mskri...@redhat.com
Sent: Friday, January 17, 2014 9:47:11 PM
Subject: Re: [Users] VM Migration failed

On 01/17/2014 06:25 PM, Edgars M. wrote:

Hi Meital

I tried to migrate another VM and it also failed.

This is what I get in UI:


Migration started (VM: nophpapp01, Source:
novmnode1, Destination:
novmnode2, User: edgarsm).
Migration failed due to Error: Fatal error during
migration. Trying to
migrate to another Host (VM: nophpapp01, Source:
novmnode1, Destination:
novmnode2).
Migration failed due to Error: Fatal error during
migration (VM:
nophpapp01, Source: novmnode1, Destination: novmnode2).

There is nothing in /var/log/messages, neither on
engine server nor nodes.


See attachments for engine and vdsm logs. (I am
migrating from vmnode1
to vmnode2)


whatever the issue is here, can you please open a bug on
trying to
return more info to user on the migration error itself
(for easier
troubleshooting).

thanks,
  Itamar


Thanks for the help
Edgars







On Fri, Jan 17, 2014 at 4:46 PM, Meital Bourvine
mbour...@redhat.com mailto:mbour...@redhat.com
mailto:mbour...@redhat.com
mailto:mbour...@redhat.com wrote:

  Which error are you getting in the UI?
  Can you please attach the full engine and vdsm
logs?
  Also, please check if there is a relevant
error in /var/log/messages



--__--__


  *From: *Edgars M.
edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com
  mailto:edgars.mazurs@gmail.__com
mailto:edgars.maz...@gmail.com
  *To: *users@ovirt.org
mailto:users@ovirt.org mailto:users@ovirt.org
mailto:users@ovirt.org
  *Sent: *Friday, January 17, 2014 3:42:37 PM
  *Subject: *[Users] VM Migration failed


  Hi

  I am experiencing issues with manual VM
migration. VM fails to
  migrate to other node in the same Cluster.
Here are some
  relevant engine.log entries:

  ERROR
[org.ovirt.engine.core.__vdsbroker.__VdsUpdateRunTimeInfo]
  (DefaultQuartzScheduler___Worker-73) Rerun vm
  a31cfd62-26fc-4396-8a83-__1aed68c7fd39.
Called from vds novmnode1

  ERROR

[org.ovirt.engine.core.__vdsbroker.vdsbroker.__MigrateStatusVDSCommand]
  (pool-6-thread-49) Failed in
MigrateStatusVDS method

  ERROR

[org.ovirt.engine.core.__vdsbroker.vdsbroker.__MigrateStatusVDSCommand]
  (pool-6-thread-49) Error code migrateErr
and error message
  VDSGenericException: VDSErrorException:
Failed to
  MigrateStatusVDS, error = Fatal error
during migration

  ERROR

[org.ovirt.engine.core.__vdsbroker.vdsbroker.__MigrateStatusVDSCommand]
  (pool-6-thread-49) Command
MigrateStatusVDS execution failed

Re: [Users] VM Migration failed

2014-01-17 Thread Meital Bourvine 
Which error are you getting in the UI? 
Can you please attach the full engine and vdsm logs? 
Also, please check if there is a relevant error in /var/log/messages 

- Original Message -

 From: Edgars M. edgars.maz...@gmail.com
 To: users@ovirt.org
 Sent: Friday, January 17, 2014 3:42:37 PM
 Subject: [Users] VM Migration failed

 Hi

 I am experiencing issues with manual VM migration. VM fails to migrate to
 other node in the same Cluster. Here are some relevant engine.log entries:

 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo]
 (DefaultQuartzScheduler_Worker-73) Rerun vm
 a31cfd62-26fc-4396-8a83-1aed68c7fd39. Called from vds novmnode1

 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand]
 (pool-6-thread-49) Failed in MigrateStatusVDS method

 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand]
 (pool-6-thread-49) Error code migrateErr and error message
 VDSGenericException: VDSErrorException: Failed to MigrateStatusVDS, error =
 Fatal error during migration

 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand]
 (pool-6-thread-49) Command MigrateStatusVDS execution failed. Exception:
 VDSErrorException: VDSGenericException: VDSErrorException: Failed to
 MigrateStatusVDS, error = Fatal error during migration

 Both Engine and Node are running CentOS 6.5 x64. oVirt Engine Version:
 3.3.2-1.el6. VDSM version 4.13.2-1. I restarted engine and vdsm, that did
 not help.

 Also in vdsm log file I see the following errors related to the same VM ID:

 Thread-27::ERROR::2014-01-17 16:37:06,271::sampling::355::vm.Vm::(collect)
 vmId=`a31cfd62-26fc-4396-8a83-1aed68c7fd39`::Stats function failed:
 AdvancedStatsFunction _highWrite at 0x26efb58

 Any hints?

 BR
 Edgars

 ___
 Users mailing list
 Users@ovirt.org
 http://lists.ovirt.org/mailman/listinfo/users
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [Users] VM Migration failed

2014-01-17 Thread Itamar Heim 

On 01/17/2014 06:25 PM, Edgars M. wrote:

Hi Meital

I tried to migrate another VM and it also failed.

This is what I get in UI:


Migration started (VM: nophpapp01, Source: novmnode1, Destination:
novmnode2, User: edgarsm).
Migration failed due to Error: Fatal error during migration. Trying to
migrate to another Host (VM: nophpapp01, Source: novmnode1, Destination:
novmnode2).
Migration failed due to Error: Fatal error during migration (VM:
nophpapp01, Source: novmnode1, Destination: novmnode2).

There is nothing in /var/log/messages, neither on engine server nor nodes.


See attachments for engine and vdsm logs. (I am migrating from vmnode1
to vmnode2)


whatever the issue is here, can you please open a bug on trying to 
return more info to user on the migration error itself (for easier 
troubleshooting).


thanks,
   Itamar



Thanks for the help
Edgars







On Fri, Jan 17, 2014 at 4:46 PM, Meital Bourvine mbour...@redhat.com
mailto:mbour...@redhat.com wrote:

Which error are you getting in the UI?
Can you please attach the full engine and vdsm logs?
Also, please check if there is a relevant error in /var/log/messages




*From: *Edgars M. edgars.maz...@gmail.com
mailto:edgars.maz...@gmail.com
*To: *users@ovirt.org mailto:users@ovirt.org
*Sent: *Friday, January 17, 2014 3:42:37 PM
*Subject: *[Users] VM Migration failed


Hi

I am experiencing issues with manual VM migration. VM fails to
migrate to other node in the same Cluster. Here are some
relevant engine.log entries:

ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo]
(DefaultQuartzScheduler_Worker-73) Rerun vm
a31cfd62-26fc-4396-8a83-1aed68c7fd39. Called from vds novmnode1

ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand]
(pool-6-thread-49) Failed in MigrateStatusVDS method

ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand]
(pool-6-thread-49) Error code migrateErr and error message
VDSGenericException: VDSErrorException: Failed to
MigrateStatusVDS, error = Fatal error during migration

ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand]
(pool-6-thread-49) Command MigrateStatusVDS execution failed.
Exception: VDSErrorException: VDSGenericException:
VDSErrorException: Failed to MigrateStatusVDS, error = Fatal
error during migration

Both Engine and Node are running CentOS 6.5 x64. oVirt Engine
Version: 3.3.2-1.el6. VDSM version 4.13.2-1. I restarted engine
and vdsm, that did not help.

Also in vdsm log file I see the following errors related to the
same VM ID:

Thread-27::ERROR::2014-01-17
16:37:06,271::sampling::355::vm.Vm::(collect)
vmId=`a31cfd62-26fc-4396-8a83-1aed68c7fd39`::Stats function
failed: AdvancedStatsFunction _highWrite at 0x26efb58

Any hints?

BR
Edgars

___
Users mailing list
Users@ovirt.org mailto:Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users





___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users




___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [Users] VM Migration failed

2014-01-17 Thread Meital Bourvine 
I opened a bug about missing info in UI:
https://bugzilla.redhat.com/show_bug.cgi?id=1054994

It actually failed with this error:
Thread-1417::DEBUG::2014-01-17 17:01:28,344::vm::768::vm.Vm::(run) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::starting migration monitor thread
Thread-1415::DEBUG::2014-01-17 
17:01:28,409::libvirtconnection::108::libvirtconnection::(wrapper) Unknown 
libvirterror: ecode: 38 edom: 42 level: 2 message: Failed to inquire lock: No 
such process
Thread-1415::DEBUG::2014-01-17 17:01:28,409::vm::745::vm.Vm::(cancel) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::canceling migration downtime thread
Thread-1415::DEBUG::2014-01-17 17:01:28,409::vm::815::vm.Vm::(stop) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::stopping migration monitor thread
Thread-1416::DEBUG::2014-01-17 17:01:28,409::vm::742::vm.Vm::(run) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::migration downtime thread exiting
Thread-1415::ERROR::2014-01-17 17:01:28,410::vm::238::vm.Vm::(_recover) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::Failed to inquire lock: No such 
process
Thread-1415::ERROR::2014-01-17 17:01:28,619::vm::337::vm.Vm::(run) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::Failed to migrate
Traceback (most recent call last):
  File /usr/share/vdsm/vm.py, line 323, in run
self._startUnderlyingMigration()
  File /usr/share/vdsm/vm.py, line 400, in _startUnderlyingMigration
None, maxBandwidth)
  File /usr/share/vdsm/vm.py, line 838, in f
ret = attr(*args, **kwargs)
  File /usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py, line 76, 
in wrapper
ret = f(*args, **kwargs)
  File /usr/lib64/python2.6/site-packages/libvirt.py, line 1178, in 
migrateToURI2
if ret == -1: raise libvirtError ('virDomainMigrateToURI2() failed', 
dom=self)
libvirtError: Failed to inquire lock: No such process
Thread-26::ERROR::2014-01-17 17:01:28,917::sampling::355::vm.Vm::(collect) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::Stats function failed: 
AdvancedStatsFunction _highWrite at 0x26efb58

The problem is that it doesn't say which process...

- Original Message -
 From: Itamar Heim ih...@redhat.com
 To: Edgars M. edgars.maz...@gmail.com, Meital Bourvine 
 mbour...@redhat.com
 Cc: users@ovirt.org, Michal Skrivanek mskri...@redhat.com
 Sent: Friday, January 17, 2014 9:47:11 PM
 Subject: Re: [Users] VM Migration failed
 
 On 01/17/2014 06:25 PM, Edgars M. wrote:
  Hi Meital
 
  I tried to migrate another VM and it also failed.
 
  This is what I get in UI:
 
 
  Migration started (VM: nophpapp01, Source: novmnode1, Destination:
  novmnode2, User: edgarsm).
  Migration failed due to Error: Fatal error during migration. Trying to
  migrate to another Host (VM: nophpapp01, Source: novmnode1, Destination:
  novmnode2).
  Migration failed due to Error: Fatal error during migration (VM:
  nophpapp01, Source: novmnode1, Destination: novmnode2).
 
  There is nothing in /var/log/messages, neither on engine server nor nodes.
 
 
  See attachments for engine and vdsm logs. (I am migrating from vmnode1
  to vmnode2)
 
 whatever the issue is here, can you please open a bug on trying to
 return more info to user on the migration error itself (for easier
 troubleshooting).
 
 thanks,
 Itamar
 
 
  Thanks for the help
  Edgars
 
 
 
 
 
 
 
  On Fri, Jan 17, 2014 at 4:46 PM, Meital Bourvine mbour...@redhat.com
  mailto:mbour...@redhat.com wrote:
 
  Which error are you getting in the UI?
  Can you please attach the full engine and vdsm logs?
  Also, please check if there is a relevant error in /var/log/messages
 
 
  
 
  *From: *Edgars M. edgars.maz...@gmail.com
  mailto:edgars.maz...@gmail.com
  *To: *users@ovirt.org mailto:users@ovirt.org
  *Sent: *Friday, January 17, 2014 3:42:37 PM
  *Subject: *[Users] VM Migration failed
 
 
  Hi
 
  I am experiencing issues with manual VM migration. VM fails to
  migrate to other node in the same Cluster. Here are some
  relevant engine.log entries:
 
  ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo]
  (DefaultQuartzScheduler_Worker-73) Rerun vm
  a31cfd62-26fc-4396-8a83-1aed68c7fd39. Called from vds novmnode1
 
  ERROR
  [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand]
  (pool-6-thread-49) Failed in MigrateStatusVDS method
 
  ERROR
  [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand]
  (pool-6-thread-49) Error code migrateErr and error message
  VDSGenericException: VDSErrorException: Failed to
  MigrateStatusVDS, error = Fatal error during migration
 
  ERROR
  [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand]
  (pool-6-thread-49) Command MigrateStatusVDS execution failed.
  Exception: VDSErrorException

Re: [Users] VM Migration failed

2014-01-17 Thread Itamar Heim 

On 01/18/2014 12:07 AM, Meital Bourvine wrote:

I opened a bug about missing info in UI:
https://bugzilla.redhat.com/show_bug.cgi?id=1054994

It actually failed with this error:
Thread-1417::DEBUG::2014-01-17 17:01:28,344::vm::768::vm.Vm::(run) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::starting migration monitor thread
Thread-1415::DEBUG::2014-01-17 
17:01:28,409::libvirtconnection::108::libvirtconnection::(wrapper) Unknown 
libvirterror: ecode: 38 edom: 42 level: 2 message: Failed to inquire lock: No 
such process
Thread-1415::DEBUG::2014-01-17 17:01:28,409::vm::745::vm.Vm::(cancel) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::canceling migration downtime thread
Thread-1415::DEBUG::2014-01-17 17:01:28,409::vm::815::vm.Vm::(stop) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::stopping migration monitor thread
Thread-1416::DEBUG::2014-01-17 17:01:28,409::vm::742::vm.Vm::(run) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::migration downtime thread exiting
Thread-1415::ERROR::2014-01-17 17:01:28,410::vm::238::vm.Vm::(_recover) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::Failed to inquire lock: No such 
process
Thread-1415::ERROR::2014-01-17 17:01:28,619::vm::337::vm.Vm::(run) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::Failed to migrate
Traceback (most recent call last):
   File /usr/share/vdsm/vm.py, line 323, in run
 self._startUnderlyingMigration()
   File /usr/share/vdsm/vm.py, line 400, in _startUnderlyingMigration
 None, maxBandwidth)
   File /usr/share/vdsm/vm.py, line 838, in f
 ret = attr(*args, **kwargs)
   File /usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py, line 
76, in wrapper
 ret = f(*args, **kwargs)
   File /usr/lib64/python2.6/site-packages/libvirt.py, line 1178, in 
migrateToURI2
 if ret == -1: raise libvirtError ('virDomainMigrateToURI2() failed', 
dom=self)
libvirtError: Failed to inquire lock: No such process
Thread-26::ERROR::2014-01-17 17:01:28,917::sampling::355::vm.Vm::(collect) 
vmId=`b8787906-187a-4234-a0c9-58fc4ddf2a57`::Stats function failed: 
AdvancedStatsFunction _highWrite at 0x26efb58

The problem is that it doesn't say which process...


this looks like noise post the migration failing, with probably a more 
relevant error in libvirt log




- Original Message -

From: Itamar Heim ih...@redhat.com
To: Edgars M. edgars.maz...@gmail.com, Meital Bourvine 
mbour...@redhat.com
Cc: users@ovirt.org, Michal Skrivanek mskri...@redhat.com
Sent: Friday, January 17, 2014 9:47:11 PM
Subject: Re: [Users] VM Migration failed

On 01/17/2014 06:25 PM, Edgars M. wrote:

Hi Meital

I tried to migrate another VM and it also failed.

This is what I get in UI:


Migration started (VM: nophpapp01, Source: novmnode1, Destination:
novmnode2, User: edgarsm).
Migration failed due to Error: Fatal error during migration. Trying to
migrate to another Host (VM: nophpapp01, Source: novmnode1, Destination:
novmnode2).
Migration failed due to Error: Fatal error during migration (VM:
nophpapp01, Source: novmnode1, Destination: novmnode2).

There is nothing in /var/log/messages, neither on engine server nor nodes.


See attachments for engine and vdsm logs. (I am migrating from vmnode1
to vmnode2)


whatever the issue is here, can you please open a bug on trying to
return more info to user on the migration error itself (for easier
troubleshooting).

thanks,
 Itamar



Thanks for the help
Edgars







On Fri, Jan 17, 2014 at 4:46 PM, Meital Bourvine mbour...@redhat.com
mailto:mbour...@redhat.com wrote:

 Which error are you getting in the UI?
 Can you please attach the full engine and vdsm logs?
 Also, please check if there is a relevant error in /var/log/messages


 

 *From: *Edgars M. edgars.maz...@gmail.com
 mailto:edgars.maz...@gmail.com
 *To: *users@ovirt.org mailto:users@ovirt.org
 *Sent: *Friday, January 17, 2014 3:42:37 PM
 *Subject: *[Users] VM Migration failed


 Hi

 I am experiencing issues with manual VM migration. VM fails to
 migrate to other node in the same Cluster. Here are some
 relevant engine.log entries:

 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo]
 (DefaultQuartzScheduler_Worker-73) Rerun vm
 a31cfd62-26fc-4396-8a83-1aed68c7fd39. Called from vds novmnode1

 ERROR
 [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand]
 (pool-6-thread-49) Failed in MigrateStatusVDS method

 ERROR
 [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand]
 (pool-6-thread-49) Error code migrateErr and error message
 VDSGenericException: VDSErrorException: Failed to
 MigrateStatusVDS, error = Fatal error during migration

 ERROR
 [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand]
 (pool-6-thread-49) Command MigrateStatusVDS

[Users] VM migration failed on oVirt Node Hypervisor release 2.5.5 (0.1.fc17) : empty cacert.pem

2013-01-24 Thread Kevin Maziere Aubry 
Hi

My concern is about ovirt node oVirt Node Hypervisor release 2.5.5
(0.1.fc17), iso downloaded from ovirt.

I've installed and connect 4 nodes on a manager, and try to migrate a VM
between hypervisors.
I always fail with error :
libvirtError: operation failed: Failed to connect to remote libvirt URI
qemu+tls://172.16.6.3/system
where 172.0.0.1 is the IP of a nde.
I've check on the node and the port 16514 is open.

I also test the virsh command to have a better error message :
virsh -c tls://172.16.6.3/system
error: Unable to import client certificate /etc/pki/CA/cacert.pem

I've checked the cert file on the ovirt node and found it was empty, and
that on all nodes install from the Ovirt ISO it is empty
I also checked /config/etc/pki/CA/cacert.pem, which is also empty.

On a vdsm node install from package on fedora17, it works.
 ls -al /etc/pki/CA/cacert.pem
lrwxrwxrwx. 1 root root 30 18 janv. 14:30 /etc/pki/CA/cacert.pem -
/etc/pki/vdsm/certs/cacert.pem
And the cert is good.

I've seen no bug report regarding the feature...

Kevin


-- 

Kevin Mazière
Responsable Infrastructure
Alter Way – Hosting
 1 rue Royal - 227 Bureaux de la Colline
92213 Saint-Cloud Cedex
Tél : +33 (0)1 41 16 38 41
Mob : +33 (0)7 62 55 57 05
 http://www.alterway.fr
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users