Re: [ovirt-users] migration failed with permission denied

2016-06-17 Thread Vinzenz Feenstra

> On Jun 17, 2016, at 12:47 PM, Vinzenz Feenstra  wrote:
> 
>> 
>> On Jun 17, 2016, at 12:42 PM, Michal Skrivanek > > wrote:
>> 
>> 
>>> On 17 Jun 2016, at 12:37, Fabrice Bacchella >> > wrote:
>>> 
>>> 
 Le 17 juin 2016 à 12:33, Vinzenz Feenstra > a écrit :
 
 
> On Jun 17, 2016, at 12:12 PM, Fabrice Bacchella 
> > 
> wrote:
> 
> 
>> Le 17 juin 2016 à 12:05, Vinzenz Feenstra > > a écrit :
>> 
>> Hi Fabrice,
>> 
>>> On Jun 17, 2016, at 11:41 AM, Fabrice Bacchella 
>>> > 
>>> wrote:
>>> 
>>> I'm running an up to date ovirt setup.
>>> 
>>> I tried to put an host in maintenance mode, with one VM running on it.
>>> 
>>> It failed with this message in vdsm.log:
>>> 
> 
>>> libvirtError: internal error: process exited while connecting to 
>>> monitor: 2016-06-17T09:30:04.429323Z qemu-kvm: -chardev 
>>> socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/b82209c9-42ff-457c-bb98-b6a2034833fc.com.redhat.rhevm.vdsm,server,nowait:
>>>  Failed to bind socket to 
>>> /var/lib/libvirt/qemu/channels/b82209c9-42ff-457c-bb98-b6a2034833fc.com.redhat.rhevm.vdsm:
>>>  Permission denied
>> 
>> This is pretty odd, could you please send me the out put of this:
>> 
>> # rpm -qa | grep vdsm
>> 
>> From the target and destination hosts. Thanks.
> 
>>> 
 
 Thanks.
 
 And on the destination server what are the access rights on 
 /var/lib/libvirt/qemu/channels? 
>>> On both:
>>> drwxrwxr-x 2 vdsm qemu 137 Jun 14 15:35 /var/lib/libvirt/qemu/channels
>>> drwxrwxr-x 2 vdsm qemu 6 May 24 16:03 /var/lib/libvirt/qemu/channels
>>> 
 And if you have SELinux enabled can you temporary set it to permissive on 
 the destination and try to migrate?
>>> 
>>> SELinux is disabled on both.
>> 
>> And was the VM started in the same SELinux state or did you change it 
>> afterwards while it was running?
> 
> It is disabled since installation (We moved the conversation for now to the 
> IRC) 
> 
> If we found a solution / reason I will respond to the thread to have it 
> documented.

So the reason for the errors is wrongly set ownership of the 
/var/lib/libvirt/qemu folder rwxr-x--x 8 oneadmin oneadmin 


> 
>> 
>>> 
>>> 
>>> ___
>>> Users mailing list
>>> Users@ovirt.org 
>>> http://lists.ovirt.org/mailman/listinfo/users 
>>> 
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


Re: [ovirt-users] migration failed with permission denied

2016-06-17 Thread Vinzenz Feenstra

> On Jun 17, 2016, at 12:42 PM, Michal Skrivanek  
> wrote:
> 
> 
>> On 17 Jun 2016, at 12:37, Fabrice Bacchella > > wrote:
>> 
>> 
>>> Le 17 juin 2016 à 12:33, Vinzenz Feenstra >> > a écrit :
>>> 
>>> 
 On Jun 17, 2016, at 12:12 PM, Fabrice Bacchella 
 > wrote:
 
 
> Le 17 juin 2016 à 12:05, Vinzenz Feenstra  > a écrit :
> 
> Hi Fabrice,
> 
>> On Jun 17, 2016, at 11:41 AM, Fabrice Bacchella 
>> > 
>> wrote:
>> 
>> I'm running an up to date ovirt setup.
>> 
>> I tried to put an host in maintenance mode, with one VM running on it.
>> 
>> It failed with this message in vdsm.log:
>> 
 
>> libvirtError: internal error: process exited while connecting to 
>> monitor: 2016-06-17T09:30:04.429323Z qemu-kvm: -chardev 
>> socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/b82209c9-42ff-457c-bb98-b6a2034833fc.com.redhat.rhevm.vdsm,server,nowait:
>>  Failed to bind socket to 
>> /var/lib/libvirt/qemu/channels/b82209c9-42ff-457c-bb98-b6a2034833fc.com.redhat.rhevm.vdsm:
>>  Permission denied
> 
> This is pretty odd, could you please send me the out put of this:
> 
> # rpm -qa | grep vdsm
> 
> From the target and destination hosts. Thanks.
 
>> 
>>> 
>>> Thanks.
>>> 
>>> And on the destination server what are the access rights on 
>>> /var/lib/libvirt/qemu/channels? 
>> On both:
>> drwxrwxr-x 2 vdsm qemu 137 Jun 14 15:35 /var/lib/libvirt/qemu/channels
>> drwxrwxr-x 2 vdsm qemu 6 May 24 16:03 /var/lib/libvirt/qemu/channels
>> 
>>> And if you have SELinux enabled can you temporary set it to permissive on 
>>> the destination and try to migrate?
>> 
>> SELinux is disabled on both.
> 
> And was the VM started in the same SELinux state or did you change it 
> afterwards while it was running?

It is disabled since installation (We moved the conversation for now to the 
IRC) 

If we found a solution / reason I will respond to the thread to have it 
documented.

> 
>> 
>> 
>> ___
>> Users mailing list
>> Users@ovirt.org 
>> http://lists.ovirt.org/mailman/listinfo/users
> 

___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


Re: [ovirt-users] migration failed with permission denied

2016-06-17 Thread Michal Skrivanek

> On 17 Jun 2016, at 12:37, Fabrice Bacchella  
> wrote:
> 
> 
>> Le 17 juin 2016 à 12:33, Vinzenz Feenstra > > a écrit :
>> 
>> 
>>> On Jun 17, 2016, at 12:12 PM, Fabrice Bacchella 
>>> > wrote:
>>> 
>>> 
 Le 17 juin 2016 à 12:05, Vinzenz Feenstra > a écrit :
 
 Hi Fabrice,
 
> On Jun 17, 2016, at 11:41 AM, Fabrice Bacchella 
> > 
> wrote:
> 
> I'm running an up to date ovirt setup.
> 
> I tried to put an host in maintenance mode, with one VM running on it.
> 
> It failed with this message in vdsm.log:
> 
>>> 
> libvirtError: internal error: process exited while connecting to monitor: 
> 2016-06-17T09:30:04.429323Z qemu-kvm: -chardev 
> socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/b82209c9-42ff-457c-bb98-b6a2034833fc.com.redhat.rhevm.vdsm,server,nowait:
>  Failed to bind socket to 
> /var/lib/libvirt/qemu/channels/b82209c9-42ff-457c-bb98-b6a2034833fc.com.redhat.rhevm.vdsm:
>  Permission denied
 
 This is pretty odd, could you please send me the out put of this:
 
 # rpm -qa | grep vdsm
 
 From the target and destination hosts. Thanks.
>>> 
> 
>> 
>> Thanks.
>> 
>> And on the destination server what are the access rights on 
>> /var/lib/libvirt/qemu/channels? 
> On both:
> drwxrwxr-x 2 vdsm qemu 137 Jun 14 15:35 /var/lib/libvirt/qemu/channels
> drwxrwxr-x 2 vdsm qemu 6 May 24 16:03 /var/lib/libvirt/qemu/channels
> 
>> And if you have SELinux enabled can you temporary set it to permissive on 
>> the destination and try to migrate?
> 
> SELinux is disabled on both.

And was the VM started in the same SELinux state or did you change it 
afterwards while it was running?

> 
> 
> ___
> Users mailing list
> Users@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users

___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


Re: [ovirt-users] migration failed with permission denied

2016-06-17 Thread Fabrice Bacchella

> Le 17 juin 2016 à 12:33, Vinzenz Feenstra  a écrit :
> 
> 
>> On Jun 17, 2016, at 12:12 PM, Fabrice Bacchella 
>> > wrote:
>> 
>> 
>>> Le 17 juin 2016 à 12:05, Vinzenz Feenstra >> > a écrit :
>>> 
>>> Hi Fabrice,
>>> 
 On Jun 17, 2016, at 11:41 AM, Fabrice Bacchella 
 > wrote:
 
 I'm running an up to date ovirt setup.
 
 I tried to put an host in maintenance mode, with one VM running on it.
 
 It failed with this message in vdsm.log:
 
>> 
 libvirtError: internal error: process exited while connecting to monitor: 
 2016-06-17T09:30:04.429323Z qemu-kvm: -chardev 
 socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/b82209c9-42ff-457c-bb98-b6a2034833fc.com.redhat.rhevm.vdsm,server,nowait:
  Failed to bind socket to 
 /var/lib/libvirt/qemu/channels/b82209c9-42ff-457c-bb98-b6a2034833fc.com.redhat.rhevm.vdsm:
  Permission denied
>>> 
>>> This is pretty odd, could you please send me the out put of this:
>>> 
>>> # rpm -qa | grep vdsm
>>> 
>>> From the target and destination hosts. Thanks.
>> 

> 
> Thanks.
> 
> And on the destination server what are the access rights on 
> /var/lib/libvirt/qemu/channels? 
On both:
drwxrwxr-x 2 vdsm qemu 137 Jun 14 15:35 /var/lib/libvirt/qemu/channels
drwxrwxr-x 2 vdsm qemu 6 May 24 16:03 /var/lib/libvirt/qemu/channels

> And if you have SELinux enabled can you temporary set it to permissive on the 
> destination and try to migrate?

SELinux is disabled on both.


___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


Re: [ovirt-users] migration failed with permission denied

2016-06-17 Thread Vinzenz Feenstra

> On Jun 17, 2016, at 12:12 PM, Fabrice Bacchella 
>  wrote:
> 
> 
>> Le 17 juin 2016 à 12:05, Vinzenz Feenstra > > a écrit :
>> 
>> Hi Fabrice,
>> 
>>> On Jun 17, 2016, at 11:41 AM, Fabrice Bacchella 
>>> > wrote:
>>> 
>>> I'm running an up to date ovirt setup.
>>> 
>>> I tried to put an host in maintenance mode, with one VM running on it.
>>> 
>>> It failed with this message in vdsm.log:
>>> 
> 
>>> libvirtError: internal error: process exited while connecting to monitor: 
>>> 2016-06-17T09:30:04.429323Z qemu-kvm: -chardev 
>>> socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/b82209c9-42ff-457c-bb98-b6a2034833fc.com.redhat.rhevm.vdsm,server,nowait:
>>>  Failed to bind socket to 
>>> /var/lib/libvirt/qemu/channels/b82209c9-42ff-457c-bb98-b6a2034833fc.com.redhat.rhevm.vdsm:
>>>  Permission denied
>> 
>> This is pretty odd, could you please send me the out put of this:
>> 
>> # rpm -qa | grep vdsm
>> 
>> From the target and destination hosts. Thanks.
> 
> On the host I was trying to put on maintenance:
> vdsm-xmlrpc-4.17.28-0.el7.centos.noarch
> vdsm-4.17.28-0.el7.centos.noarch
> vdsm-infra-4.17.28-0.el7.centos.noarch
> vdsm-yajsonrpc-4.17.28-0.el7.centos.noarch
> vdsm-python-4.17.28-0.el7.centos.noarch
> vdsm-jsonrpc-4.17.28-0.el7.centos.noarch
> vdsm-hook-vmfex-dev-4.17.28-0.el7.centos.noarch
> vdsm-cli-4.17.28-0.el7.centos.noarch
> 
> And it was trying to send to an host with:
> vdsm-yajsonrpc-4.17.28-1.el7.noarch
> vdsm-cli-4.17.28-1.el7.noarch
> vdsm-python-4.17.28-1.el7.noarch
> vdsm-hook-vmfex-dev-4.17.28-1.el7.noarch
> vdsm-xmlrpc-4.17.28-1.el7.noarch
> vdsm-4.17.28-1.el7.noarch
> vdsm-infra-4.17.28-1.el7.noarch
> vdsm-jsonrpc-4.17.28-1.el7.noarch
> 
> And in the log about that:
> jsonrpc.Executor/1::DEBUG::2016-06-17 
> 11:39:57,233::__init__::503::jsonrpc.JsonRpcServer::(_serveRequest) Calling 
> 'VM.migrate' in bridge with {u'params': {u
> 'tunneled': u'false', u'dstqemu': u'XX.XX.XX.28', u'autoConverge': u'false', 
> u'src': u'nb0101.XXX', u'dst': u'nb0105.XXX:54321', u
> 'vmId': u'b82209c9-42ff-457c-bb98-b6a2034833fc', u'abortOnError': u'true', 
> u'compressed': u'false', u'method': u'online'}, u'vmID': 
> u'b82209c9-42ff-457c-bb9
> 8-b6a2034833fc'}
> jsonrpc.Executor/1::DEBUG::2016-06-17 11:39:57,234::API::547::vds::(migrate) 
> {u'tunneled': u'false', u'dstqemu': u'XX.XX.XX.28', u'autoConverge': 
> u'false', 
> u'src': u'nb0101.XXX', u'dst': u'nb0105.XXX:54321', u'vmId': 
> u'b82209c9-42ff-457c-bb98-b6a2034833fc', u'abortOnError': u'true', u'
> compressed': u'false', u'method': u'online’}

Thanks.

And on the destination server what are the access rights on 
/var/lib/libvirt/qemu/channels? 
And if you have SELinux enabled can you temporary set it to permissive on the 
destination and try to migrate?


> 

___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


Re: [ovirt-users] migration failed with permission denied

2016-06-17 Thread Fabrice Bacchella

> Le 17 juin 2016 à 12:05, Vinzenz Feenstra  a écrit :
> 
> Hi Fabrice,
> 
>> On Jun 17, 2016, at 11:41 AM, Fabrice Bacchella 
>> > wrote:
>> 
>> I'm running an up to date ovirt setup.
>> 
>> I tried to put an host in maintenance mode, with one VM running on it.
>> 
>> It failed with this message in vdsm.log:
>> 

>> libvirtError: internal error: process exited while connecting to monitor: 
>> 2016-06-17T09:30:04.429323Z qemu-kvm: -chardev 
>> socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/b82209c9-42ff-457c-bb98-b6a2034833fc.com.redhat.rhevm.vdsm,server,nowait:
>>  Failed to bind socket to 
>> /var/lib/libvirt/qemu/channels/b82209c9-42ff-457c-bb98-b6a2034833fc.com.redhat.rhevm.vdsm:
>>  Permission denied
> 
> This is pretty odd, could you please send me the out put of this:
> 
> # rpm -qa | grep vdsm
> 
> From the target and destination hosts. Thanks.

On the host I was trying to put on maintenance:
vdsm-xmlrpc-4.17.28-0.el7.centos.noarch
vdsm-4.17.28-0.el7.centos.noarch
vdsm-infra-4.17.28-0.el7.centos.noarch
vdsm-yajsonrpc-4.17.28-0.el7.centos.noarch
vdsm-python-4.17.28-0.el7.centos.noarch
vdsm-jsonrpc-4.17.28-0.el7.centos.noarch
vdsm-hook-vmfex-dev-4.17.28-0.el7.centos.noarch
vdsm-cli-4.17.28-0.el7.centos.noarch

And it was trying to send to an host with:
vdsm-yajsonrpc-4.17.28-1.el7.noarch
vdsm-cli-4.17.28-1.el7.noarch
vdsm-python-4.17.28-1.el7.noarch
vdsm-hook-vmfex-dev-4.17.28-1.el7.noarch
vdsm-xmlrpc-4.17.28-1.el7.noarch
vdsm-4.17.28-1.el7.noarch
vdsm-infra-4.17.28-1.el7.noarch
vdsm-jsonrpc-4.17.28-1.el7.noarch

And in the log about that:
jsonrpc.Executor/1::DEBUG::2016-06-17 
11:39:57,233::__init__::503::jsonrpc.JsonRpcServer::(_serveRequest) Calling 
'VM.migrate' in bridge with {u'params': {u
'tunneled': u'false', u'dstqemu': u'XX.XX.XX.28', u'autoConverge': u'false', 
u'src': u'nb0101.XXX', u'dst': u'nb0105.XXX:54321', u
'vmId': u'b82209c9-42ff-457c-bb98-b6a2034833fc', u'abortOnError': u'true', 
u'compressed': u'false', u'method': u'online'}, u'vmID': 
u'b82209c9-42ff-457c-bb9
8-b6a2034833fc'}
jsonrpc.Executor/1::DEBUG::2016-06-17 11:39:57,234::API::547::vds::(migrate) 
{u'tunneled': u'false', u'dstqemu': u'XX.XX.XX.28', u'autoConverge': u'false', 
u'src': u'nb0101.XXX', u'dst': u'nb0105.XXX:54321', u'vmId': 
u'b82209c9-42ff-457c-bb98-b6a2034833fc', u'abortOnError': u'true', u'
compressed': u'false', u'method': u'online'}

___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


Re: [ovirt-users] migration failed with permission denied

2016-06-17 Thread Vinzenz Feenstra
Hi Fabrice,

> On Jun 17, 2016, at 11:41 AM, Fabrice Bacchella 
>  wrote:
> 
> I'm running an up to date ovirt setup.
> 
> I tried to put an host in maintenance mode, with one VM running on it.
> 
> It failed with this message in vdsm.log:
> 
> Thread-351083::ERROR::2016-06-17 
> 11:30:04,732::migration::209::virt.vm::(_recover) 
> vmId=`b82209c9-42ff-457c-bb98-b6a2034833fc`::internal error: process exited 
> while connecting to monitor: 2016-06-17T09:30:04.429323Z qemu-kvm: -chardev 
> socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/b82209c9-42ff-457c-bb98-b6a2034833fc.com.redhat.rhevm.vdsm,server,nowait:
>  Failed to bind socket to 
> /var/lib/libvirt/qemu/channels/b82209c9-42ff-457c-bb98-b6a2034833fc.com.redhat.rhevm.vdsm:
>  Permission denied
> ...
> Traceback (most recent call last):
>   File "/usr/share/vdsm/virt/migration.py", line 298, in run
> self._startUnderlyingMigration(time.time())
>   File "/usr/share/vdsm/virt/migration.py", line 364, in 
> _startUnderlyingMigration
> self._perform_migration(duri, muri)
>   File "/usr/share/vdsm/virt/migration.py", line 403, in _perform_migration
> self._vm._dom.migrateToURI3(duri, params, flags)
>   File "/usr/share/vdsm/virt/virdomain.py", line 68, in f
> ret = attr(*args, **kwargs)
>   File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 
> 124, in wrapper
> ret = f(*args, **kwargs)
>   File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 1313, in wrapper
> return func(inst, *args, **kwargs)
>   File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1836, in 
> migrateToURI3
> if ret == -1: raise libvirtError ('virDomainMigrateToURI3() failed', 
> dom=self)
> libvirtError: internal error: process exited while connecting to monitor: 
> 2016-06-17T09:30:04.429323Z qemu-kvm: -chardev 
> socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/b82209c9-42ff-457c-bb98-b6a2034833fc.com.redhat.rhevm.vdsm,server,nowait:
>  Failed to bind socket to 
> /var/lib/libvirt/qemu/channels/b82209c9-42ff-457c-bb98-b6a2034833fc.com.redhat.rhevm.vdsm:
>  Permission denied

This is pretty odd, could you please send me the out put of this:

# rpm -qa | grep vdsm

From the target and destination hosts. Thanks.

> 
> If i check the file, I see :
> 
> srwxrwxr-x 1 qemu qemu 0 May 31 16:21 
> /var/lib/libvirt/qemu/channels/b82209c9-42ff-457c-bb98-b6a2034833fc.com.redhat.rhevm.vdsm
> 
> And on all my hosts, the permissions are the same:
> srwxrwxr-x 1 qemu qemu /var/lib/libvirt/qemu/channels/*
> 
> And vdsm is running vdsm:
> 4 S vdsm  3816 1  0  60 -20 - 947345 poll_s May25 ?   02:21:58 
> /usr/bin/python /usr/share/vdsm/vdsm
> 
> If I check vdsm groups:
> ~# id vdsm
> uid=36(vdsm) gid=36(kvm) groups=36(kvm),179(sanlock),107(qemu)
> 
> 
> 
> 
> ___
> Users mailing list
> Users@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users

___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users