Re: [Gluster-devel] Glusterfs 3.7.11 with LibGFApi in Qemu on Ubuntu Xenial does not work

2016-11-26 Thread André Bauer 
Just upgraded our Storage nodes to GlusterFS 3.8.6.
Same problem on Xenial KVM Clients.



Am 23.08.2016 um 06:51 schrieb Poornima Gurusiddaiah:
> Hi,
> 
> Because of the bugs:
> https://bugzilla.redhat.com/show_bug.cgi?id=1350880
> https://bugzilla.redhat.com/show_bug.cgi?id=1352482
> 
> 3.7.11 is not a good version to be on for Qemu use case, please update
> to 3.7.13, which has fix for both the bugs.
> 
> W.R.T your original permission denied issue, please check the firewall
> settings, and also check if its not selinux issue.
> 
> Regards,
> Poornima
> 
> 
> *From: *"Stephen Howell" 
> *To: *gluster-devel@gluster.org
> *Sent: *Saturday, August 20, 2016 7:54:48 AM
>     *Subject: *[Gluster-devel] Glusterfs 3.7.11 with LibGFApi in Qemu on
> Ubuntu Xenial does not work
> 
> I would like to follow up on a previous thread. I have here 3
> machines running Ubuntu. All were running 14.04 LTS and of these two
> have been upgraded to 16.04. They all run QEMU with a shared
> GlusterFS mount for storing VM images. Libgfapi was configured and
> running on all hosts with 14.04 but has stopped recently with 16.04.
> 
> I can see exactly the same problems as mentioned here on the 16.04
> machines, with these packages:
> 
> ii  glusterfs-client
> 3.7.14-ubuntu1~xenial1 amd64  
>  clustered file-system (client package)
> ii  glusterfs-common
> 3.7.14-ubuntu1~xenial1 amd64  
>  GlusterFS common libraries and translator modules
> ii  glusterfs-server
> 3.7.14-ubuntu1~xenial1 amd64  
>  clustered file-system (server package)
> ii  qemu-block-extra:amd64  
> 1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1   amd64  
>  extra block backend modules for qemu-system and qemu-utils
> ii  qemu-kvm
> 1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1   amd64  
>  QEMU Full virtualization
> ii  qemu-system-common  
> 1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1   amd64  
>  QEMU full system emulation binaries (common files)
> ii  qemu-system-x86
>  1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1   amd64  
>  QEMU full system emulation binaries (x86)
> ii  qemu-utils  
> 1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1   amd64  
>  QEMU utilities
> 
> Packages on the 14.04 instance:
> 
> ii  glusterfs-client   3.7.13-ubuntu1~trusty1  
> amd64clustered file-system (client package)
> ii  glusterfs-common   3.7.13-ubuntu1~trusty1  
> amd64GlusterFS common libraries and
> translator modules
> ii  glusterfs-server   3.7.13-ubuntu1~trusty1  
> amd64clustered file-system (server package)
> ii  qemu-common  
>  2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 all  dummy
> transitional package from qemu-common to qemu-keymaps
> ii  qemu-keymaps  
> 2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 all  QEMU
> keyboard maps
> ii  qemu-kvm  
> 2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 amd64QEMU Full
> virtualization
> ii  qemu-system-common
> 2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 amd64QEMU full
> system emulation binaries (common files)
> ii  qemu-system-x86  
>  2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 amd64QEMU full
> system emulation binaries (x86)
> ii  qemu-utils
> 2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 amd64QEMU utilities
> 
> 
> As you can see I am using Andre (monotek)'s packages to employ the
> Gluster protocol in QEMU under Ubuntu (not compiled by default). The
> versions of Gluster are similar and have indeed been identical in my
> prior testing. The relevant volume options were set, apparmour rules
> were added and the setup worked without issue serving block devices
> over libgfapi for 10+ VMs. However on upgrading to 16.04 there are
> issues relating to QEMU being unable to access the Gluster volume
&g

Re: [Gluster-devel] Glusterfs 3.7.11 with LibGFApi in Qemu on Ubuntu Xenial does not work

2016-08-23 Thread Stephen Howell 
As per my package output, this affects 3.7.14.  We have both executed
in-place upgrades from Ubuntu 14.04 to 16.04, no firewall settings were
modified and no user-instigated changes were made to selinux.

regards
Stephen

On 23 August 2016 at 05:51, Poornima Gurusiddaiah 
wrote:

> Hi,
>
> Because of the bugs:
> https://bugzilla.redhat.com/show_bug.cgi?id=1350880
> https://bugzilla.redhat.com/show_bug.cgi?id=1352482
>
> 3.7.11 is not a good version to be on for Qemu use case, please update to
> 3.7.13, which has fix for both the bugs.
>
> W.R.T your original permission denied issue, please check the firewall
> settings, and also check if its not selinux issue.
>
> Regards,
> Poornima
> --
>
> *From: *"Stephen Howell" 
> *To: *gluster-devel@gluster.org
> *Sent: *Saturday, August 20, 2016 7:54:48 AM
> *Subject: *[Gluster-devel] Glusterfs 3.7.11 with LibGFApi in Qemu on
> Ubuntu Xenial does not work
>
>
> I would like to follow up on a previous thread. I have here 3 machines
> running Ubuntu. All were running 14.04 LTS and of these two have been
> upgraded to 16.04. They all run QEMU with a shared GlusterFS mount for
> storing VM images. Libgfapi was configured and running on all hosts with
> 14.04 but has stopped recently with 16.04.
>
> I can see exactly the same problems as mentioned here on the 16.04
> machines, with these packages:
>
> ii  glusterfs-client 3.7.14-ubuntu1~xenial1
>   amd64clustered file-system (client
> package)
> ii  glusterfs-common 3.7.14-ubuntu1~xenial1
>   amd64GlusterFS common libraries and
> translator modules
> ii  glusterfs-server 3.7.14-ubuntu1~xenial1
>   amd64clustered file-system (server
> package)
> ii  qemu-block-extra:amd64   
> 1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1
>   amd64extra block backend modules for qemu-system and
> qemu-utils
> ii  qemu-kvm 
> 1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1
>   amd64QEMU Full virtualization
> ii  qemu-system-common   
> 1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1
>   amd64QEMU full system emulation binaries (common files)
> ii  qemu-system-x86  
> 1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1
>   amd64QEMU full system emulation binaries (x86)
> ii  qemu-utils   
> 1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1
>   amd64QEMU utilities
>
> Packages on the 14.04 instance:
>
> ii  glusterfs-client   3.7.13-ubuntu1~trusty1
>   amd64clustered file-system (client package)
> ii  glusterfs-common   3.7.13-ubuntu1~trusty1
>   amd64GlusterFS common libraries and translator modules
> ii  glusterfs-server   3.7.13-ubuntu1~trusty1
>   amd64clustered file-system (server package)
> ii  qemu-common
> 2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1
> all  dummy transitional package from qemu-common to qemu-keymaps
> ii  qemu-keymaps   
> 2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1
> all  QEMU keyboard maps
> ii  qemu-kvm   
> 2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1
> amd64QEMU Full virtualization
> ii  qemu-system-common 
> 2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1
> amd64QEMU full system emulation binaries (common files)
> ii  qemu-system-x86
> 2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1
> amd64QEMU full system emulation binaries (x86)
> ii  qemu-utils 
> 2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1
> amd64QEMU utilities
>
>
> As you can see I am using Andre (monotek)'s packages to employ the Gluster
> protocol in QEMU under Ubuntu (not compiled by default). The versions of
> Gluster are similar and have indeed been identical in my prior testing. The
> relevant volume options were set, apparmour rules were added and the setup
> worked without issue serving block devices over libgfapi for 10+ VMs.
> However on upgrading to 16.04 there are issues relating to QEMU being
> unable to access the Gluster volume file when starting a VM. I can use
> qemu-img to create a blank file using the Gluster profocol but I cannot
> then start a VM using that file.
>
> Error message:
>
>  [MSGID: 104007] [

Re: [Gluster-devel] Glusterfs 3.7.11 with LibGFApi in Qemu on Ubuntu Xenial does not work

2016-08-23 Thread Joe Julian 
That log message shows, "port=0", instead of 24007. Not sure if that's *the* 
problem but it's certainly worth looking in to.

On August 20, 2016 4:54:48 AM PDT, Stephen Howell  
wrote:
>I would like to follow up on a previous thread. I have here 3 machines
>running Ubuntu. All were running 14.04 LTS and of these two have been
>upgraded to 16.04. They all run QEMU with a shared GlusterFS mount for
>storing VM images. Libgfapi was configured and running on all hosts
>with
>14.04 but has stopped recently with 16.04.
>
>I can see exactly the same problems as mentioned here on the 16.04
>machines, with these packages:
>
>ii  glusterfs-client 3.7.14-ubuntu1~xenial1
>amd64clustered file-system (client
>package)
>ii  glusterfs-common 3.7.14-ubuntu1~xenial1
>amd64GlusterFS common libraries and
>translator modules
>ii  glusterfs-server 3.7.14-ubuntu1~xenial1
>amd64clustered file-system (server
>package)
>ii  qemu-block-extra:amd64
>1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1   amd64   
>extra
>block backend modules for qemu-system and qemu-utils
>ii  qemu-kvm
>1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1   amd64   
>QEMU
>Full virtualization
>ii  qemu-system-common
>1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1   amd64   
>QEMU
>full system emulation binaries (common files)
>ii  qemu-system-x86
>1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1   amd64   
>QEMU
>full system emulation binaries (x86)
>ii  qemu-utils
>1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1   amd64   
>QEMU
>utilities
>
>Packages on the 14.04 instance:
>
>ii  glusterfs-client   3.7.13-ubuntu1~trusty1
>amd64clustered file-system (client package)
>ii  glusterfs-common   3.7.13-ubuntu1~trusty1
> amd64GlusterFS common libraries and translator modules
>ii  glusterfs-server   3.7.13-ubuntu1~trusty1
>amd64clustered file-system (server package)
>ii  qemu-common
> 2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 all  dummy
>transitional package from qemu-common to qemu-keymaps
>ii  qemu-keymaps
>2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 all  QEMU keyboard
>maps
>ii  qemu-kvm
>2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 amd64QEMU Full
>virtualization
>ii  qemu-system-common
>2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 amd64QEMU full
>system
>emulation binaries (common files)
>ii  qemu-system-x86
>2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 amd64QEMU full
>system
>emulation binaries (x86)
>ii  qemu-utils
>2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 amd64QEMU
>utilities
>
>
>As you can see I am using Andre (monotek)'s packages to employ the
>Gluster
>protocol in QEMU under Ubuntu (not compiled by default). The versions
>of
>Gluster are similar and have indeed been identical in my prior testing.
>The
>relevant volume options were set, apparmour rules were added and the
>setup
>worked without issue serving block devices over libgfapi for 10+ VMs.
>However on upgrading to 16.04 there are issues relating to QEMU being
>unable to access the Gluster volume file when starting a VM. I can use
>qemu-img to create a blank file using the Gluster profocol but I cannot
>then start a VM using that file.
>
>Error message:
>
> [MSGID: 104007] [glfs-mgmt.c:637:glfs_mgmt_getspec_cbk] 0-glfs-mgmt:
>failed to fetch volume file (key:VM) [Invalid argument] [2016-08-20
>11:28:02.985483] E [MSGID: 104024] [glfs-mgmt.c:738:mgmt_rpc_notify]
>0-glfs-mgmt: failed to connect with remote-host: 127.0.0.1 (Permission
>denied) [Permission denied] 2016-08-20T11:28:03.979968Z
>qemu-system-x86_64:
>-drive file=gluster://
>127.0.0.1/VM/vm1.qcow2,format=qcow2,if=none,id=drive-virtio-disk0,cache=none:
>Gluster connection failed for server=127.0.0.1 port=0 volume=VM
>image=vm1.qcow2 transport=tcp: Permission denied
>
>Any assistance on changes to permissions or apparmour in 16.04 would be
>greatly appreciated.
>
>thanks
>Stephen
>
>
>
>
>___
>Gluster-devel mailing list
>Gluster-devel@gluster.org
>http://www.gluster.org/mailman/listinfo/gluster-devel
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Glusterfs 3.7.11 with LibGFApi in Qemu on Ubuntu Xenial does not work

2016-08-22 Thread Poornima Gurusiddaiah 
Hi, 

Because of the bugs: 
https://bugzilla.redhat.com/show_bug.cgi?id=1350880 
https://bugzilla.redhat.com/show_bug.cgi?id=1352482 

3.7.11 is not a good version to be on for Qemu use case, please update to 
3.7.13, which has fix for both the bugs. 

W.R.T your original permission denied issue, please check the firewall 
settings, and also check if its not selinux issue. 

Regards, 
Poornima 
- Original Message -

> From: "Stephen Howell" 
> To: gluster-devel@gluster.org
> Sent: Saturday, August 20, 2016 7:54:48 AM
> Subject: [Gluster-devel] Glusterfs 3.7.11 with LibGFApi in Qemu on Ubuntu
> Xenial does not work

> I would like to follow up on a previous thread. I have here 3 machines
> running Ubuntu. All were running 14.04 LTS and of these two have been
> upgraded to 16.04. They all run QEMU with a shared GlusterFS mount for
> storing VM images. Libgfapi was configured and running on all hosts with
> 14.04 but has stopped recently with 16.04.

> I can see exactly the same problems as mentioned here on the 16.04 machines,
> with these packages:

> ii glusterfs-client 3.7.14-ubuntu1~xenial1 amd64 clustered file-system
> (client package)
> ii glusterfs-common 3.7.14-ubuntu1~xenial1 amd64 GlusterFS common libraries
> and translator modules
> ii glusterfs-server 3.7.14-ubuntu1~xenial1 amd64 clustered file-system
> (server package)
> ii qemu-block-extra:amd64 1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1 amd64
> extra block backend modules for qemu-system and qemu-utils
> ii qemu-kvm 1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1 amd64 QEMU Full
> virtualization
> ii qemu-system-common 1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1 amd64 QEMU
> full system emulation binaries (common files)
> ii qemu-system-x86 1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1 amd64 QEMU
> full system emulation binaries (x86)
> ii qemu-utils 1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1 amd64 QEMU
> utilities

> Packages on the 14.04 instance:

> ii glusterfs-client 3.7.13-ubuntu1~trusty1 amd64 clustered file-system
> (client package)
> ii glusterfs-common 3.7.13-ubuntu1~trusty1 amd64 GlusterFS common libraries
> and translator modules
> ii glusterfs-server 3.7.13-ubuntu1~trusty1 amd64 clustered file-system
> (server package)
> ii qemu-common 2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 all dummy
> transitional package from qemu-common to qemu-keymaps
> ii qemu-keymaps 2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 all QEMU
> keyboard maps
> ii qemu-kvm 2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 amd64 QEMU Full
> virtualization
> ii qemu-system-common 2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 amd64 QEMU
> full system emulation binaries (common files)
> ii qemu-system-x86 2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 amd64 QEMU
> full system emulation binaries (x86)
> ii qemu-utils 2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 amd64 QEMU
> utilities

> As you can see I am using Andre (monotek)'s packages to employ the Gluster
> protocol in QEMU under Ubuntu (not compiled by default). The versions of
> Gluster are similar and have indeed been identical in my prior testing. The
> relevant volume options were set, apparmour rules were added and the setup
> worked without issue serving block devices over libgfapi for 10+ VMs.
> However on upgrading to 16.04 there are issues relating to QEMU being unable
> to access the Gluster volume file when starting a VM. I can use qemu-img to
> create a blank file using the Gluster profocol but I cannot then start a VM
> using that file.

> Error message:

> [MSGID: 104007] [glfs-mgmt.c:637:glfs_mgmt_getspec_cbk] 0-glfs-mgmt: failed
> to fetch volume file (key:VM) [Invalid argument] [2016-08-20
> 11:28:02.985483] E [MSGID: 104024] [glfs-mgmt.c:738:mgmt_rpc_notify]
> 0-glfs-mgmt: failed to connect with remote-host: 127.0.0.1 (Permission
> denied) [Permission denied] 2016-08-20T11:28:03.979968Z qemu-system-x86_64:
> -drive file=gluster://
> 127.0.0.1/VM/vm1.qcow2,format=qcow2,if=none,id=drive-virtio-disk0,cache=none
> : Gluster connection failed for server=127.0.0.1 port=0 volume=VM
> image=vm1.qcow2 transport=tcp: Permission denied

> Any assistance on changes to permissions or apparmour in 16.04 would be
> greatly appreciated.

> thanks
> Stephen

> ___
> Gluster-devel mailing list
> Gluster-devel@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-devel___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

[Gluster-devel] Glusterfs 3.7.11 with LibGFApi in Qemu on Ubuntu Xenial does not work

2016-08-22 Thread Stephen Howell 
I would like to follow up on a previous thread. I have here 3 machines
running Ubuntu. All were running 14.04 LTS and of these two have been
upgraded to 16.04. They all run QEMU with a shared GlusterFS mount for
storing VM images. Libgfapi was configured and running on all hosts with
14.04 but has stopped recently with 16.04.

I can see exactly the same problems as mentioned here on the 16.04
machines, with these packages:

ii  glusterfs-client 3.7.14-ubuntu1~xenial1
amd64clustered file-system (client
package)
ii  glusterfs-common 3.7.14-ubuntu1~xenial1
amd64GlusterFS common libraries and
translator modules
ii  glusterfs-server 3.7.14-ubuntu1~xenial1
amd64clustered file-system (server
package)
ii  qemu-block-extra:amd64
1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1   amd64extra
block backend modules for qemu-system and qemu-utils
ii  qemu-kvm
1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1   amd64QEMU
Full virtualization
ii  qemu-system-common
1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1   amd64QEMU
full system emulation binaries (common files)
ii  qemu-system-x86
 1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1   amd64QEMU
full system emulation binaries (x86)
ii  qemu-utils
1:2.5+dfsg-5ubuntu10.2glusterfs3.7.14xenial1   amd64QEMU
utilities

Packages on the 14.04 instance:

ii  glusterfs-client   3.7.13-ubuntu1~trusty1
amd64clustered file-system (client package)
ii  glusterfs-common   3.7.13-ubuntu1~trusty1
amd64GlusterFS common libraries and translator modules
ii  glusterfs-server   3.7.13-ubuntu1~trusty1
amd64clustered file-system (server package)
ii  qemu-common
 2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 all  dummy
transitional package from qemu-common to qemu-keymaps
ii  qemu-keymaps
2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 all  QEMU keyboard maps
ii  qemu-kvm
2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 amd64QEMU Full
virtualization
ii  qemu-system-common
2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 amd64QEMU full system
emulation binaries (common files)
ii  qemu-system-x86
 2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 amd64QEMU full system
emulation binaries (x86)
ii  qemu-utils
2.0.0+dfsg-2ubuntu1.24glusterfs3.7.12trusty1 amd64QEMU utilities


As you can see I am using Andre (monotek)'s packages to employ the Gluster
protocol in QEMU under Ubuntu (not compiled by default). The versions of
Gluster are similar and have indeed been identical in my prior testing. The
relevant volume options were set, apparmour rules were added and the setup
worked without issue serving block devices over libgfapi for 10+ VMs.
However on upgrading to 16.04 there are issues relating to QEMU being
unable to access the Gluster volume file when starting a VM. I can use
qemu-img to create a blank file using the Gluster profocol but I cannot
then start a VM using that file.

Error message:

 [MSGID: 104007] [glfs-mgmt.c:637:glfs_mgmt_getspec_cbk] 0-glfs-mgmt:
failed to fetch volume file (key:VM) [Invalid argument] [2016-08-20
11:28:02.985483] E [MSGID: 104024] [glfs-mgmt.c:738:mgmt_rpc_notify]
0-glfs-mgmt: failed to connect with remote-host: 127.0.0.1 (Permission
denied) [Permission denied] 2016-08-20T11:28:03.979968Z qemu-system-x86_64:
-drive file=gluster://
127.0.0.1/VM/vm1.qcow2,format=qcow2,if=none,id=drive-virtio-disk0,cache=none:
Gluster connection failed for server=127.0.0.1 port=0 volume=VM
image=vm1.qcow2 transport=tcp: Permission denied

Any assistance on changes to permissions or apparmour in 16.04 would be
greatly appreciated.

thanks
Stephen
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Glusterfs 3.7.11 with LibGFApi in Qemu on Ubuntu Xenial does not work

2016-06-22 Thread André Bauer 
Hi Vijay,

i just used "tail -f /var/log/glusterfs/*.log" and also "tail -f
/var/log/glusterfs/bricks/glusterfs-vmimages.log" on all 4 nodes to
check for new log entries when trying to migrate a VM to the host.

There are no new log entries from start of vm migration until error.

Does anybody have this (qemu / libgfapi access) running in Ubuntu 16.04?

Regards
André



Am 17.06.2016 um 04:44 schrieb Vijay Bellur:
> On Wed, Jun 15, 2016 at 8:07 AM, André Bauer  wrote:
>> Hi Prasanna,
>>
>> Am 15.06.2016 um 12:09 schrieb Prasanna Kalever:
>>
>>>
>>> I think you have missed enabling bind insecure which is needed by
>>> libgfapi access, please try again after following below steps
>>>
>>> => edit /etc/glusterfs/glusterd.vol by add "option
>>> rpc-auth-allow-insecure on" #(on all nodes)
>>> => gluster vol set $volume server.allow-insecure on
>>> => systemctl restart glusterd #(on all nodes)
>>>
>>
>> No, thats not the case. All services are up and runnig correctly,
>> allow-insecure is set and the volume works fine with libgfapi access
>> from my Ubuntu 14.04 KVM/Qemu servers.
>>
>> Just the server which was updated to Ubuntu 16.04 can't access the
>> volume via libgfapi anmyore (fuse mount still works).
>>
>> GlusterFS logs are empty when trying to access the GlusterFS nodes so iyo
>> think the requests are blocked on the client side.
>>
>> Maybe apparmor again?
>>
> 
> Might be worth a check again to see if there are any errors seen in
> glusterd's log file on the server. libvirtd seems to indicate that
> fetch of the volume configuration file from glusterd has failed.
> 
> If there are no errors in glusterd or glusterfsd (brick) logs, then we
> can possibly blame apparmor ;-).
> 
> Regards,
> Vijay
> 


-- 
Mit freundlichen Grüßen
André Bauer

MAGIX Software GmbH
André Bauer
Administrator
August-Bebel-Straße 48
01219 Dresden
GERMANY

tel.: 0351 41884875
e-mail: aba...@magix.net
aba...@magix.net 
www.magix.com 

Geschäftsführer | Managing Directors: Dr. Arnd Schröder, Klaus Schmidt
Amtsgericht | Commercial Register: Berlin Charlottenburg, HRB 127205

Find us on:

 
 
--
The information in this email is intended only for the addressee named
above. Access to this email by anyone else is unauthorized. If you are
not the intended recipient of this message any disclosure, copying,
distribution or any action taken in reliance on it is prohibited and
may be unlawful. MAGIX does not warrant that any attachments are free
from viruses or other defects and accepts no liability for any losses
resulting from infected email transmissions. Please note that any
views expressed in this email may be those of the originator and do
not necessarily represent the agenda of the company.
--
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Glusterfs 3.7.11 with LibGFApi in Qemu on Ubuntu Xenial does not work

2016-06-16 Thread Vijay Bellur 
On Wed, Jun 15, 2016 at 8:07 AM, André Bauer  wrote:
> Hi Prasanna,
>
> Am 15.06.2016 um 12:09 schrieb Prasanna Kalever:
>
>>
>> I think you have missed enabling bind insecure which is needed by
>> libgfapi access, please try again after following below steps
>>
>> => edit /etc/glusterfs/glusterd.vol by add "option
>> rpc-auth-allow-insecure on" #(on all nodes)
>> => gluster vol set $volume server.allow-insecure on
>> => systemctl restart glusterd #(on all nodes)
>>
>
> No, thats not the case. All services are up and runnig correctly,
> allow-insecure is set and the volume works fine with libgfapi access
> from my Ubuntu 14.04 KVM/Qemu servers.
>
> Just the server which was updated to Ubuntu 16.04 can't access the
> volume via libgfapi anmyore (fuse mount still works).
>
> GlusterFS logs are empty when trying to access the GlusterFS nodes so iyo
> think the requests are blocked on the client side.
>
> Maybe apparmor again?
>

Might be worth a check again to see if there are any errors seen in
glusterd's log file on the server. libvirtd seems to indicate that
fetch of the volume configuration file from glusterd has failed.

If there are no errors in glusterd or glusterfsd (brick) logs, then we
can possibly blame apparmor ;-).

Regards,
Vijay
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Glusterfs 3.7.11 with LibGFApi in Qemu on Ubuntu Xenial does not work

2016-06-15 Thread André Bauer 
Hi Prasanna,

Am 15.06.2016 um 12:09 schrieb Prasanna Kalever:

>
> I think you have missed enabling bind insecure which is needed by
> libgfapi access, please try again after following below steps
>
> => edit /etc/glusterfs/glusterd.vol by add "option
> rpc-auth-allow-insecure on" #(on all nodes)
> => gluster vol set $volume server.allow-insecure on
> => systemctl restart glusterd #(on all nodes)
>

No, thats not the case. All services are up and runnig correctly,
allow-insecure is set and the volume works fine with libgfapi access
from my Ubuntu 14.04 KVM/Qemu servers.

Just the server which was updated to Ubuntu 16.04 can't access the
volume via libgfapi anmyore (fuse mount still works).

GlusterFS logs are empty when trying to access the GlusterFS nodes so i
think the requests are blocked on the client side.

Maybe apparmor again?

Regards
André

>
> --
> Prasanna
>
>>
>> I don't see anything in the apparmor logs when setting everything to
>> complain or audit.
>>
>> It also seems GlusterFS servers don't get any request because brick logs
>> are not complaining anything.
>>
>> Any hints?
>>
>>
>> --
>> Regards
>> André Bauer
>>
>> ___
>> Gluster-devel mailing list
>> Gluster-devel@gluster.org
>> http://www.gluster.org/mailman/listinfo/gluster-devel
>


-- 
Mit freundlichen Grüßen
André Bauer

MAGIX Software GmbH
André Bauer
Administrator
August-Bebel-Straße 48
01219 Dresden
GERMANY

tel.: 0351 41884875
e-mail: aba...@magix.net
aba...@magix.net 
www.magix.com 

Geschäftsführer | Managing Directors: Dr. Arnd Schröder, Klaus Schmidt
Amtsgericht | Commercial Register: Berlin Charlottenburg, HRB 127205

Find us on:

 
 
--
The information in this email is intended only for the addressee named
above. Access to this email by anyone else is unauthorized. If you are
not the intended recipient of this message any disclosure, copying,
distribution or any action taken in reliance on it is prohibited and
may be unlawful. MAGIX does not warrant that any attachments are free
from viruses or other defects and accepts no liability for any losses
resulting from infected email transmissions. Please note that any
views expressed in this email may be those of the originator and do
not necessarily represent the agenda of the company.
--

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Glusterfs 3.7.11 with LibGFApi in Qemu on Ubuntu Xenial does not work

2016-06-15 Thread Prasanna Kalever 
On Wed, Jun 15, 2016 at 2:41 PM, André Bauer  wrote:
>
> Hi Lists,
>
> i just updated on of my Ubuntu KVM Servers from 14.04 (Trusty) to 16.06
> (Xenial).
>
> I use the Glusterfs packages from the officail Ubuntu PPA and my own
> Qemu packages (
> https://launchpad.net/~monotek/+archive/ubuntu/qemu-glusterfs-3.7 )
> which have libgfapi enabled.
>
> On Ubuntu 14.04 everything is working fine. I only had to add the
> following lines to the Apparmor config in
> /etc/apparmor.d/abstractions/libvirt-qemu to get it work:
>
> # for glusterfs
> /proc/sys/net/ipv4/ip_local_reserved_ports r,
> /usr/lib/@{multiarch}/glusterfs/**.so mr,
> /tmp/** rw,
>
> In Ubuntu 16.04 i'm not able to start the my VMs via libvirt or to
> create new images via qemu-img using libgfapi.
>
> Mounting the volume via fuse does work without problems.
>
> Examples:
>
> qemu-img create gluster://storage.mydomain/vmimages/kvm2test.img 1G
> Formatting 'gluster://storage.intdmz.h1.mdd/vmimages/kvm2test.img',
> fmt=raw size=1073741824
> [2016-06-15 08:15:26.710665] E [MSGID: 108006]
> [afr-common.c:4046:afr_notify] 0-vmimages-replicate-0: All subvolumes
> are down. Going offline until atleast one of them comes back up.
> [2016-06-15 08:15:26.710736] E [MSGID: 108006]
> [afr-common.c:4046:afr_notify] 0-vmimages-replicate-1: All subvolumes
> are down. Going offline until atleast one of them comes back up.
>
> Libvirtd log:
>
> [2016-06-13 16:53:57.055113] E [MSGID: 104007]
> [glfs-mgmt.c:637:glfs_mgmt_getspec_cbk] 0-glfs-mgmt: failed to fetch
> volume file (key:vmimages) [Invalid argument]
> [2016-06-13 16:53:57.055196] E [MSGID: 104024]
> [glfs-mgmt.c:738:mgmt_rpc_notify] 0-glfs-mgmt: failed to connect with
> remote-host: storage.intdmz.h1.mdd (Permission denied) [Permission denied]
> 2016-06-13T16:53:58.049945Z qemu-system-x86_64: -drive
> file=gluster://storage.intdmz.h1.mdd/vmimages/checkbox.qcow2,format=qcow2,if=none,id=drive-virtio-disk0,cache=writeback:
> Gluster connection failed for server=storage.intdmz.h1.mdd port=0
> volume=vmimages image=checkbox.qcow2 transport=tcp: Permission denied

I think you have missed enabling bind insecure which is needed by
libgfapi access, please try again after following below steps

=> edit /etc/glusterfs/glusterd.vol by add "option
rpc-auth-allow-insecure on" #(on all nodes)
=> gluster vol set $volume server.allow-insecure on
=> systemctl restart glusterd #(on all nodes)

In case this does not work,
provide help us with the below, along with the logfiles
# gluster vol info
# gluster vol status
# gluster peer status

--
Prasanna

>
> I don't see anything in the apparmor logs when setting everything to
> complain or audit.
>
> It also seems GlusterFS servers don't get any request because brick logs
> are not complaining anything.
>
> Any hints?
>
>
> --
> Regards
> André Bauer
>
> ___
> Gluster-devel mailing list
> Gluster-devel@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-devel
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

[Gluster-devel] Glusterfs 3.7.11 with LibGFApi in Qemu on Ubuntu Xenial does not work

2016-06-15 Thread André Bauer 
Hi Lists,

i just updated on of my Ubuntu KVM Servers from 14.04 (Trusty) to 16.06
(Xenial).

I use the Glusterfs packages from the officail Ubuntu PPA and my own
Qemu packages (
https://launchpad.net/~monotek/+archive/ubuntu/qemu-glusterfs-3.7 )
which have libgfapi enabled.

On Ubuntu 14.04 everything is working fine. I only had to add the
following lines to the Apparmor config in
/etc/apparmor.d/abstractions/libvirt-qemu to get it work:

# for glusterfs
/proc/sys/net/ipv4/ip_local_reserved_ports r,
/usr/lib/@{multiarch}/glusterfs/**.so mr,
/tmp/** rw,

In Ubuntu 16.04 i'm not able to start the my VMs via libvirt or to
create new images via qemu-img using libgfapi.

Mounting the volume via fuse does work without problems.

Examples:

qemu-img create gluster://storage.mydomain/vmimages/kvm2test.img 1G
Formatting 'gluster://storage.intdmz.h1.mdd/vmimages/kvm2test.img',
fmt=raw size=1073741824
[2016-06-15 08:15:26.710665] E [MSGID: 108006]
[afr-common.c:4046:afr_notify] 0-vmimages-replicate-0: All subvolumes
are down. Going offline until atleast one of them comes back up.
[2016-06-15 08:15:26.710736] E [MSGID: 108006]
[afr-common.c:4046:afr_notify] 0-vmimages-replicate-1: All subvolumes
are down. Going offline until atleast one of them comes back up.

Libvirtd log:

[2016-06-13 16:53:57.055113] E [MSGID: 104007]
[glfs-mgmt.c:637:glfs_mgmt_getspec_cbk] 0-glfs-mgmt: failed to fetch
volume file (key:vmimages) [Invalid argument]
[2016-06-13 16:53:57.055196] E [MSGID: 104024]
[glfs-mgmt.c:738:mgmt_rpc_notify] 0-glfs-mgmt: failed to connect with
remote-host: storage.intdmz.h1.mdd (Permission denied) [Permission denied]
2016-06-13T16:53:58.049945Z qemu-system-x86_64: -drive
file=gluster://storage.intdmz.h1.mdd/vmimages/checkbox.qcow2,format=qcow2,if=none,id=drive-virtio-disk0,cache=writeback:
Gluster connection failed for server=storage.intdmz.h1.mdd port=0
volume=vmimages image=checkbox.qcow2 transport=tcp: Permission denied

I don't see anything in the apparmor logs when setting everything to
complain or audit.

It also seems GlusterFS servers don't get any request because brick logs
are not complaining anything.

Any hints?


-- 
Regards
André Bauer

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel