Hi,
I have been having issues using ZFS and glusterfs
I configured it using various sources from Internet and it appears to
working fine but , in fact, I am no able to do some simple tasks ( like
cloning from template)
I am getting "no route to host" and "no such device"
" ....
192.168.192.152:49154 failed (Connection timed out)
[2016-10-23 18:24:41.483942] I [MSGID: 114018]
[client.c:2280:client_rpc_notify] 0-templates-client-1: disconnected from
templates-client-1. Client process will keep trying to connect to glusterd
until brick's port is available
[2016-10-23 18:24:56.952000] E [socket.c:2309:socket_connect_finish]
0-templates-client-1: connection to 192.168.192.152:24007 failed (No route
to host)
[2016-10-23 18:26:22.015600] I [rpc-clnt.c:1947:rpc_clnt_reconfig]
0-templates-client-1: changing port to 49154 (from 0)
[2016-10-23 18:26:22.016104] I [MSGID: 114057]
[client-handshake.c:1446:select_server_supported_programs]
0-templates-client-1: Using Program GlusterFS 3.3, Num (1298437), Version
(330)
[2016-10-23 18:26:22.016475] I [MSGID: 114046]
[client-handshake.c:1222:client_setvolume_cbk] 0-templates-client-1:
Connected to templates-client-1, attached to remote volume
'/pool1/templates/brick3'.
[2016-10-23 18:26:22.016488] I [MSGID: 114047]
[client-handshake.c:1233:client_setvolume_cbk] 0-templates-client-1: Server
and Client lk-version numbers are not same, reopening the fds
..."
If someone has a similar configuration that works it will be appreciated if
they can provide some advice
Here is some is info ( 2 nodes only for now, glusterfs and pve running on
both)
pveversion
pve-manager/4.3-7/db02a4de (running kernel: 4.4.21-1-pve)
dpkg -l | grep zfs
ii debian-zfs 7~jessie amd64
Native ZFS filesystem metapackage for Debian.
ii libzfs2 0.6.5.8-pve11~bpo80 all
transitional package
ii libzfs2linux 0.6.5.8-pve11~bpo80 amd64
OpenZFS filesystem library for Linux
ii zfs-dkms 0.6.5.7-8-jessie all
Native ZFS filesystem kernel modules for Linux
ii zfs-initramfs 0.6.5.8-pve11~bpo80 all
OpenZFS root filesystem capabilities for Linux - initramfs
ii zfs-zed 0.6.5.8-pve11~bpo80 amd64
OpenZFS Event Daemon
ii zfsonlinux 8 all
archive.zfsonlinux.org trust package
ii zfsutils 0.6.5.8-pve11~bpo80 all
transitional package
ii zfsutils-linux 0.6.5.8-pve11~bpo80 amd64
command-line tools to manage OpenZFS filesystems
zpool status pool1
pool: pool1
state: ONLINE
scan: none requested
config:
NAME STATE READ WRITE CKSUM
pool1 ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
scsi-350000396f8429a0d ONLINE 0 0 0
scsi-350000396f8429b35 ONLINE 0 0 0
errors: No known data errors
root@node1:~# zpool list pool1
NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT
pool1 1.09T 2.87G 1.08T - 0% 0% 1.00x ONLINE -
gluster --version
glusterfs 3.8.4 built on Sep 11 2016 06:28:04
gluster peer list
unrecognized word: list (position 1)
root@node1:~# gluster peer status
Number of Peers: 1
Hostname: node3.gnp.box
Uuid: ba3a4eef-2ad3-4cf8-b15f-f00bf8db25ea
State: Peer in Cluster (Connected)
root@node1:~# gluster volume list
dump
images
templates
root@node1:~# gluster volume status images
Status of volume: images
Gluster process TCP Port RDMA Port Online Pid
------------------------------------------------------------------------------
Brick node1.gnp.box:/pool1/images/brick1 49152 0 Y
64896
Brick node3.gnp.box:/pool1/images/brick3 49152 0 Y
43174
Self-heal Daemon on localhost N/A N/A Y
178961
Self-heal Daemon on node3.gnp.box N/A N/A Y
155245
Task Status of Volume images
------------------------------------------------------------------------------
There are no active volume tasks
root@node1:~# ping node3.gnp.box
PING node3.gnp.box (192.168.192.152) 56(84) bytes of data.
64 bytes from node3.gnp.box (192.168.192.152): icmp_seq=1 ttl=64 time=0.131
ms
64 bytes from node3.gnp.box (192.168.192.152): icmp_seq=2 ttl=64 time=0.123
ms
cat /etc/pve/storage.cfg
dir: local
path /var/lib/vz
content iso,vztmpl,backup
dir: gluster-local
path /mnt/gluster/images
content images
lvmthin: local-lvm
thinpool data
vgname pve
content rootdir,images
glusterfs: Gluster-images
server 192.168.192.150
server2 192.168.192.152
volume images
content images,iso
glusterfs: Gluster-templates
server 192.168.192.150
server2 192.168.192.152
volume templates
content iso
_______________________________________________
pve-user mailing list
[email protected]
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
