Re: [ceph-users] DockerSwarm and CephFS
On 31/01/2019 18:51, Jacob DeGlopper wrote: Hi Carlos - just a guess, but you might need your credentials from /etc/ceph on the host mounted inside the container. -- jacob Hi Jacob! That's not the case afaik. Docker daemon itself mounts the target, so it's still the host in here, and then bind mounts it to the container. It's not the container itself that mounts the target. Thanks anyway ;) Carlos Mogas da Silva ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] DockerSwarm and CephFS
Hi Carlos - just a guess, but you might need your credentials from /etc/ceph on the host mounted inside the container. -- jacob Hey guys! First post to the list and new Ceph user so I might say/ask some stupid stuff ;) I've setup a Ceph Storage (and crashed it 2 days after), with 2 ceph-mon, 2 ceph-ods (same host), 2 ceph-mgr and 1 ceph-mgs. Everything is up and running and works great. Now I'm trying to integrate the CephFS functionality with my Docker Swarm (the rbd part is already working great). I can mount the CephFS on the docker host without any problem with a specific client created for the effect (client.dockerfs). It also works great if creating a volume with "docker volume create" and then use that volume on a container. With a stack (defined as docker-compose.yml), it simply doesn't mount the CephFS share, and the ceph-mon daemons log this kind of msgs: 2019-01-30 21:44:56.595 7fed6daf9700 0 cephx server client.dockerfs: unexpected key: req.key=cb19d6f224e3099 expected_key=aa096575fa04aa68 2019-01-30 21:45:02.295 7fed6daf9700 0 cephx server client.dockerfs: unexpected key: req.key=8a87e7949a095e50 expected_key=1c3fd3ad47398e0a 2019-01-30 21:45:13.711 7fed6daf9700 0 cephx server client.dockerfs: unexpected key: req.key=93933c29c40e9b05 expected_key=5b1a8d4f4f0e8dd1 While on the docker host trying to start the container shows this: Jan 30 23:57:57 docker02 kernel: libceph: auth method 'x' error -1 This is the mount command I use on the docker host to mount the CephFS share: mount -t ceph ceph-mon:/znc tmp -o mds_namespace=dockerfs,name=dockerfs,secret=`ceph auth print-key client.dockerfs` And this is the volume part of the docker-compose.yml file: volumes: data: driver: n0r1skcom/docker-volume-cephfs driver_opts: name: dockerfs secret: # Same output as the command above produces path: /znc monitors: ceph-mon mds_namespace: dockerfs I must be doing something wrong with this because it looks really simple to do but, somehow, it isn't working. Can someone shed any light plz? Thanks, Carlos Mogas da Silva ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] DockerSwarm and CephFS
Hey guys! First post to the list and new Ceph user so I might say/ask some stupid stuff ;) I've setup a Ceph Storage (and crashed it 2 days after), with 2 ceph-mon, 2 ceph-ods (same host), 2 ceph-mgr and 1 ceph-mgs. Everything is up and running and works great. Now I'm trying to integrate the CephFS functionality with my Docker Swarm (the rbd part is already working great). I can mount the CephFS on the docker host without any problem with a specific client created for the effect (client.dockerfs). It also works great if creating a volume with "docker volume create" and then use that volume on a container. With a stack (defined as docker-compose.yml), it simply doesn't mount the CephFS share, and the ceph-mon daemons log this kind of msgs: 2019-01-30 21:44:56.595 7fed6daf9700 0 cephx server client.dockerfs: unexpected key: req.key=cb19d6f224e3099 expected_key=aa096575fa04aa68 2019-01-30 21:45:02.295 7fed6daf9700 0 cephx server client.dockerfs: unexpected key: req.key=8a87e7949a095e50 expected_key=1c3fd3ad47398e0a 2019-01-30 21:45:13.711 7fed6daf9700 0 cephx server client.dockerfs: unexpected key: req.key=93933c29c40e9b05 expected_key=5b1a8d4f4f0e8dd1 While on the docker host trying to start the container shows this: Jan 30 23:57:57 docker02 kernel: libceph: auth method 'x' error -1 This is the mount command I use on the docker host to mount the CephFS share: mount -t ceph ceph-mon:/znc tmp -o mds_namespace=dockerfs,name=dockerfs,secret=`ceph auth print-key client.dockerfs` And this is the volume part of the docker-compose.yml file: volumes: data: driver: n0r1skcom/docker-volume-cephfs driver_opts: name: dockerfs secret: # Same output as the command above produces path: /znc monitors: ceph-mon mds_namespace: dockerfs I must be doing something wrong with this because it looks really simple to do but, somehow, it isn't working. Can someone shed any light plz? Thanks, Carlos Mogas da Silva ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
