Hey guys!

First post to the list and new Ceph user so I might say/ask some stupid stuff ;)

I've setup a Ceph Storage (and crashed it 2 days after), with 2 ceph-mon, 2 ceph-ods (same host), 2 ceph-mgr and 1 ceph-mgs. Everything is up and running and works great. Now I'm trying to integrate the CephFS functionality with my Docker Swarm (the rbd part is already working great). I can mount the CephFS on the docker host without any problem with a specific client created for the effect (client.dockerfs). It also works great if creating a volume with "docker volume create" and then use that volume on a container. With a stack (defined as docker-compose.yml), it simply doesn't mount the CephFS share, and the ceph-mon daemons log this kind of msgs:
2019-01-30 21:44:56.595 7fed6daf9700  0 cephx server client.dockerfs:  
unexpected key: req.key=cb19d6f224e3099 expected_key=aa096575fa04aa68
2019-01-30 21:45:02.295 7fed6daf9700  0 cephx server client.dockerfs:  
unexpected key: req.key=8a87e7949a095e50 expected_key=1c3fd3ad47398e0a
2019-01-30 21:45:13.711 7fed6daf9700  0 cephx server client.dockerfs:  
unexpected key: req.key=93933c29c40e9b05 expected_key=5b1a8d4f4f0e8dd1

While on the docker host trying to start the container shows this:
Jan 30 23:57:57 docker02 kernel: libceph: auth method 'x' error -1

This is the mount command I use on the docker host to mount the CephFS share:
mount -t ceph  ceph-mon:/znc tmp -o 
mds_namespace=dockerfs,name=dockerfs,secret=`ceph auth print-key 
client.dockerfs`

And this is the volume part of the docker-compose.yml file:
volumes:
    data:
        driver: n0r1skcom/docker-volume-cephfs
        driver_opts:
            name: dockerfs
            secret: # Same output as the command above produces
            path: /znc
            monitors: ceph-mon
            mds_namespace: dockerfs


I must be doing something wrong with this because it looks really simple to do 
but, somehow, it isn't working.

Can someone shed any light plz?

Thanks,
Carlos Mogas da Silva
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Reply via email to