Hi Mathias, Have you tried these steps and sticking to the slow interfaces? I would be curious to see if this is just a problem of how those interfaces are able to talk to each other.
> *From:* Mathias Lindberg <[email protected]> > *Date:* August 1, 2013, 4:01:38 MDT > *To:* "[email protected]" <[email protected]> > *Subject:* *[ceph-users] ceph-deploy ceph-create-keys hangs* > > Hi > > Having previously had problems during startup with "creating keys" > (otherwise a working setup) one one node when using mkcephfs, i have given > ceph-deploy a try and get stuck on what feels like the same step. > Ceph version is 0.61.7 and OS is centos 6.4. > > Steps i have done is: > #ceph-deploy new cloud-{0,1,2}-fast > #ceph-deploy --overwrite-conf mon create cloud-{0,1,2}-fast > Ceph-mon starts ok on all nodes and ceph-create-keys seems to be stuck. > > cloud-1-fast: root 6580 1 0 11:45 ? 00:00:00 > /usr/bin/ceph-mon -i cloud-1 --pid-file /var/run/ceph/mon.cloud-1.pid -c > /etc/ceph/ceph.conf > cloud-1-fast: root 6601 1 0 11:45 ? 00:00:00 > /usr/bin/python /usr/sbin/ceph-create-keys -i cloud-1 > cloud-2-fast: root 18724 1 0 11:45 ? 00:00:00 > /usr/bin/ceph-mon -i cloud-2 --pid-file /var/run/ceph/mon.cloud-2.pid -c > /etc/ceph/ceph.conf > cloud-2-fast: root 18747 1 0 11:45 ? 00:00:00 > /usr/bin/python /usr/sbin/ceph-create-keys -i cloud-2 > cloud-0-fast: root 19629 8546 0 11:44 pts/0 00:00:00 su - ceph > cloud-0-fast: ceph 19630 19629 0 11:44 pts/0 00:00:00 -bash > cloud-0-fast: root 19853 1 0 11:45 ? 00:00:00 > /usr/bin/ceph-mon -i cloud-0 --pid-file /var/run/ceph/mon.cloud-0.pid -c > /etc/ceph/ceph.conf > cloud-0-fast: root 19872 1 0 11:45 ? 00:00:00 > /usr/bin/python /usr/sbin/ceph-create-keys -i cloud-0 > cloud-0-fast: ceph 20282 19630 0 11:46 pts/0 00:00:00 grep ceph > > I have the /var/log/ceph/ceph-mon.cloud-0.log with debug turned on at > http://pastebin.com/DivE95mK > And the output from a strace of the ceph-create-keys from one of the nodes > at http://pastebin.com/JQak151Z > > Worth mentioning is that each server has 2 interfaces cloud-* ("normal > interface") and cloud-*-fast (10gE that i want to use), hostname resolves > to cloud-*. > The small ceph.conf file created so far > > [global] > debug_ms = 1 > filestore_xattr_use_omap = true > debug_monc = 20 > mon_host = 10.12.1.160,10.12.1.161,10.12.1.162 > osd_journal_size = 1024 > debug_mon = 20 > mon_initial_members = cloud-0-fast, cloud-1-fast, cloud-2-fast > auth_supported = cephx > fsid = 90578caa-3c63-4183-96c7-176467a98ddb > > Regards, > Mathias > > _______________________________________________ > ceph-users mailing list > [email protected] > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > >
_______________________________________________ ceph-users mailing list [email protected] http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
