Hi Maruthi,
and did you test that DNS name lookup properly works (e.g. nslookup
ceph-mon1 etc...) on all hosts?
>From the output of 'ceph-deploy' it seem that the host can only resolve
it's own name but not the others:
[ceph-mon1][DEBUG ] "monmap": {
[ceph-mon1][DEBUG ] "created": "0.000000",
[ceph-mon1][DEBUG ] "epoch": 0,
[ceph-mon1][DEBUG ] "fsid": "d6ca9ac6-bfb9-4464-a128-459068637924",
[ceph-mon1][DEBUG ] "modified": "0.000000",
[ceph-mon1][DEBUG ] "mons": [
[ceph-mon1][DEBUG ] {
[ceph-mon1][DEBUG ] "addr": "10.31.141.76:6789/0",
[ceph-mon1][DEBUG ] "name": "ceph-mon1",
[ceph-mon1][DEBUG ] "rank": 0
[ceph-mon1][DEBUG ] },
[ceph-mon1][DEBUG ] {
[ceph-mon1][DEBUG ] "addr": "0.0.0.0:0/1",
[ceph-mon1][DEBUG ] "name": "ceph-mon2",
[ceph-mon1][DEBUG ] "rank": 1
[ceph-mon1][DEBUG ] },
[ceph-mon1][DEBUG ] {
[ceph-mon1][DEBUG ] "addr": "0.0.0.0:0/2",
[ceph-mon1][DEBUG ] "name": "ceph-mon3",
[ceph-mon1][DEBUG ] "rank": 2
[ceph-mon1][DEBUG ] }
[ceph-mon1][DEBUG ] ]
[ceph-mon1][DEBUG ] },
Best,
Martin
On Fri, Jan 1, 2016 at 3:21 AM, Maruthi Seshidhar <
maruthi.seshid...@gmail.com> wrote:
> hi Wade,
>
> Yes firewalld is disabled on all nodes.
>
> [ceph@ceph-mon1 ~]$ systemctl status firewalld
> firewalld.service - firewalld - dynamic firewall daemon
> Loaded: loaded (/usr/lib/systemd/system/firewalld.service; disabled)
> Active: inactive (dead)
>
> thanks,
> Maruthi.
>
> On Fri, Jan 1, 2016 at 7:46 AM, Wade Holler <wade.hol...@gmail.com> wrote:
>
>> I assume you have tested with firewalld disabled ?
>>
>> Best Regards
>> Wade
>> On Thu, Dec 31, 2015 at 9:13 PM Maruthi Seshidhar <
>> maruthi.seshid...@gmail.com> wrote:
>>
>>> hi fellow users,
>>>
>>> I am setting up a ceph cluster with 3 monitors, 4 osds on CentOS 7.1
>>>
>>> Each of the nodes have 2 NICs.
>>> 10.31.141.0/23 is the public n/w and 192.168.10.0/24 is the cluster n/w.
>>>
>>> Completed the "Preflight Checklist"
>>> <http://docs.ceph.com/docs/master/start/quick-start-preflight/>.
>>> But in the "Storage Cluster Quick Start"
>>> <http://docs.ceph.com/docs/master/start/quick-ceph-deploy/>, while
>>> doing "ceph-deploy create-initial" I see error "Some monitors have still
>>> not reached quorum".
>>>
>>> [ceph@ceph-mgmt ceph-cluster]$ ceph-deploy --overwrite-conf mon
>>> create-initial
>>> [ceph_deploy.conf][DEBUG ] found configuration file at:
>>> /home/ceph/.cephdeploy.conf
>>> [ceph_deploy.cli][INFO ] Invoked (1.5.30): /usr/bin/ceph-deploy
>>> --overwrite-conf mon create-initial
>>> [ceph_deploy.cli][INFO ] ceph-deploy options:
>>> [ceph_deploy.cli][INFO ] username : None
>>> [ceph_deploy.cli][INFO ] verbose : False
>>> [ceph_deploy.cli][INFO ] overwrite_conf : True
>>> [ceph_deploy.cli][INFO ] subcommand : create-initial
>>> [ceph_deploy.cli][INFO ] quiet : False
>>> [ceph_deploy.cli][INFO ] cd_conf :
>>> <ceph_deploy.conf.cephdeploy.Conf instance at 0x1fe7488>
>>> [ceph_deploy.cli][INFO ] cluster : ceph
>>> [ceph_deploy.cli][INFO ] func : <function mon
>>> at 0x1fd6e60>
>>> [ceph_deploy.cli][INFO ] ceph_conf : None
>>> [ceph_deploy.cli][INFO ] default_release : False
>>> [ceph_deploy.cli][INFO ] keyrings : None
>>> [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts ceph-mon1
>>> ceph-mon2 ceph-mon3
>>> [ceph_deploy.mon][DEBUG ] detecting platform for host ceph-mon1 ...
>>> [ceph-mon1][DEBUG ] connection detected need for sudo
>>> [ceph-mon1][DEBUG ] connected to host: ceph-mon1
>>> [ceph-mon1][DEBUG ] detect platform information from remote host
>>> [ceph-mon1][DEBUG ] detect machine type
>>> [ceph-mon1][DEBUG ] find the location of an executable
>>> [ceph_deploy.mon][INFO ] distro info: CentOS Linux 7.1.1503 Core
>>> [ceph-mon1][DEBUG ] determining if provided host has same hostname in
>>> remote
>>> [ceph-mon1][DEBUG ] get remote short hostname
>>> [ceph-mon1][DEBUG ] deploying mon to ceph-mon1
>>> [ceph-mon1][DEBUG ] get remote short hostname
>>> [ceph-mon1][DEBUG ] remote hostname: ceph-mon1
>>> [ceph-mon1][DEBUG ] write cluster configuration to
>>> /etc/ceph/{cluster}.conf
>>> [ceph-mon1][DEBUG ] create the mon path if it does not exist
>>> [ceph-mon1][DEBUG ] checking for done path:
>>> /var/lib/ceph/mon/ceph-ceph-mon1/done
>>> [ceph-mon1][DEBUG ] create a done file to avoid re-doing the mon
>>> deployment
>>> [ceph-mon1][DEBUG ] create the init path if it does not exist
>>> [ceph-mon1][INFO ] Running command: sudo systemctl enable ceph.target
>>> [ceph-mon1][INFO ] Running command: sudo systemctl enable
>>> ceph-mon@ceph-mon1
>>> [ceph-mon1][INFO ] Running command: sudo systemctl start
>>> ceph-mon@ceph-mon1
>>> [ceph-mon1][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon1.asok mon_status
>>> [ceph-mon1][DEBUG ]
>>> ********************************************************************************
>>> [ceph-mon1][DEBUG ] status for monitor: mon.ceph-mon1
>>> [ceph-mon1][DEBUG ] {
>>> [ceph-mon1][DEBUG ] "election_epoch": 0,
>>> [ceph-mon1][DEBUG ] "extra_probe_peers": [
>>> [ceph-mon1][DEBUG ] "192.168.10.3:6789/0",
>>> [ceph-mon1][DEBUG ] "192.168.10.4:6789/0",
>>> [ceph-mon1][DEBUG ] "192.168.10.5:6789/0"
>>> [ceph-mon1][DEBUG ] ],
>>> [ceph-mon1][DEBUG ] "monmap": {
>>> [ceph-mon1][DEBUG ] "created": "0.000000",
>>> [ceph-mon1][DEBUG ] "epoch": 0,
>>> [ceph-mon1][DEBUG ] "fsid": "d6ca9ac6-bfb9-4464-a128-459068637924",
>>> [ceph-mon1][DEBUG ] "modified": "0.000000",
>>> [ceph-mon1][DEBUG ] "mons": [
>>> [ceph-mon1][DEBUG ] {
>>> [ceph-mon1][DEBUG ] "addr": "10.31.141.76:6789/0",
>>> [ceph-mon1][DEBUG ] "name": "ceph-mon1",
>>> [ceph-mon1][DEBUG ] "rank": 0
>>> [ceph-mon1][DEBUG ] },
>>> [ceph-mon1][DEBUG ] {
>>> [ceph-mon1][DEBUG ] "addr": "0.0.0.0:0/1",
>>> [ceph-mon1][DEBUG ] "name": "ceph-mon2",
>>> [ceph-mon1][DEBUG ] "rank": 1
>>> [ceph-mon1][DEBUG ] },
>>> [ceph-mon1][DEBUG ] {
>>> [ceph-mon1][DEBUG ] "addr": "0.0.0.0:0/2",
>>> [ceph-mon1][DEBUG ] "name": "ceph-mon3",
>>> [ceph-mon1][DEBUG ] "rank": 2
>>> [ceph-mon1][DEBUG ] }
>>> [ceph-mon1][DEBUG ] ]
>>> [ceph-mon1][DEBUG ] },
>>> [ceph-mon1][DEBUG ] "name": "ceph-mon1",
>>> [ceph-mon1][DEBUG ] "outside_quorum": [
>>> [ceph-mon1][DEBUG ] "ceph-mon1"
>>> [ceph-mon1][DEBUG ] ],
>>> [ceph-mon1][DEBUG ] "quorum": [],
>>> [ceph-mon1][DEBUG ] "rank": 0,
>>> [ceph-mon1][DEBUG ] "state": "probing",
>>> [ceph-mon1][DEBUG ] "sync_provider": []
>>> [ceph-mon1][DEBUG ] }
>>> [ceph-mon1][DEBUG ]
>>> ********************************************************************************
>>> [ceph-mon1][INFO ] monitor: mon.ceph-mon1 is running
>>> [ceph-mon1][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon1.asok mon_status
>>> [ceph_deploy.mon][DEBUG ] detecting platform for host ceph-mon2 ...
>>> Warning: Permanently added the ECDSA host key for IP address
>>> '10.31.141.77' to the list of known hosts.
>>> [ceph-mon2][DEBUG ] connection detected need for sudo
>>> [ceph-mon2][DEBUG ] connected to host: ceph-mon2
>>> [ceph-mon2][DEBUG ] detect platform information from remote host
>>> [ceph-mon2][DEBUG ] detect machine type
>>> [ceph-mon2][DEBUG ] find the location of an executable
>>> [ceph_deploy.mon][INFO ] distro info: CentOS Linux 7.1.1503 Core
>>> [ceph-mon2][DEBUG ] determining if provided host has same hostname in
>>> remote
>>> [ceph-mon2][DEBUG ] get remote short hostname
>>> [ceph-mon2][DEBUG ] deploying mon to ceph-mon2
>>> [ceph-mon2][DEBUG ] get remote short hostname
>>> [ceph-mon2][DEBUG ] remote hostname: ceph-mon2
>>> [ceph-mon2][DEBUG ] write cluster configuration to
>>> /etc/ceph/{cluster}.conf
>>> [ceph-mon2][DEBUG ] create the mon path if it does not exist
>>> [ceph-mon2][DEBUG ] checking for done path:
>>> /var/lib/ceph/mon/ceph-ceph-mon2/done
>>> [ceph-mon2][DEBUG ] create a done file to avoid re-doing the mon
>>> deployment
>>> [ceph-mon2][DEBUG ] create the init path if it does not exist
>>> [ceph-mon2][INFO ] Running command: sudo systemctl enable ceph.target
>>> [ceph-mon2][INFO ] Running command: sudo systemctl enable
>>> ceph-mon@ceph-mon2
>>> [ceph-mon2][INFO ] Running command: sudo systemctl start
>>> ceph-mon@ceph-mon2
>>> [ceph-mon2][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon2.asok mon_status
>>> [ceph-mon2][DEBUG ]
>>> ********************************************************************************
>>> [ceph-mon2][DEBUG ] status for monitor: mon.ceph-mon2
>>> [ceph-mon2][DEBUG ] {
>>> [ceph-mon2][DEBUG ] "election_epoch": 0,
>>> [ceph-mon2][DEBUG ] "extra_probe_peers": [
>>> [ceph-mon2][DEBUG ] "192.168.10.3:6789/0",
>>> [ceph-mon2][DEBUG ] "192.168.10.4:6789/0",
>>> [ceph-mon2][DEBUG ] "192.168.10.5:6789/0"
>>> [ceph-mon2][DEBUG ] ],
>>> [ceph-mon2][DEBUG ] "monmap": {
>>> [ceph-mon2][DEBUG ] "created": "0.000000",
>>> [ceph-mon2][DEBUG ] "epoch": 0,
>>> [ceph-mon2][DEBUG ] "fsid": "d6ca9ac6-bfb9-4464-a128-459068637924",
>>> [ceph-mon2][DEBUG ] "modified": "0.000000",
>>> [ceph-mon2][DEBUG ] "mons": [
>>> [ceph-mon2][DEBUG ] {
>>> [ceph-mon2][DEBUG ] "addr": "10.31.141.77:6789/0",
>>> [ceph-mon2][DEBUG ] "name": "ceph-mon2",
>>> [ceph-mon2][DEBUG ] "rank": 0
>>> [ceph-mon2][DEBUG ] },
>>> [ceph-mon2][DEBUG ] {
>>> [ceph-mon2][DEBUG ] "addr": "0.0.0.0:0/1",
>>> [ceph-mon2][DEBUG ] "name": "ceph-mon1",
>>> [ceph-mon2][DEBUG ] "rank": 1
>>> [ceph-mon2][DEBUG ] },
>>> [ceph-mon2][DEBUG ] {
>>> [ceph-mon2][DEBUG ] "addr": "0.0.0.0:0/2",
>>> [ceph-mon2][DEBUG ] "name": "ceph-mon3",
>>> [ceph-mon2][DEBUG ] "rank": 2
>>> [ceph-mon2][DEBUG ] }
>>> [ceph-mon2][DEBUG ] ]
>>> [ceph-mon2][DEBUG ] },
>>> [ceph-mon2][DEBUG ] "name": "ceph-mon2",
>>> [ceph-mon2][DEBUG ] "outside_quorum": [
>>> [ceph-mon2][DEBUG ] "ceph-mon2"
>>> [ceph-mon2][DEBUG ] ],
>>> [ceph-mon2][DEBUG ] "quorum": [],
>>> [ceph-mon2][DEBUG ] "rank": 0,
>>> [ceph-mon2][DEBUG ] "state": "probing",
>>> [ceph-mon2][DEBUG ] "sync_provider": []
>>> [ceph-mon2][DEBUG ] }
>>> [ceph-mon2][DEBUG ]
>>> ********************************************************************************
>>> [ceph-mon2][INFO ] monitor: mon.ceph-mon2 is running
>>> [ceph-mon2][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon2.asok mon_status
>>> [ceph_deploy.mon][DEBUG ] detecting platform for host ceph-mon3 ...
>>> Warning: Permanently added the ECDSA host key for IP address
>>> '10.31.141.78' to the list of known hosts.
>>> [ceph-mon3][DEBUG ] connection detected need for sudo
>>> [ceph-mon3][DEBUG ] connected to host: ceph-mon3
>>> [ceph-mon3][DEBUG ] detect platform information from remote host
>>> [ceph-mon3][DEBUG ] detect machine type
>>> [ceph-mon3][DEBUG ] find the location of an executable
>>> [ceph_deploy.mon][INFO ] distro info: CentOS Linux 7.1.1503 Core
>>> [ceph-mon3][DEBUG ] determining if provided host has same hostname in
>>> remote
>>> [ceph-mon3][DEBUG ] get remote short hostname
>>> [ceph-mon3][DEBUG ] deploying mon to ceph-mon3
>>> [ceph-mon3][DEBUG ] get remote short hostname
>>> [ceph-mon3][DEBUG ] remote hostname: ceph-mon3
>>> [ceph-mon3][DEBUG ] write cluster configuration to
>>> /etc/ceph/{cluster}.conf
>>> [ceph-mon3][DEBUG ] create the mon path if it does not exist
>>> [ceph-mon3][DEBUG ] checking for done path:
>>> /var/lib/ceph/mon/ceph-ceph-mon3/done
>>> [ceph-mon3][DEBUG ] create a done file to avoid re-doing the mon
>>> deployment
>>> [ceph-mon3][DEBUG ] create the init path if it does not exist
>>> [ceph-mon3][INFO ] Running command: sudo systemctl enable ceph.target
>>> [ceph-mon3][INFO ] Running command: sudo systemctl enable
>>> ceph-mon@ceph-mon3
>>> [ceph-mon3][INFO ] Running command: sudo systemctl start
>>> ceph-mon@ceph-mon3
>>> [ceph-mon3][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon3.asok mon_status
>>> [ceph-mon3][DEBUG ]
>>> ********************************************************************************
>>> [ceph-mon3][DEBUG ] status for monitor: mon.ceph-mon3
>>> [ceph-mon3][DEBUG ] {
>>> [ceph-mon3][DEBUG ] "election_epoch": 0,
>>> [ceph-mon3][DEBUG ] "extra_probe_peers": [
>>> [ceph-mon3][DEBUG ] "192.168.10.3:6789/0",
>>> [ceph-mon3][DEBUG ] "192.168.10.4:6789/0",
>>> [ceph-mon3][DEBUG ] "192.168.10.5:6789/0"
>>> [ceph-mon3][DEBUG ] ],
>>> [ceph-mon3][DEBUG ] "monmap": {
>>> [ceph-mon3][DEBUG ] "created": "0.000000",
>>> [ceph-mon3][DEBUG ] "epoch": 0,
>>> [ceph-mon3][DEBUG ] "fsid": "d6ca9ac6-bfb9-4464-a128-459068637924",
>>> [ceph-mon3][DEBUG ] "modified": "0.000000",
>>> [ceph-mon3][DEBUG ] "mons": [
>>> [ceph-mon3][DEBUG ] {
>>> [ceph-mon3][DEBUG ] "addr": "10.31.141.78:6789/0",
>>> [ceph-mon3][DEBUG ] "name": "ceph-mon3",
>>> [ceph-mon3][DEBUG ] "rank": 0
>>> [ceph-mon3][DEBUG ] },
>>> [ceph-mon3][DEBUG ] {
>>> [ceph-mon3][DEBUG ] "addr": "0.0.0.0:0/1",
>>> [ceph-mon3][DEBUG ] "name": "ceph-mon1",
>>> [ceph-mon3][DEBUG ] "rank": 1
>>> [ceph-mon3][DEBUG ] },
>>> [ceph-mon3][DEBUG ] {
>>> [ceph-mon3][DEBUG ] "addr": "0.0.0.0:0/2",
>>> [ceph-mon3][DEBUG ] "name": "ceph-mon2",
>>> [ceph-mon3][DEBUG ] "rank": 2
>>> [ceph-mon3][DEBUG ] }
>>> [ceph-mon3][DEBUG ] ]
>>> [ceph-mon3][DEBUG ] },
>>> [ceph-mon3][DEBUG ] "name": "ceph-mon3",
>>> [ceph-mon3][DEBUG ] "outside_quorum": [
>>> [ceph-mon3][DEBUG ] "ceph-mon3"
>>> [ceph-mon3][DEBUG ] ],
>>> [ceph-mon3][DEBUG ] "quorum": [],
>>> [ceph-mon3][DEBUG ] "rank": 0,
>>> [ceph-mon3][DEBUG ] "state": "probing",
>>> [ceph-mon3][DEBUG ] "sync_provider": []
>>> [ceph-mon3][DEBUG ] }
>>> [ceph-mon3][DEBUG ]
>>> ********************************************************************************
>>> [ceph-mon3][INFO ] monitor: mon.ceph-mon3 is running
>>> [ceph-mon3][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon3.asok mon_status
>>> [ceph_deploy.mon][INFO ] processing monitor mon.ceph-mon1
>>> [ceph-mon1][DEBUG ] connection detected need for sudo
>>> [ceph-mon1][DEBUG ] connected to host: ceph-mon1
>>> [ceph-mon1][DEBUG ] detect platform information from remote host
>>> [ceph-mon1][DEBUG ] detect machine type
>>> [ceph-mon1][DEBUG ] find the location of an executable
>>> [ceph-mon1][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon1.asok mon_status
>>> [ceph_deploy.mon][WARNIN] mon.ceph-mon1 monitor is not yet in quorum,
>>> tries left: 5
>>> [ceph_deploy.mon][WARNIN] waiting 5 seconds before retrying
>>> [ceph-mon1][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon1.asok mon_status
>>> [ceph_deploy.mon][WARNIN] mon.ceph-mon1 monitor is not yet in quorum,
>>> tries left: 4
>>> [ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
>>> [ceph-mon1][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon1.asok mon_status
>>> [ceph_deploy.mon][WARNIN] mon.ceph-mon1 monitor is not yet in quorum,
>>> tries left: 3
>>> [ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
>>> [ceph-mon1][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon1.asok mon_status
>>> [ceph_deploy.mon][WARNIN] mon.ceph-mon1 monitor is not yet in quorum,
>>> tries left: 2
>>> [ceph_deploy.mon][WARNIN] waiting 15 seconds before retrying
>>> [ceph-mon1][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon1.asok mon_status
>>> [ceph_deploy.mon][WARNIN] mon.ceph-mon1 monitor is not yet in quorum,
>>> tries left: 1
>>> [ceph_deploy.mon][WARNIN] waiting 20 seconds before retrying
>>> [ceph_deploy.mon][INFO ] processing monitor mon.ceph-mon2
>>> [ceph-mon2][DEBUG ] connection detected need for sudo
>>> [ceph-mon2][DEBUG ] connected to host: ceph-mon2
>>> [ceph-mon2][DEBUG ] detect platform information from remote host
>>> [ceph-mon2][DEBUG ] detect machine type
>>> [ceph-mon2][DEBUG ] find the location of an executable
>>> [ceph-mon2][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon2.asok mon_status
>>> [ceph_deploy.mon][WARNIN] mon.ceph-mon2 monitor is not yet in quorum,
>>> tries left: 5
>>> [ceph_deploy.mon][WARNIN] waiting 5 seconds before retrying
>>> [ceph-mon2][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon2.asok mon_status
>>> [ceph_deploy.mon][WARNIN] mon.ceph-mon2 monitor is not yet in quorum,
>>> tries left: 4
>>> [ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
>>> [ceph-mon2][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon2.asok mon_status
>>> [ceph_deploy.mon][WARNIN] mon.ceph-mon2 monitor is not yet in quorum,
>>> tries left: 3
>>> [ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
>>> [ceph-mon2][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon2.asok mon_status
>>> [ceph_deploy.mon][WARNIN] mon.ceph-mon2 monitor is not yet in quorum,
>>> tries left: 2
>>> [ceph_deploy.mon][WARNIN] waiting 15 seconds before retrying
>>> [ceph-mon2][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon2.asok mon_status
>>> [ceph_deploy.mon][WARNIN] mon.ceph-mon2 monitor is not yet in quorum,
>>> tries left: 1
>>> [ceph_deploy.mon][WARNIN] waiting 20 seconds before retrying
>>> [ceph_deploy.mon][INFO ] processing monitor mon.ceph-mon3
>>> [ceph-mon3][DEBUG ] connection detected need for sudo
>>> [ceph-mon3][DEBUG ] connected to host: ceph-mon3
>>> [ceph-mon3][DEBUG ] detect platform information from remote host
>>> [ceph-mon3][DEBUG ] detect machine type
>>> [ceph-mon3][DEBUG ] find the location of an executable
>>> [ceph-mon3][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon3.asok mon_status
>>> [ceph_deploy.mon][WARNIN] mon.ceph-mon3 monitor is not yet in quorum,
>>> tries left: 5
>>> [ceph_deploy.mon][WARNIN] waiting 5 seconds before retrying
>>> [ceph-mon3][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon3.asok mon_status
>>> [ceph_deploy.mon][WARNIN] mon.ceph-mon3 monitor is not yet in quorum,
>>> tries left: 4
>>> [ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
>>> [ceph-mon3][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon3.asok mon_status
>>> [ceph_deploy.mon][WARNIN] mon.ceph-mon3 monitor is not yet in quorum,
>>> tries left: 3
>>> [ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
>>> [ceph-mon3][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon3.asok mon_status
>>> [ceph_deploy.mon][WARNIN] mon.ceph-mon3 monitor is not yet in quorum,
>>> tries left: 2
>>> [ceph_deploy.mon][WARNIN] waiting 15 seconds before retrying
>>> [ceph-mon3][INFO ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon3.asok mon_status
>>> [ceph_deploy.mon][WARNIN] mon.ceph-mon3 monitor is not yet in quorum,
>>> tries left: 1
>>> [ceph_deploy.mon][WARNIN] waiting 20 seconds before retrying
>>> [ceph_deploy.mon][ERROR ] Some monitors have still not reached quorum:
>>> [ceph_deploy.mon][ERROR ] ceph-mon2
>>> [ceph_deploy.mon][ERROR ] ceph-mon3
>>> [ceph_deploy.mon][ERROR ] ceph-mon1
>>>
>>> I tried enlisting 192168.10.x IPs for mon_host in the ceph.conf file,
>>> but still monitors are not joining the quorum.
>>>
>>> On all nodes the /etc/hosts file is
>>>
>>> $ cat /etc/hosts
>>> 127.0.0.1 localhost localhost.localdomain localhost4
>>> localhost4.localdomain4
>>> ::1 localhost localhost.localdomain localhost6
>>> localhost6.localdomain6
>>> 10.31.141.75 ceph-mgmt
>>> 10.31.141.76 ceph-mon1
>>> 10.31.141.77 ceph-mon2
>>> 10.31.141.78 ceph-mon3
>>> #192.168.10.2 ceph-mgmt
>>> #192.168.10.3 ceph-mon1
>>> #192.168.10.4 ceph-mon2
>>> #192.168.10.5 ceph-mon3
>>> 192.168.10.6 ceph-node1
>>> 192.168.10.7 ceph-node2
>>> 192.168.10.8 ceph-node3
>>> 192.168.10.9 ceph-node4
>>>
>>>
>>> [ceph@ceph-mgmt ceph-cluster]$ cat ceph.conf
>>> [global]
>>> fsid = 5448338e-aa85-4251-9e27-e38f35bd4b34
>>> mon_initial_members = ceph-mon1, ceph-mon2, ceph-mon3
>>> #mon_host = 192.168.10.3,192.168.10.4,192.168.10.5
>>> mon_host = 10.31.141.76, 10.31.141.77, 10.31.141.78
>>> auth_cluster_required = none
>>> auth_service_required = none
>>> auth_client_required = none
>>> #auth_cluster_required = cephx
>>> #auth_service_required = cephx
>>> #auth_client_required = cephx
>>> filestore_xattr_use_omap = true
>>> public network = 10.31.141.0/23
>>> cluster network = 192.168.10.0/24
>>>
>>> Thanks,
>>> Maruthi Seshidhar
>>> _______________________________________________
>>> ceph-users mailing list
>>> ceph-users@lists.ceph.com
>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>
>>
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
