subject:"Re\: \[ceph\-users\] ceph\-deploy create\-initial errors out with \"Some monitors have still not reached quorum\""

Re: [ceph-users] ceph-deploy create-initial errors out with "Some monitors have still not reached quorum"

2016-01-05 Thread Martin Palma

Hi Maruthi,

happy to hear that it is working now.

Yes, with the latest stable release, infernalis, the "ceph" username is
reserved  for the Ceph daemons.

Best,
Martin

On Tuesday, 5 January 2016, Maruthi Seshidhar 
wrote:

> Thank you Martin,
>
> Yes, "nslookup " was not working.
> After configuring DNS on all nodes, the nslookup issue got sorted out.
>
> But the "some monitors have still not reach quorun" issue was still seen.
> I was using user "ceph" for ceph deployment. The user "ceph" is reserved
> for ceph internal use.
> After creating a new user "cephdeploy", and running ceph-deploy commands
> from this user, the cluster came up.
>
> thanks & regards,
> Maruthi.
>
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] ceph-deploy create-initial errors out with "Some monitors have still not reached quorum"

2016-01-04 Thread Maruthi Seshidhar

Thank you Martin,

Yes, "nslookup " was not working.
After configuring DNS on all nodes, the nslookup issue got sorted out.

But the "some monitors have still not reach quorun" issue was still seen.
I was using user "ceph" for ceph deployment. The user "ceph" is reserved
for ceph internal use.
After creating a new user "cephdeploy", and running ceph-deploy commands
from this user, the cluster came up.

thanks & regards,
Maruthi.
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] ceph-deploy create-initial errors out with "Some monitors have still not reached quorum"

2016-01-01 Thread Martin Palma

Hi Maruthi,

and did you test that DNS name lookup properly works (e.g. nslookup
ceph-mon1 etc...) on all hosts?

>From the output of 'ceph-deploy' it seem that the host can only resolve
it's own name but not the others:

[ceph-mon1][DEBUG ]   "monmap": {
[ceph-mon1][DEBUG ] "created": "0.00",
[ceph-mon1][DEBUG ] "epoch": 0,
[ceph-mon1][DEBUG ] "fsid": "d6ca9ac6-bfb9-4464-a128-459068637924",
[ceph-mon1][DEBUG ] "modified": "0.00",
[ceph-mon1][DEBUG ] "mons": [
[ceph-mon1][DEBUG ]   {
[ceph-mon1][DEBUG ] "addr": "10.31.141.76:6789/0",
[ceph-mon1][DEBUG ] "name": "ceph-mon1",
[ceph-mon1][DEBUG ] "rank": 0
[ceph-mon1][DEBUG ]   },
[ceph-mon1][DEBUG ]   {
[ceph-mon1][DEBUG ] "addr": "0.0.0.0:0/1",
[ceph-mon1][DEBUG ] "name": "ceph-mon2",
[ceph-mon1][DEBUG ] "rank": 1
[ceph-mon1][DEBUG ]   },
[ceph-mon1][DEBUG ]   {
[ceph-mon1][DEBUG ] "addr": "0.0.0.0:0/2",
[ceph-mon1][DEBUG ] "name": "ceph-mon3",
[ceph-mon1][DEBUG ] "rank": 2
[ceph-mon1][DEBUG ]   }
[ceph-mon1][DEBUG ] ]
[ceph-mon1][DEBUG ]   },


Best,
Martin


On Fri, Jan 1, 2016 at 3:21 AM, Maruthi Seshidhar <
maruthi.seshid...@gmail.com> wrote:

> hi Wade,
>
> Yes firewalld is disabled on all nodes.
>
> [ceph@ceph-mon1 ~]$ systemctl status firewalld
> firewalld.service - firewalld - dynamic firewall daemon
>Loaded: loaded (/usr/lib/systemd/system/firewalld.service; disabled)
>Active: inactive (dead)
>
> thanks,
> Maruthi.
>
> On Fri, Jan 1, 2016 at 7:46 AM, Wade Holler  wrote:
>
>> I assume you have tested with firewalld disabled ?
>>
>> Best Regards
>> Wade
>> On Thu, Dec 31, 2015 at 9:13 PM Maruthi Seshidhar <
>> maruthi.seshid...@gmail.com> wrote:
>>
>>> hi fellow users,
>>>
>>> I am setting up a ceph cluster with 3 monitors, 4 osds on CentOS 7.1
>>>
>>> Each of the nodes have 2 NICs.
>>> 10.31.141.0/23 is the public n/w and 192.168.10.0/24 is the cluster n/w.
>>>
>>> Completed the "Preflight Checklist"
>>> .
>>> But in the "Storage Cluster Quick Start"
>>> , while
>>> doing "ceph-deploy create-initial" I see  error "Some monitors have still
>>> not reached quorum".
>>>
>>> [ceph@ceph-mgmt ceph-cluster]$ ceph-deploy --overwrite-conf mon
>>> create-initial
>>> [ceph_deploy.conf][DEBUG ] found configuration file at:
>>> /home/ceph/.cephdeploy.conf
>>> [ceph_deploy.cli][INFO  ] Invoked (1.5.30): /usr/bin/ceph-deploy
>>> --overwrite-conf mon create-initial
>>> [ceph_deploy.cli][INFO  ] ceph-deploy options:
>>> [ceph_deploy.cli][INFO  ]  username  : None
>>> [ceph_deploy.cli][INFO  ]  verbose   : False
>>> [ceph_deploy.cli][INFO  ]  overwrite_conf: True
>>> [ceph_deploy.cli][INFO  ]  subcommand: create-initial
>>> [ceph_deploy.cli][INFO  ]  quiet : False
>>> [ceph_deploy.cli][INFO  ]  cd_conf   :
>>> 
>>> [ceph_deploy.cli][INFO  ]  cluster   : ceph
>>> [ceph_deploy.cli][INFO  ]  func  : >> at 0x1fd6e60>
>>> [ceph_deploy.cli][INFO  ]  ceph_conf : None
>>> [ceph_deploy.cli][INFO  ]  default_release   : False
>>> [ceph_deploy.cli][INFO  ]  keyrings  : None
>>> [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts ceph-mon1
>>> ceph-mon2 ceph-mon3
>>> [ceph_deploy.mon][DEBUG ] detecting platform for host ceph-mon1 ...
>>> [ceph-mon1][DEBUG ] connection detected need for sudo
>>> [ceph-mon1][DEBUG ] connected to host: ceph-mon1
>>> [ceph-mon1][DEBUG ] detect platform information from remote host
>>> [ceph-mon1][DEBUG ] detect machine type
>>> [ceph-mon1][DEBUG ] find the location of an executable
>>> [ceph_deploy.mon][INFO  ] distro info: CentOS Linux 7.1.1503 Core
>>> [ceph-mon1][DEBUG ] determining if provided host has same hostname in
>>> remote
>>> [ceph-mon1][DEBUG ] get remote short hostname
>>> [ceph-mon1][DEBUG ] deploying mon to ceph-mon1
>>> [ceph-mon1][DEBUG ] get remote short hostname
>>> [ceph-mon1][DEBUG ] remote hostname: ceph-mon1
>>> [ceph-mon1][DEBUG ] write cluster configuration to
>>> /etc/ceph/{cluster}.conf
>>> [ceph-mon1][DEBUG ] create the mon path if it does not exist
>>> [ceph-mon1][DEBUG ] checking for done path:
>>> /var/lib/ceph/mon/ceph-ceph-mon1/done
>>> [ceph-mon1][DEBUG ] create a done file to avoid re-doing the mon
>>> deployment
>>> [ceph-mon1][DEBUG ] create the init path if it does not exist
>>> [ceph-mon1][INFO  ] Running command: sudo systemctl enable ceph.target
>>> [ceph-mon1][INFO  ] Running command: sudo systemctl enable
>>> ceph-mon@ceph-mon1
>>> [ceph-mon1][INFO  ] Running command: sudo systemctl start
>>> ceph-mon@ceph-mon1
>>> [ceph-mon1][INFO  ] Running command: sudo ceph --cluster=ceph
>>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon1.asok m

Re: [ceph-users] ceph-deploy create-initial errors out with "Some monitors have still not reached quorum"

2015-12-31 Thread Maruthi Seshidhar

hi Wade,

Yes firewalld is disabled on all nodes.

[ceph@ceph-mon1 ~]$ systemctl status firewalld
firewalld.service - firewalld - dynamic firewall daemon
   Loaded: loaded (/usr/lib/systemd/system/firewalld.service; disabled)
   Active: inactive (dead)

thanks,
Maruthi.

On Fri, Jan 1, 2016 at 7:46 AM, Wade Holler  wrote:

> I assume you have tested with firewalld disabled ?
>
> Best Regards
> Wade
> On Thu, Dec 31, 2015 at 9:13 PM Maruthi Seshidhar <
> maruthi.seshid...@gmail.com> wrote:
>
>> hi fellow users,
>>
>> I am setting up a ceph cluster with 3 monitors, 4 osds on CentOS 7.1
>>
>> Each of the nodes have 2 NICs.
>> 10.31.141.0/23 is the public n/w and 192.168.10.0/24 is the cluster n/w.
>>
>> Completed the "Preflight Checklist"
>> .
>> But in the "Storage Cluster Quick Start"
>> , while doing
>> "ceph-deploy create-initial" I see  error "Some monitors have still not
>> reached quorum".
>>
>> [ceph@ceph-mgmt ceph-cluster]$ ceph-deploy --overwrite-conf mon
>> create-initial
>> [ceph_deploy.conf][DEBUG ] found configuration file at:
>> /home/ceph/.cephdeploy.conf
>> [ceph_deploy.cli][INFO  ] Invoked (1.5.30): /usr/bin/ceph-deploy
>> --overwrite-conf mon create-initial
>> [ceph_deploy.cli][INFO  ] ceph-deploy options:
>> [ceph_deploy.cli][INFO  ]  username  : None
>> [ceph_deploy.cli][INFO  ]  verbose   : False
>> [ceph_deploy.cli][INFO  ]  overwrite_conf: True
>> [ceph_deploy.cli][INFO  ]  subcommand: create-initial
>> [ceph_deploy.cli][INFO  ]  quiet : False
>> [ceph_deploy.cli][INFO  ]  cd_conf   :
>> 
>> [ceph_deploy.cli][INFO  ]  cluster   : ceph
>> [ceph_deploy.cli][INFO  ]  func  : > at 0x1fd6e60>
>> [ceph_deploy.cli][INFO  ]  ceph_conf : None
>> [ceph_deploy.cli][INFO  ]  default_release   : False
>> [ceph_deploy.cli][INFO  ]  keyrings  : None
>> [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts ceph-mon1
>> ceph-mon2 ceph-mon3
>> [ceph_deploy.mon][DEBUG ] detecting platform for host ceph-mon1 ...
>> [ceph-mon1][DEBUG ] connection detected need for sudo
>> [ceph-mon1][DEBUG ] connected to host: ceph-mon1
>> [ceph-mon1][DEBUG ] detect platform information from remote host
>> [ceph-mon1][DEBUG ] detect machine type
>> [ceph-mon1][DEBUG ] find the location of an executable
>> [ceph_deploy.mon][INFO  ] distro info: CentOS Linux 7.1.1503 Core
>> [ceph-mon1][DEBUG ] determining if provided host has same hostname in
>> remote
>> [ceph-mon1][DEBUG ] get remote short hostname
>> [ceph-mon1][DEBUG ] deploying mon to ceph-mon1
>> [ceph-mon1][DEBUG ] get remote short hostname
>> [ceph-mon1][DEBUG ] remote hostname: ceph-mon1
>> [ceph-mon1][DEBUG ] write cluster configuration to
>> /etc/ceph/{cluster}.conf
>> [ceph-mon1][DEBUG ] create the mon path if it does not exist
>> [ceph-mon1][DEBUG ] checking for done path:
>> /var/lib/ceph/mon/ceph-ceph-mon1/done
>> [ceph-mon1][DEBUG ] create a done file to avoid re-doing the mon
>> deployment
>> [ceph-mon1][DEBUG ] create the init path if it does not exist
>> [ceph-mon1][INFO  ] Running command: sudo systemctl enable ceph.target
>> [ceph-mon1][INFO  ] Running command: sudo systemctl enable
>> ceph-mon@ceph-mon1
>> [ceph-mon1][INFO  ] Running command: sudo systemctl start
>> ceph-mon@ceph-mon1
>> [ceph-mon1][INFO  ] Running command: sudo ceph --cluster=ceph
>> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon1.asok mon_status
>> [ceph-mon1][DEBUG ]
>> 
>> [ceph-mon1][DEBUG ] status for monitor: mon.ceph-mon1
>> [ceph-mon1][DEBUG ] {
>> [ceph-mon1][DEBUG ]   "election_epoch": 0,
>> [ceph-mon1][DEBUG ]   "extra_probe_peers": [
>> [ceph-mon1][DEBUG ] "192.168.10.3:6789/0",
>> [ceph-mon1][DEBUG ] "192.168.10.4:6789/0",
>> [ceph-mon1][DEBUG ] "192.168.10.5:6789/0"
>> [ceph-mon1][DEBUG ]   ],
>> [ceph-mon1][DEBUG ]   "monmap": {
>> [ceph-mon1][DEBUG ] "created": "0.00",
>> [ceph-mon1][DEBUG ] "epoch": 0,
>> [ceph-mon1][DEBUG ] "fsid": "d6ca9ac6-bfb9-4464-a128-459068637924",
>> [ceph-mon1][DEBUG ] "modified": "0.00",
>> [ceph-mon1][DEBUG ] "mons": [
>> [ceph-mon1][DEBUG ]   {
>> [ceph-mon1][DEBUG ] "addr": "10.31.141.76:6789/0",
>> [ceph-mon1][DEBUG ] "name": "ceph-mon1",
>> [ceph-mon1][DEBUG ] "rank": 0
>> [ceph-mon1][DEBUG ]   },
>> [ceph-mon1][DEBUG ]   {
>> [ceph-mon1][DEBUG ] "addr": "0.0.0.0:0/1",
>> [ceph-mon1][DEBUG ] "name": "ceph-mon2",
>> [ceph-mon1][DEBUG ] "rank": 1
>> [ceph-mon1][DEBUG ]   },
>> [ceph-mon1][DEBUG ]   {
>> [ceph-mon1][DEBUG ] "addr": "0.0.0.0:0/2",
>> [ceph-mon1][DEBUG ] "name": "ceph-mon3",
>> [ceph-mon

Re: [ceph-users] ceph-deploy create-initial errors out with "Some monitors have still not reached quorum"

2015-12-31 Thread Wade Holler

I assume you have tested with firewalld disabled ?

Best Regards
Wade
On Thu, Dec 31, 2015 at 9:13 PM Maruthi Seshidhar <
maruthi.seshid...@gmail.com> wrote:

> hi fellow users,
>
> I am setting up a ceph cluster with 3 monitors, 4 osds on CentOS 7.1
>
> Each of the nodes have 2 NICs.
> 10.31.141.0/23 is the public n/w and 192.168.10.0/24 is the cluster n/w.
>
> Completed the "Preflight Checklist"
> .
> But in the "Storage Cluster Quick Start"
> , while doing
> "ceph-deploy create-initial" I see  error "Some monitors have still not
> reached quorum".
>
> [ceph@ceph-mgmt ceph-cluster]$ ceph-deploy --overwrite-conf mon
> create-initial
> [ceph_deploy.conf][DEBUG ] found configuration file at:
> /home/ceph/.cephdeploy.conf
> [ceph_deploy.cli][INFO  ] Invoked (1.5.30): /usr/bin/ceph-deploy
> --overwrite-conf mon create-initial
> [ceph_deploy.cli][INFO  ] ceph-deploy options:
> [ceph_deploy.cli][INFO  ]  username  : None
> [ceph_deploy.cli][INFO  ]  verbose   : False
> [ceph_deploy.cli][INFO  ]  overwrite_conf: True
> [ceph_deploy.cli][INFO  ]  subcommand: create-initial
> [ceph_deploy.cli][INFO  ]  quiet : False
> [ceph_deploy.cli][INFO  ]  cd_conf   :
> 
> [ceph_deploy.cli][INFO  ]  cluster   : ceph
> [ceph_deploy.cli][INFO  ]  func  :  at 0x1fd6e60>
> [ceph_deploy.cli][INFO  ]  ceph_conf : None
> [ceph_deploy.cli][INFO  ]  default_release   : False
> [ceph_deploy.cli][INFO  ]  keyrings  : None
> [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts ceph-mon1
> ceph-mon2 ceph-mon3
> [ceph_deploy.mon][DEBUG ] detecting platform for host ceph-mon1 ...
> [ceph-mon1][DEBUG ] connection detected need for sudo
> [ceph-mon1][DEBUG ] connected to host: ceph-mon1
> [ceph-mon1][DEBUG ] detect platform information from remote host
> [ceph-mon1][DEBUG ] detect machine type
> [ceph-mon1][DEBUG ] find the location of an executable
> [ceph_deploy.mon][INFO  ] distro info: CentOS Linux 7.1.1503 Core
> [ceph-mon1][DEBUG ] determining if provided host has same hostname in
> remote
> [ceph-mon1][DEBUG ] get remote short hostname
> [ceph-mon1][DEBUG ] deploying mon to ceph-mon1
> [ceph-mon1][DEBUG ] get remote short hostname
> [ceph-mon1][DEBUG ] remote hostname: ceph-mon1
> [ceph-mon1][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
> [ceph-mon1][DEBUG ] create the mon path if it does not exist
> [ceph-mon1][DEBUG ] checking for done path:
> /var/lib/ceph/mon/ceph-ceph-mon1/done
> [ceph-mon1][DEBUG ] create a done file to avoid re-doing the mon deployment
> [ceph-mon1][DEBUG ] create the init path if it does not exist
> [ceph-mon1][INFO  ] Running command: sudo systemctl enable ceph.target
> [ceph-mon1][INFO  ] Running command: sudo systemctl enable
> ceph-mon@ceph-mon1
> [ceph-mon1][INFO  ] Running command: sudo systemctl start
> ceph-mon@ceph-mon1
> [ceph-mon1][INFO  ] Running command: sudo ceph --cluster=ceph
> --admin-daemon /var/run/ceph/ceph-mon.ceph-mon1.asok mon_status
> [ceph-mon1][DEBUG ]
> 
> [ceph-mon1][DEBUG ] status for monitor: mon.ceph-mon1
> [ceph-mon1][DEBUG ] {
> [ceph-mon1][DEBUG ]   "election_epoch": 0,
> [ceph-mon1][DEBUG ]   "extra_probe_peers": [
> [ceph-mon1][DEBUG ] "192.168.10.3:6789/0",
> [ceph-mon1][DEBUG ] "192.168.10.4:6789/0",
> [ceph-mon1][DEBUG ] "192.168.10.5:6789/0"
> [ceph-mon1][DEBUG ]   ],
> [ceph-mon1][DEBUG ]   "monmap": {
> [ceph-mon1][DEBUG ] "created": "0.00",
> [ceph-mon1][DEBUG ] "epoch": 0,
> [ceph-mon1][DEBUG ] "fsid": "d6ca9ac6-bfb9-4464-a128-459068637924",
> [ceph-mon1][DEBUG ] "modified": "0.00",
> [ceph-mon1][DEBUG ] "mons": [
> [ceph-mon1][DEBUG ]   {
> [ceph-mon1][DEBUG ] "addr": "10.31.141.76:6789/0",
> [ceph-mon1][DEBUG ] "name": "ceph-mon1",
> [ceph-mon1][DEBUG ] "rank": 0
> [ceph-mon1][DEBUG ]   },
> [ceph-mon1][DEBUG ]   {
> [ceph-mon1][DEBUG ] "addr": "0.0.0.0:0/1",
> [ceph-mon1][DEBUG ] "name": "ceph-mon2",
> [ceph-mon1][DEBUG ] "rank": 1
> [ceph-mon1][DEBUG ]   },
> [ceph-mon1][DEBUG ]   {
> [ceph-mon1][DEBUG ] "addr": "0.0.0.0:0/2",
> [ceph-mon1][DEBUG ] "name": "ceph-mon3",
> [ceph-mon1][DEBUG ] "rank": 2
> [ceph-mon1][DEBUG ]   }
> [ceph-mon1][DEBUG ] ]
> [ceph-mon1][DEBUG ]   },
> [ceph-mon1][DEBUG ]   "name": "ceph-mon1",
> [ceph-mon1][DEBUG ]   "outside_quorum": [
> [ceph-mon1][DEBUG ] "ceph-mon1"
> [ceph-mon1][DEBUG ]   ],
> [ceph-mon1][DEBUG ]   "quorum": [],
> [ceph-mon1][DEBUG ]   "rank": 0,
> [ceph-mon1][DEBUG ]   "state": "probing",
> [ceph-mon1][DEBUG ]   "sync_provider": []
> [cep

Re: [ceph-users] ceph-deploy create-initial errors out with "Some monitors have still not reached quorum"

Re: [ceph-users] ceph-deploy create-initial errors out with "Some monitors have still not reached quorum"

Re: [ceph-users] ceph-deploy create-initial errors out with "Some monitors have still not reached quorum"

Re: [ceph-users] ceph-deploy create-initial errors out with "Some monitors have still not reached quorum"

Re: [ceph-users] ceph-deploy create-initial errors out with "Some monitors have still not reached quorum"

5 matches

Site Navigation

Mail list logo

Footer information