Re: [ceph-users] Ceph Cluster Address

[Gregory Farnum]

On Tue, Mar 3, 2015 at 9:26 AM, Garg, Pankaj
pankaj.g...@caviumnetworks.com wrote:
 Hi,

 I have ceph cluster that is contained within a rack (1 Monitor and 5 OSD
 nodes). I kept the same public and private address for configuration.

 I do have 2 NICS and 2 valid IP addresses (one internal only and one
 external) for each machine.



 Is it possible now, to change the Public Network address, after the cluster
 is up and running?

 I had used Ceph-deploy for the cluster. If I change the address of the
 public network in Ceph.conf, do I need to propagate to all the machines in
 the cluster or just the Monitor Node is enough?

You'll need to change the config on each node and then restart it so
that the OSDs will bind to the new location. The OSDs will let you do
this on a rolling basis, but the networks will need to be routable to
each other.

Note that changing the addresses on the monitors (I can't tell if you
want to do that) is much more difficult; it's probably easiest to
remove one at a time from the cluster and then recreate it with its
new IP. (There are docs on how to do this.)
-Greg




 Thanks

 Pankaj


 ___
 ceph-users mailing list
 ceph-users@lists.ceph.com
 http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph Cluster Address

[J-P Methot]

I had to go through the same experience of changing the public network 
address and it's not easy.  Ceph seems to keep a record of what ip 
address is associated to what OSD and a port number for the process. I 
was never able to find out where this record is kept or how to change it 
manually. Here's what I did, from memory :


1. Remove the network address I didn't want to use anymore from the 
ceph.conf and put the one I wanted to use instead. Don't worry, 
modifying the ceph.conf will not affect a currently running cluster 
unless you issue a command to it, like adding an OSD.
2. Remove each OSD one by one and then reinitialize them right after. 
You will lose the data that's on the OSD, but if your cluster is 
replicated properly and do this operation one OSD at a time, you should 
not lose the copies of that data.
3. Check the OSD status to make sure they use the proper IP. The command 
ceph osd dump will tell you if your OSDs are detected on the proper IP.

4. Remove and reinstall each monitor one by one.

If anybody else has another solution I'd be curious to hear it, but this 
is how I managed to do it, by basically reinstalling each component one 
by one.


On 3/3/2015 12:26 PM, Garg, Pankaj wrote:


Hi,

I have ceph cluster that is contained within a rack (1 Monitor and 5 
OSD nodes). I kept the same public and private address for configuration.


I do have 2 NICS and 2 valid IP addresses (one internal only and one 
external) for each machine.


Is it possible now, to change the Public Network address, after the 
cluster is up and running?


I had used Ceph-deploy for the cluster. If I change the address of the 
public network in Ceph.conf, do I need to propagate to all the 
machines in the cluster or just the Monitor Node is enough?


Thanks

Pankaj



___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



--
==
Jean-Philippe Méthot
Administrateur système / System administrator
GloboTech Communications
Phone: 1-514-907-0050
Toll Free: 1-(888)-GTCOMM1
Fax: 1-(514)-907-0750
jpmet...@gtcomm.net
http://www.gtcomm.net

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com