Re: [ceph-users] Ceph deployment

[Fran Barrera]

Hi Oliver,

This is my problem:

I have deployed Ceph AIO with two interfaces 192.168.1.67 and 10.0.0.67 but
at the momento of installation I used 192.168.1.67 and I have an Openstack
installed with two interfaces 192.168.1.65 and 10.0.0.65.

Openstack have the storage in Ceph but is working on 192.168.1.0/24 net and
I need to work in 10.0.0.0/24 net.

If will do a tcpdump on ceph node and launch everything from openstack:

# tcpdump -i eth2 tcp and src host 10.0.0.65
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on eth2, link-type EN10MB (Ethernet), capture size 262144 bytes

Nothing appears and if I do with the other interface you can see it's
working:

# tcpdump -i eth1 tcp and src host 192.168.1.65
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on eth1, link-type EN10MB (Ethernet), capture size 262144 bytes
09:29:56.577198 IP 192.168.1.65.50338 > ceph-node.6800: Flags [P.], seq
3504392283:3504392292, ack 1662624736, win 1444, options [nop,nop,TS val
276566611 ecr 223200], length 9
09:29:56.711320 IP 192.168.1.65.53642 > ceph-node.6808: Flags [P.], seq
2208322028:2208326424, ack 2367465877, win 1444, options [nop,nop,TS val
276566644 ecr 223227], length 4396

This is my ceph.conf:

[global]
...
mon_initial_members = ceph-node
mon_host = 192.168.1.67
public_network = 192.168.1.0/24, 10.0.0.0/24
...

How I can change this for work with 10.0.0.0/24 net?

Thanks,
Fran.

2016-06-22 12:06 GMT+02:00 Oliver Dzombic :

> Hi Fran,
>
> public_network = the network of the clients to access ceph ressources
>
> cluster_network = the network ceph use to keep the osd's sycronizing
> themself
>
> 
>
> So if you want that your ceph cluster is available to public internet
> addresses, you will have to assign IPs from a real public network.
>
> That means not 10.0.0.0 / 192.168.0.0 and so on. But thats a logical
> network design question and has nothing to do with ceph.
>
> Of course you could, via iptables/what ever create rules to
> masquarade/forward public ceph traffic to an internal, private network.
>
> --
> Mit freundlichen Gruessen / Best regards
>
> Oliver Dzombic
> IP-Interactive
>
> mailto:i...@ip-interactive.de
>
> Anschrift:
>
> IP Interactive UG ( haftungsbeschraenkt )
> Zum Sonnenberg 1-3
> 63571 Gelnhausen
>
> HRB 93402 beim Amtsgericht Hanau
> Geschäftsführung: Oliver Dzombic
>
> Steuer Nr.: 35 236 3622 1
> UST ID: DE274086107
>
>
> Am 22.06.2016 um 11:33 schrieb Fran Barrera:
> > Hi all,
> >
> > I have a couple of question about the deployment of Ceph.
> >
> >
> > This is what I plan:
> >
> > Private Net - 10.0.0.0/24 
> > Public Net - 192.168.1.0/24 
> >
> > Ceph server:
> >  - eth1: 192.168.1.67
> >  - eth2: 10.0.0.67
> >
> > Openstack server:
> >  - eth1: 192.168.1.65
> >  - eth2: 10.0.0.65
> >
> >
> >  ceph.conf
> >   - mon_host: 10.0.0.67
> >   - cluster_network - 10.0.0.0/24 
> >   - public_network - 192.168.1.0/24 
> >
> > Now, I have some doubts:
> >  - If I configure Ceph with this configuration. Could I connect with
> > Ceph from a client in the Public Net? I say it this because mon_host is
> > 10.0.0.67 in ceph.conf
> >  - The private NET was created for Openstack, but I think if I can use
> > this net for Ceph cluster network  or if I need to create another one.
> >
> > I want to connect Ceph with Openstack through a private Net and have the
> > possibility to connect with ceph from the public net too.
> >
> >
> > Any suggestions?
> >
> > Thanks,
> > Fran.
> >
> >
> > ___
> > ceph-users mailing list
> > ceph-users@lists.ceph.com
> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> >
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph deployment

[Oliver Dzombic]

Hi Fran,

public_network = the network of the clients to access ceph ressources

cluster_network = the network ceph use to keep the osd's sycronizing
themself



So if you want that your ceph cluster is available to public internet
addresses, you will have to assign IPs from a real public network.

That means not 10.0.0.0 / 192.168.0.0 and so on. But thats a logical
network design question and has nothing to do with ceph.

Of course you could, via iptables/what ever create rules to
masquarade/forward public ceph traffic to an internal, private network.

-- 
Mit freundlichen Gruessen / Best regards

Oliver Dzombic
IP-Interactive

mailto:i...@ip-interactive.de

Anschrift:

IP Interactive UG ( haftungsbeschraenkt )
Zum Sonnenberg 1-3
63571 Gelnhausen

HRB 93402 beim Amtsgericht Hanau
Geschäftsführung: Oliver Dzombic

Steuer Nr.: 35 236 3622 1
UST ID: DE274086107


Am 22.06.2016 um 11:33 schrieb Fran Barrera:
> Hi all,
> 
> I have a couple of question about the deployment of Ceph.
> 
> 
> This is what I plan:
> 
> Private Net - 10.0.0.0/24 
> Public Net - 192.168.1.0/24 
> 
> Ceph server:
>  - eth1: 192.168.1.67
>  - eth2: 10.0.0.67
> 
> Openstack server:
>  - eth1: 192.168.1.65
>  - eth2: 10.0.0.65
>  
> 
>  ceph.conf
>   - mon_host: 10.0.0.67
>   - cluster_network - 10.0.0.0/24 
>   - public_network - 192.168.1.0/24 
> 
> Now, I have some doubts:
>  - If I configure Ceph with this configuration. Could I connect with
> Ceph from a client in the Public Net? I say it this because mon_host is
> 10.0.0.67 in ceph.conf
>  - The private NET was created for Openstack, but I think if I can use
> this net for Ceph cluster network  or if I need to create another one.
>  
> I want to connect Ceph with Openstack through a private Net and have the
> possibility to connect with ceph from the public net too.
> 
> 
> Any suggestions?
> 
> Thanks,
> Fran.
> 
> 
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> 
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Ceph deployment

[Fran Barrera]

Hi all,

I have a couple of question about the deployment of Ceph.


This is what I plan:

Private Net - 10.0.0.0/24
Public Net - 192.168.1.0/24

Ceph server:
 - eth1: 192.168.1.67
 - eth2: 10.0.0.67

Openstack server:
 - eth1: 192.168.1.65
 - eth2: 10.0.0.65


 ceph.conf
  - mon_host: 10.0.0.67
  - cluster_network - 10.0.0.0/24
  - public_network - 192.168.1.0/24

Now, I have some doubts:
 - If I configure Ceph with this configuration. Could I connect with Ceph
from a client in the Public Net? I say it this because mon_host is
10.0.0.67 in ceph.conf
 - The private NET was created for Openstack, but I think if I can use this
net for Ceph cluster network  or if I need to create another one.

I want to connect Ceph with Openstack through a private Net and have the
possibility to connect with ceph from the public net too.


Any suggestions?

Thanks,
Fran.
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Ceph deployment using puppet

[Karan Singh]

Hello Everyone 

Can someone guide me how i can start for  ceph deployment using puppet  , 
what all things i need to have for this . 

I have no prior idea of using puppet , hence need your help to getting started 
with it. 


Regards 
Karan Singh 
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph deployment using puppet

[Loic Dachary]

Hi,

Unless you're force to use puppet for some reason, I suggest you give 
ceph-deploy a try:

http://ceph.com/docs/master/start/quick-ceph-deploy/

Cheers

On 04/11/2013 19:00, Karan Singh wrote:
 Hello Everyone
 
 Can  someone guide me how i can start for  ceph deployment using puppet  , 
 what all things i need to have for this .
 
 I have no prior idea of using puppet , hence need your help to getting 
 started with it.
 
 
 Regards
 Karan Singh
 
 
 ___
 ceph-users mailing list
 ceph-users@lists.ceph.com
 http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 

-- 
Loïc Dachary, Artisan Logiciel Libre



signature.asc
Description: OpenPGP digital signature
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph deployment using puppet

[Karan Singh]

Hello Loic

Thanks for your reply , Ceph-deploy works good to me.

My next objective is to deploy ceph using puppet. Can you guide me now i can 
proceed.

Regards
karan

- Original Message -
From: Loic Dachary l...@dachary.org
To: ceph-users@lists.ceph.com
Sent: Monday, 4 November, 2013 4:45:06 PM
Subject: Re: [ceph-users] Ceph deployment using puppet

Hi,

Unless you're force to use puppet for some reason, I suggest you give 
ceph-deploy a try:

http://ceph.com/docs/master/start/quick-ceph-deploy/

Cheers

On 04/11/2013 19:00, Karan Singh wrote:
 Hello Everyone
 
 Can  someone guide me how i can start for  ceph deployment using puppet  , 
 what all things i need to have for this .
 
 I have no prior idea of using puppet , hence need your help to getting 
 started with it.
 
 
 Regards
 Karan Singh
 
 
 ___
 ceph-users mailing list
 ceph-users@lists.ceph.com
 http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 

-- 
Loïc Dachary, Artisan Logiciel Libre


___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Ceph deployment issue in physical hosts

[Guang]

Hi ceph-users,
I deployed a cluster successfully in VMs, and today I tried to deploy a cluster 
in physical nodes. However, I came across a problem when I started creating a 
monitor.

-bash-4.1$ ceph-deploy mon create x
[ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts 
[ceph_deploy.mon][DEBUG ] detecting platform for host web2 ...
[ceph_deploy.sudo_pushy][DEBUG ] will use a remote connection with sudo
[ceph_deploy.mon][INFO  ] distro info: RedHatEnterpriseServer 6.4 Santiago
[web2][DEBUG ] determining if provided host has same hostname in remote
[web2][DEBUG ] deploying mon to web2
[web2][DEBUG ] remote hostname: web2
[web2][INFO  ] write cluster configuration to /etc/ceph/{cluster}.conf
[web2][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-web2/done
[web2][INFO  ] create a done file to avoid re-doing the mon deployment
[web2][INFO  ] create the init path if it does not exist
[web2][INFO  ] locating `service` executable...
[web2][INFO  ] found `service` executable: /sbin/service
ssh: Could not resolve hostname web2: Name or service not known
Traceback (most recent call last):
  File /usr/bin/ceph-deploy, line 21, in module
sys.exit(main())
  File /usr/lib/python2.6/site-packages/ceph_deploy/util/decorators.py, line 
83, in newfunc
return f(*a, **kw)
  File /usr/lib/python2.6/site-packages/ceph_deploy/cli.py, line 147, in main
return args.func(args)
  File /usr/lib/python2.6/site-packages/ceph_deploy/mon.py, line 246, in mon
mon_create(args)
  File /usr/lib/python2.6/site-packages/ceph_deploy/mon.py, line 105, in 
mon_create
distro.mon.create(distro, rlogger, args, monitor_keyring)
  File 
/usr/lib/python2.6/site-packages/ceph_deploy/hosts/centos/mon/create.py, line 
15, in create
rconn = get_connection(hostname, logger)
  File /usr/lib/python2.6/site-packages/ceph_deploy/connection.py, line 13, 
in get_connection
sudo=needs_sudo(),
  File /usr/lib/python2.6/site-packages/ceph_deploy/lib/remoto/connection.py, 
line 12, in __init__
self.gateway = execnet.makegateway('ssh=%s' % hostname)
  File 
/usr/lib/python2.6/site-packages/ceph_deploy/lib/remoto/lib/execnet/multi.py, 
line 89, in makegateway
gw = gateway_bootstrap.bootstrap(io, spec)
  File 
/usr/lib/python2.6/site-packages/ceph_deploy/lib/remoto/lib/execnet/gateway_bootstrap.py,
 line 70, in bootstrap
bootstrap_ssh(io, spec)
  File 
/usr/lib/python2.6/site-packages/ceph_deploy/lib/remoto/lib/execnet/gateway_bootstrap.py,
 line 42, in bootstrap_ssh
raise HostNotFound(io.remoteaddress)
execnet.gateway_bootstrap.HostNotFound: web2

Does anyone come across the same issue? Looks like I mis-configured the network 
environment?

Thanks,
Guang
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph deployment issue in physical hosts

[Wolfgang Hennerbichler]

On 09/25/2013 10:03 AM, Guang wrote:
 Hi ceph-users,
 I deployed a cluster successfully in VMs, and today I tried to deploy a 
 cluster in physical nodes. However, I came across a problem when I started 
 creating a monitor.
 
 -bash-4.1$ ceph-deploy mon create x

 ssh: Could not resolve hostname web2: Name or service not known
 Does anyone come across the same issue? Looks like I mis-configured the 
 network environment?

The machine you run ceph-deploy on doesn't know who web2 is. If this
command succeeds: ping web2 then ceph deploy will at least be able to
contact that host.

hint: look at your /etc/hosts file.

 Thanks,
 Guang

Wolfgang

 __
 ceph-users mailing list
 ceph-users@lists.ceph.com
 http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 


-- 
DI (FH) Wolfgang Hennerbichler
Software Development
Unit Advanced Computing Technologies
RISC Software GmbH
A company of the Johannes Kepler University Linz

IT-Center
Softwarepark 35
4232 Hagenberg
Austria

Phone: +43 7236 3343 245
Fax: +43 7236 3343 250
wolfgang.hennerbich...@risc-software.at
http://www.risc-software.at
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph deployment issue in physical hosts

[Guang]

Thanks Wolfgang.

-bash-4.1$ ping web2
PING web2 (10.193.244.209) 56(84) bytes of data.
64 bytes from web2 (10.193.244.209): icmp_seq=1 ttl=64 time=0.505 ms
64 bytes from web2 (10.193.244.209): icmp_seq=2 ttl=64 time=0.194 ms
...

[I omit part of the host name].

It can ping to the host and I actually used ceph-deploy to install ceph onto 
the web2 remote host…

Thanks,
Guang


Date: Wed, 25 Sep 2013 10:29:14 +0200
From: Wolfgang Hennerbichler wolfgang.hennerbich...@risc-software.at
To: ceph-users@lists.ceph.com
Subject: Re: [ceph-users] Ceph deployment issue in physical hosts
Message-ID: 52429eda.8070...@risc-software.at
Content-Type: text/plain; charset=ISO-8859-1



On 09/25/2013 10:03 AM, Guang wrote:
 Hi ceph-users,
 I deployed a cluster successfully in VMs, and today I tried to deploy a 
 cluster in physical nodes. However, I came across a problem when I started 
 creating a monitor.
 
 -bash-4.1$ ceph-deploy mon create x

 ssh: Could not resolve hostname web2: Name or service not known
 Does anyone come across the same issue? Looks like I mis-configured the 
 network environment?

The machine you run ceph-deploy on doesn't know who web2 is. If this
command succeeds: ping web2 then ceph deploy will at least be able to
contact that host.

hint: look at your /etc/hosts file.

 Thanks,
 Guang

Wolfgang
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph deployment issue in physical hosts

[Alfredo Deza]

On Wed, Sep 25, 2013 at 5:08 AM, Guang yguan...@yahoo.com wrote:
 Thanks Wolfgang.

 -bash-4.1$ ping web2
 PING web2 (10.193.244.209) 56(84) bytes of data.
 64 bytes from web2 (10.193.244.209): icmp_seq=1 ttl=64 time=0.505 ms
 64 bytes from web2 (10.193.244.209): icmp_seq=2 ttl=64 time=0.194 ms
 ...

 [I omit part of the host name].

 It can ping to the host and I actually used ceph-deploy to install ceph onto
 the web2 remote host…


This is very unexpected, it most definitely sounds like at some point
web2 is not resolvable (as the
error says) but you are also right in that you initiate the deployment
correctly with ceph-deploy doing work
on the remote end.

Are you able to SSH directly to this host from where you are executing
ceph-deploy? (same user/login)



 Thanks,
 Guang


 Date: Wed, 25 Sep 2013 10:29:14 +0200
 From: Wolfgang Hennerbichler wolfgang.hennerbich...@risc-software.at
 To: ceph-users@lists.ceph.com
 Subject: Re: [ceph-users] Ceph deployment issue in physical hosts
 Message-ID: 52429eda.8070...@risc-software.at
 Content-Type: text/plain; charset=ISO-8859-1




 On 09/25/2013 10:03 AM, Guang wrote:

 Hi ceph-users,

 I deployed a cluster successfully in VMs, and today I tried to deploy a
 cluster in physical nodes. However, I came across a problem when I started
 creating a monitor.


 -bash-4.1$ ceph-deploy mon create x

 

 ssh: Could not resolve hostname web2: Name or service not known

 Does anyone come across the same issue? Looks like I mis-configured the
 network environment?


 The machine you run ceph-deploy on doesn't know who web2 is. If this
 command succeeds: ping web2 then ceph deploy will at least be able to
 contact that host.

 hint: look at your /etc/hosts file.

 Thanks,

 Guang


 Wolfgang

 ___
 ceph-users mailing list
 ceph-users@lists.ceph.com
 http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph deployment issue in physical hosts

[Guang]

Thanks for the reply!

I don't know the reason, but I work-around this issue by add a new entry in the 
/etc/hosts with something like 'web2   {id_address_of_web2}' and it can work.

I am not sure if that is due to some mis-config by my end of the deployment 
script, will further investigate.

Thanks all for the help!

Guang

On Sep 25, 2013, at 8:38 PM, Alfredo Deza wrote:

 On Wed, Sep 25, 2013 at 5:08 AM, Guang yguan...@yahoo.com wrote:
 Thanks Wolfgang.
 
 -bash-4.1$ ping web2
 PING web2 (10.193.244.209) 56(84) bytes of data.
 64 bytes from web2 (10.193.244.209): icmp_seq=1 ttl=64 time=0.505 ms
 64 bytes from web2 (10.193.244.209): icmp_seq=2 ttl=64 time=0.194 ms
 ...
 
 [I omit part of the host name].
 
 It can ping to the host and I actually used ceph-deploy to install ceph onto
 the web2 remote host…
 
 
 This is very unexpected, it most definitely sounds like at some point
 web2 is not resolvable (as the
 error says) but you are also right in that you initiate the deployment
 correctly with ceph-deploy doing work
 on the remote end.
 
 Are you able to SSH directly to this host from where you are executing
 ceph-deploy? (same user/login)
 
 
 
 Thanks,
 Guang
 
 
 Date: Wed, 25 Sep 2013 10:29:14 +0200
 From: Wolfgang Hennerbichler wolfgang.hennerbich...@risc-software.at
 To: ceph-users@lists.ceph.com
 Subject: Re: [ceph-users] Ceph deployment issue in physical hosts
 Message-ID: 52429eda.8070...@risc-software.at
 Content-Type: text/plain; charset=ISO-8859-1
 
 
 
 
 On 09/25/2013 10:03 AM, Guang wrote:
 
 Hi ceph-users,
 
 I deployed a cluster successfully in VMs, and today I tried to deploy a
 cluster in physical nodes. However, I came across a problem when I started
 creating a monitor.
 
 
 -bash-4.1$ ceph-deploy mon create x
 
 
 
 ssh: Could not resolve hostname web2: Name or service not known
 
 Does anyone come across the same issue? Looks like I mis-configured the
 network environment?
 
 
 The machine you run ceph-deploy on doesn't know who web2 is. If this
 command succeeds: ping web2 then ceph deploy will at least be able to
 contact that host.
 
 hint: look at your /etc/hosts file.
 
 Thanks,
 
 Guang
 
 
 Wolfgang
 
 ___
 ceph-users mailing list
 ceph-users@lists.ceph.com
 http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com