Re: [ceph-users] Migrating data from a Ceph clusters to another

[Christian Wuerdig]

According to:
http://lists.ceph.com/pipermail/ceph-users-ceph.com/2016-May/009485.html it
seems not entirely safe to copy an RBD pool this way.

This thread mentions doing a rados ls and the get/put the objects but Greg
mentioned that this may also have issues with snapshots.

Maybe cppool has been fixed but maybe there is no generic way to do this.

On Sat, Feb 11, 2017 at 4:42 AM, Eugen Block  wrote:

> I'm not sure if this is what you need, but I recently tried 'rados cppool
>  ' to populate a new test-pool with different
> properties. I simply needed some data in there, and this command for me.
>
> Regards,
> Eugen
>
> Zitat von 林自均 :
>
> Hi Irek & Craig,
>>
>> Sorry, I misunderstood "RBD mirroring". What I want to do is not like
>> that.
>>
>> I just want to move all the data from a cluster to another. It can be
>> achieved by `rados -p  get  ` for all objects on
>> cluster A, and then `rados -p  put  ` on cluster
>> B.
>> Is there any tool for that?
>>
>> Best,
>> John Lin
>>
>> Craig Chi  於 2017年2月9日 週四 下午4:43寫道：
>>
>> Hi,
>>>
>>> Sorry I gave the wrong feature.
>>> rbd mirroring method can only be used on rbd with "journaling" feature
>>> (not layering).
>>>
>>> Sincerely,
>>> Craig Chi
>>>
>>> On 2017-02-09 16:41, Craig Chi  wrote:
>>>
>>> Hi John,
>>>
>>> rbd mirroring can configured by pool.
>>> http://docs.ceph.com/docs/master/rbd/rbd-mirroring/
>>> However the rbd mirroring method can only be used on rbd with layering
>>> feature, it can not mirror objects other than rbd for you.
>>>
>>> Sincerely,
>>> Craig Chi
>>>
>>> On 2017-02-09 16:24, Irek Fasikhov  wrote:
>>>
>>> Hi.
>>> I recommend using rbd import/export.
>>>
>>> С уважением, Фасихов Ирек Нургаязович
>>> Моб.: +79229045757 <+7%20922%20904-57-57>
>>>
>>> 2017-02-09 11:13 GMT+03:00 林自均 :
>>>
>>> Hi,
>>>
>>> I have 2 Ceph clusters, cluster A and cluster B. I want to move all the
>>> pools on A to B. The pool names don't conflict between clusters. I guess
>>> it's like RBD mirroring, except that it's pool mirroring. Is there any
>>> proper ways to do it?
>>>
>>> Thanks for any suggestions.
>>>
>>> Best,
>>> John Lin
>>>
>>> ___
>>> ceph-users mailing list
>>> ceph-users@lists.ceph.com
>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>
>>> ___ ceph-users mailing list
>>> ceph-users@lists.ceph.com
>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>
>>>
>>>
>
>
> --
> Eugen Block voice   : +49-40-559 51 75
> NDE Netzdesign und -entwicklung AG  fax : +49-40-559 51 77
> Postfach 61 03 15
> D-22423 Hamburg e-mail  : ebl...@nde.ag
>
> Vorsitzende des Aufsichtsrates: Angelika Mozdzen
>   Sitz und Registergericht: Hamburg, HRB 90934
>   Vorstand: Jens-U. Mozdzen
>USt-IdNr. DE 814 013 983
>
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Migrating data from a Ceph clusters to another

[Eugen Block]

I'm not sure if this is what you need, but I recently tried 'rados  
cppool  ' to populate a new test-pool with  
different properties. I simply needed some data in there, and this  
command for me.


Regards,
Eugen

Zitat von 林自均 :


Hi Irek & Craig,

Sorry, I misunderstood "RBD mirroring". What I want to do is not like that.

I just want to move all the data from a cluster to another. It can be
achieved by `rados -p  get  ` for all objects on
cluster A, and then `rados -p  put  ` on cluster B.
Is there any tool for that?

Best,
John Lin

Craig Chi  於 2017年2月9日 週四 下午4:43寫道：


Hi,

Sorry I gave the wrong feature.
rbd mirroring method can only be used on rbd with "journaling" feature
(not layering).

Sincerely,
Craig Chi

On 2017-02-09 16:41, Craig Chi  wrote:

Hi John,

rbd mirroring can configured by pool.
http://docs.ceph.com/docs/master/rbd/rbd-mirroring/
However the rbd mirroring method can only be used on rbd with layering
feature, it can not mirror objects other than rbd for you.

Sincerely,
Craig Chi

On 2017-02-09 16:24, Irek Fasikhov  wrote:

Hi.
I recommend using rbd import/export.

С уважением, Фасихов Ирек Нургаязович
Моб.: +79229045757 <+7%20922%20904-57-57>

2017-02-09 11:13 GMT+03:00 林自均 :

Hi,

I have 2 Ceph clusters, cluster A and cluster B. I want to move all the
pools on A to B. The pool names don't conflict between clusters. I guess
it's like RBD mirroring, except that it's pool mirroring. Is there any
proper ways to do it?

Thanks for any suggestions.

Best,
John Lin

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

___ ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com






--
Eugen Block voice   : +49-40-559 51 75
NDE Netzdesign und -entwicklung AG  fax : +49-40-559 51 77
Postfach 61 03 15
D-22423 Hamburg e-mail  : ebl...@nde.ag

Vorsitzende des Aufsichtsrates: Angelika Mozdzen
  Sitz und Registergericht: Hamburg, HRB 90934
  Vorstand: Jens-U. Mozdzen
   USt-IdNr. DE 814 013 983

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Migrating data from a Ceph clusters to another

[林自均]

Hi Irek & Craig,

Sorry, I misunderstood "RBD mirroring". What I want to do is not like that.

I just want to move all the data from a cluster to another. It can be
achieved by `rados -p  get  ` for all objects on
cluster A, and then `rados -p  put  ` on cluster B.
Is there any tool for that?

Best,
John Lin

Craig Chi  於 2017年2月9日 週四 下午4:43寫道：

> Hi,
>
> Sorry I gave the wrong feature.
> rbd mirroring method can only be used on rbd with "journaling" feature
> (not layering).
>
> Sincerely,
> Craig Chi
>
> On 2017-02-09 16:41, Craig Chi  wrote:
>
> Hi John,
>
> rbd mirroring can configured by pool.
> http://docs.ceph.com/docs/master/rbd/rbd-mirroring/
> However the rbd mirroring method can only be used on rbd with layering
> feature, it can not mirror objects other than rbd for you.
>
> Sincerely,
> Craig Chi
>
> On 2017-02-09 16:24, Irek Fasikhov  wrote:
>
> Hi.
> I recommend using rbd import/export.
>
> С уважением, Фасихов Ирек Нургаязович
> Моб.: +79229045757 <+7%20922%20904-57-57>
>
> 2017-02-09 11:13 GMT+03:00 林自均 :
>
> Hi,
>
> I have 2 Ceph clusters, cluster A and cluster B. I want to move all the
> pools on A to B. The pool names don't conflict between clusters. I guess
> it's like RBD mirroring, except that it's pool mirroring. Is there any
> proper ways to do it?
>
> Thanks for any suggestions.
>
> Best,
> John Lin
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
> ___ ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Migrating data from a Ceph clusters to another

[Craig Chi]

Hi,

Sorry I gave the wrong feature.
rbd mirroring method can only be used on rbd with "journaling" feature (not 
layering).

Sincerely,
Craig Chi

On 2017-02-09 16:41, Craig Chiwrote:
> Hi John,
>   
> rbd mirroring can configured by 
> pool.http://docs.ceph.com/docs/master/rbd/rbd-mirroring/
> However the rbd mirroring method can only be used on rbd with layering 
> feature, it can not mirror objects other than rbd for you.
>   
> Sincerely,
> Craig Chi
>   
> On 2017-02-09 16:24, Irek Fasikhovwrote:
> > Hi.
> > I recommend using rbd import/export.
> >   
> >   
> > С уважением, Фасихов Ирек Нургаязович
> > Моб.: +79229045757
> >   
> >   
> >   
> >   
> > 2017-02-09 11:13 GMT+03:00 
> > 林自均:
> > > Hi,
> > >   
> > > I have 2 Ceph clusters, cluster A and cluster B. I want to move all the 
> > > pools on A to B. The pool names don't conflict between clusters. I guess 
> > > it's like RBD mirroring, except that it's pool mirroring.Is there any 
> > > proper ways to do it?
> > >   
> > > Thanks for any suggestions.
> > >   
> > > Best,
> > > John Lin
> > >   
> > >   
> > > ___
> > > ceph-users mailing list
> > > ceph-users@lists.ceph.com(mailto:ceph-users@lists.ceph.com)
> > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com___
> > >  ceph-users mailing list ceph-users@lists.ceph.com 
> > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Migrating data from a Ceph clusters to another

[Craig Chi]

Hi John,

rbd mirroring can configured by 
pool.http://docs.ceph.com/docs/master/rbd/rbd-mirroring/
However the rbd mirroring method can only be used on rbd with layering feature, 
it can not mirror objects other than rbd for you.

Sincerely,
Craig Chi

On 2017-02-09 16:24, Irek Fasikhovwrote:
> Hi.
> I recommend using rbd import/export.
>   
>   
> С уважением, Фасихов Ирек Нургаязович
> Моб.: +79229045757
>   
>   
>   
>   
> 2017-02-09 11:13 GMT+03:00 林自均:
> > Hi,
> >   
> > I have 2 Ceph clusters, cluster A and cluster B. I want to move all the 
> > pools on A to B. The pool names don't conflict between clusters. I guess 
> > it's like RBD mirroring, except that it's pool mirroring.Is there any 
> > proper ways to do it?
> >   
> > Thanks for any suggestions.
> >   
> > Best,
> > John Lin
> >   
> >   
> > ___
> > ceph-users mailing list
> > ceph-users@lists.ceph.com(mailto:ceph-users@lists.ceph.com)
> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com___
> >  ceph-users mailing list ceph-users@lists.ceph.com 
> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Migrating data from a Ceph clusters to another

[Irek Fasikhov]

Hi.
I recommend using rbd import/export.

С уважением, Фасихов Ирек Нургаязович
Моб.: +79229045757

2017-02-09 11:13 GMT+03:00 林自均 :

> Hi,
>
> I have 2 Ceph clusters, cluster A and cluster B. I want to move all the
> pools on A to B. The pool names don't conflict between clusters. I guess
> it's like RBD mirroring, except that it's pool mirroring. Is there any
> proper ways to do it?
>
> Thanks for any suggestions.
>
> Best,
> John Lin
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com