Re: [ceph-users] Migrating data from a Ceph clusters to another
According to: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2016-May/009485.html it seems not entirely safe to copy an RBD pool this way. This thread mentions doing a rados ls and the get/put the objects but Greg mentioned that this may also have issues with snapshots. Maybe cppool has been fixed but maybe there is no generic way to do this. On Sat, Feb 11, 2017 at 4:42 AM, Eugen Blockwrote: > I'm not sure if this is what you need, but I recently tried 'rados cppool > ' to populate a new test-pool with different > properties. I simply needed some data in there, and this command for me. > > Regards, > Eugen > > Zitat von 林自均 : > > Hi Irek & Craig, >> >> Sorry, I misunderstood "RBD mirroring". What I want to do is not like >> that. >> >> I just want to move all the data from a cluster to another. It can be >> achieved by `rados -p get ` for all objects on >> cluster A, and then `rados -p put ` on cluster >> B. >> Is there any tool for that? >> >> Best, >> John Lin >> >> Craig Chi 於 2017年2月9日 週四 下午4:43寫道: >> >> Hi, >>> >>> Sorry I gave the wrong feature. >>> rbd mirroring method can only be used on rbd with "journaling" feature >>> (not layering). >>> >>> Sincerely, >>> Craig Chi >>> >>> On 2017-02-09 16:41, Craig Chi wrote: >>> >>> Hi John, >>> >>> rbd mirroring can configured by pool. >>> http://docs.ceph.com/docs/master/rbd/rbd-mirroring/ >>> However the rbd mirroring method can only be used on rbd with layering >>> feature, it can not mirror objects other than rbd for you. >>> >>> Sincerely, >>> Craig Chi >>> >>> On 2017-02-09 16:24, Irek Fasikhov wrote: >>> >>> Hi. >>> I recommend using rbd import/export. >>> >>> С уважением, Фасихов Ирек Нургаязович >>> Моб.: +79229045757 <+7%20922%20904-57-57> >>> >>> 2017-02-09 11:13 GMT+03:00 林自均 : >>> >>> Hi, >>> >>> I have 2 Ceph clusters, cluster A and cluster B. I want to move all the >>> pools on A to B. The pool names don't conflict between clusters. I guess >>> it's like RBD mirroring, except that it's pool mirroring. Is there any >>> proper ways to do it? >>> >>> Thanks for any suggestions. >>> >>> Best, >>> John Lin >>> >>> ___ >>> ceph-users mailing list >>> ceph-users@lists.ceph.com >>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>> >>> ___ ceph-users mailing list >>> ceph-users@lists.ceph.com >>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>> >>> >>> > > > -- > Eugen Block voice : +49-40-559 51 75 > NDE Netzdesign und -entwicklung AG fax : +49-40-559 51 77 > Postfach 61 03 15 > D-22423 Hamburg e-mail : ebl...@nde.ag > > Vorsitzende des Aufsichtsrates: Angelika Mozdzen > Sitz und Registergericht: Hamburg, HRB 90934 > Vorstand: Jens-U. Mozdzen >USt-IdNr. DE 814 013 983 > > > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Migrating data from a Ceph clusters to another
I'm not sure if this is what you need, but I recently tried 'rados cppool ' to populate a new test-pool with different properties. I simply needed some data in there, and this command for me. Regards, Eugen Zitat von 林自均: Hi Irek & Craig, Sorry, I misunderstood "RBD mirroring". What I want to do is not like that. I just want to move all the data from a cluster to another. It can be achieved by `rados -p get ` for all objects on cluster A, and then `rados -p put ` on cluster B. Is there any tool for that? Best, John Lin Craig Chi 於 2017年2月9日 週四 下午4:43寫道: Hi, Sorry I gave the wrong feature. rbd mirroring method can only be used on rbd with "journaling" feature (not layering). Sincerely, Craig Chi On 2017-02-09 16:41, Craig Chi wrote: Hi John, rbd mirroring can configured by pool. http://docs.ceph.com/docs/master/rbd/rbd-mirroring/ However the rbd mirroring method can only be used on rbd with layering feature, it can not mirror objects other than rbd for you. Sincerely, Craig Chi On 2017-02-09 16:24, Irek Fasikhov wrote: Hi. I recommend using rbd import/export. С уважением, Фасихов Ирек Нургаязович Моб.: +79229045757 <+7%20922%20904-57-57> 2017-02-09 11:13 GMT+03:00 林自均 : Hi, I have 2 Ceph clusters, cluster A and cluster B. I want to move all the pools on A to B. The pool names don't conflict between clusters. I guess it's like RBD mirroring, except that it's pool mirroring. Is there any proper ways to do it? Thanks for any suggestions. Best, John Lin ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Eugen Block voice : +49-40-559 51 75 NDE Netzdesign und -entwicklung AG fax : +49-40-559 51 77 Postfach 61 03 15 D-22423 Hamburg e-mail : ebl...@nde.ag Vorsitzende des Aufsichtsrates: Angelika Mozdzen Sitz und Registergericht: Hamburg, HRB 90934 Vorstand: Jens-U. Mozdzen USt-IdNr. DE 814 013 983 ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Migrating data from a Ceph clusters to another
Hi Irek & Craig, Sorry, I misunderstood "RBD mirroring". What I want to do is not like that. I just want to move all the data from a cluster to another. It can be achieved by `rados -p get ` for all objects on cluster A, and then `rados -p put ` on cluster B. Is there any tool for that? Best, John Lin Craig Chi於 2017年2月9日 週四 下午4:43寫道: > Hi, > > Sorry I gave the wrong feature. > rbd mirroring method can only be used on rbd with "journaling" feature > (not layering). > > Sincerely, > Craig Chi > > On 2017-02-09 16:41, Craig Chi wrote: > > Hi John, > > rbd mirroring can configured by pool. > http://docs.ceph.com/docs/master/rbd/rbd-mirroring/ > However the rbd mirroring method can only be used on rbd with layering > feature, it can not mirror objects other than rbd for you. > > Sincerely, > Craig Chi > > On 2017-02-09 16:24, Irek Fasikhov wrote: > > Hi. > I recommend using rbd import/export. > > С уважением, Фасихов Ирек Нургаязович > Моб.: +79229045757 <+7%20922%20904-57-57> > > 2017-02-09 11:13 GMT+03:00 林自均 : > > Hi, > > I have 2 Ceph clusters, cluster A and cluster B. I want to move all the > pools on A to B. The pool names don't conflict between clusters. I guess > it's like RBD mirroring, except that it's pool mirroring. Is there any > proper ways to do it? > > Thanks for any suggestions. > > Best, > John Lin > > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > ___ ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Migrating data from a Ceph clusters to another
Hi, Sorry I gave the wrong feature. rbd mirroring method can only be used on rbd with "journaling" feature (not layering). Sincerely, Craig Chi On 2017-02-09 16:41, Craig Chiwrote: > Hi John, > > rbd mirroring can configured by > pool.http://docs.ceph.com/docs/master/rbd/rbd-mirroring/ > However the rbd mirroring method can only be used on rbd with layering > feature, it can not mirror objects other than rbd for you. > > Sincerely, > Craig Chi > > On 2017-02-09 16:24, Irek Fasikhov wrote: > > Hi. > > I recommend using rbd import/export. > > > > > > С уважением, Фасихов Ирек Нургаязович > > Моб.: +79229045757 > > > > > > > > > > 2017-02-09 11:13 GMT+03:00 > > 林自均 : > > > Hi, > > > > > > I have 2 Ceph clusters, cluster A and cluster B. I want to move all the > > > pools on A to B. The pool names don't conflict between clusters. I guess > > > it's like RBD mirroring, except that it's pool mirroring.Is there any > > > proper ways to do it? > > > > > > Thanks for any suggestions. > > > > > > Best, > > > John Lin > > > > > > > > > ___ > > > ceph-users mailing list > > > ceph-users@lists.ceph.com(mailto:ceph-users@lists.ceph.com) > > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com___ > > > ceph-users mailing list ceph-users@lists.ceph.com > > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Migrating data from a Ceph clusters to another
Hi John, rbd mirroring can configured by pool.http://docs.ceph.com/docs/master/rbd/rbd-mirroring/ However the rbd mirroring method can only be used on rbd with layering feature, it can not mirror objects other than rbd for you. Sincerely, Craig Chi On 2017-02-09 16:24, Irek Fasikhovwrote: > Hi. > I recommend using rbd import/export. > > > С уважением, Фасихов Ирек Нургаязович > Моб.: +79229045757 > > > > > 2017-02-09 11:13 GMT+03:00 林自均 : > > Hi, > > > > I have 2 Ceph clusters, cluster A and cluster B. I want to move all the > > pools on A to B. The pool names don't conflict between clusters. I guess > > it's like RBD mirroring, except that it's pool mirroring.Is there any > > proper ways to do it? > > > > Thanks for any suggestions. > > > > Best, > > John Lin > > > > > > ___ > > ceph-users mailing list > > ceph-users@lists.ceph.com(mailto:ceph-users@lists.ceph.com) > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com___ > > ceph-users mailing list ceph-users@lists.ceph.com > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Migrating data from a Ceph clusters to another
Hi. I recommend using rbd import/export. С уважением, Фасихов Ирек Нургаязович Моб.: +79229045757 2017-02-09 11:13 GMT+03:00 林自均: > Hi, > > I have 2 Ceph clusters, cluster A and cluster B. I want to move all the > pools on A to B. The pool names don't conflict between clusters. I guess > it's like RBD mirroring, except that it's pool mirroring. Is there any > proper ways to do it? > > Thanks for any suggestions. > > Best, > John Lin > > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com