Re: [PVE-User] pve-csync version of pve-zsync?

[Fabrizio Cuseo]

Hi.
There is some news regarding two-cluster replication ? I would like to use it 
in a DR scenario, with the big cluster that can have some VMs replicated on a 
small one (but different, and possibly in a different datacenter).

Something included in the proxmox gui will be really great and add a lot of 
value to proxmox itself.

Regards, Fabrizio Cuseo


- Il 13-mar-18, alle 19:32, Alexandre DERUMIER aderum...@odiso.com ha 
scritto:

> Hi,
> 
> I have plans to implement storage replication for rbd in proxmox,
> like for zfs export|import.  (with rbd export-diff |rbd import-diff )
> 
> I'll try to work on it next month.
> 
> I'm not sure that currently a plugin infrastructe in done in code,
> and that it's able to manage storages with differents name.
> 
> Can't tell if it'll be hard to implement, but the workflow is almost the same.
> 
> I'll try to look also at rbd mirror, but it's only work with librbd in qemu, 
> not
> with krbd,
> so it can't be implemented for container.
> 
> 
> - Mail original -
> De: "Mark Adams" 
> À: "proxmoxve" 
> Envoyé: Mardi 13 Mars 2018 18:52:21
> Objet: Re: [PVE-User] pve-csync version of pve-zsync?
> 
> Hi Alwin,
> 
> I might have to take another look at it, but have you actually done this
> with 2 proxmox clusters? I can't remember the exact part I got stuck on as
> it was quite a while ago, but it wasn't as straight forward as you suggest.
> I think you couldn't use the same cluster name, which in turn created
> issues trying to use the "remote" (backup/dr/whatever you wanna call it)
> cluster with proxmox because it needed to be called ceph.
> 
> The docs I was referring to were the ceph ones yes. Some of the options
> listed in that doc do not work in the current proxmox version (I think the
> doc hasn't been updated for newer versions...)
> 
> Regards,
> Mark
> 
> On 13 March 2018 at 17:19, Alwin Antreich  wrote:
> 
>> On Mon, Mar 12, 2018 at 04:51:32PM +, Mark Adams wrote:
>> > Hi Alwin,
>> > 
>> > The last I looked at it, rbd mirror only worked if you had different
>> > cluster names. Tried to get it working with proxmox but to no avail,
>> > without really messing with how proxmox uses ceph I'm not sure it's
>> > feasible, as proxmox assumes the default cluster name for everything...
>> That isn't mentioned anywhere in the ceph docs, they use for ease of
>> explaining two different cluster names.
>> 
>> If you have a config file named after the cluster, then you can specifiy
>> it on the command line.
>> http://docs.ceph.com/docs/master/rados/configuration/
>> ceph-conf/#running-multiple-clusters
>> 
>> > 
>> > Also the documentation was a bit poor for it IMO.
>> Which documentation do you mean?
>> ? -> http://docs.ceph.com/docs/master/rbd/rbd-mirroring/
>> 
>> > 
>> > Would also be nice to choose specifically which VM's you want to be
>> > mirroring, rather than the whole cluster.
>> It is done either per pool or image separately. See the link above.
>> 
>> > 
>> > I've manually done rbd export-diff and rbd import-diff between 2 separate
>> > proxmox clusters over ssh, and it seems to work really well... It would
>> > just be nice to have a tool like pve-zsync so I don't have to write some
>> > script myself. Seems to me like something that would be desirable as part
>> > of proxmox as well?
>> That would basically implement the ceph rbd mirror feature.
>> 
>> > 
>> > Cheers,
>> > Mark
>> > 
>> > On 12 March 2018 at 16:37, Alwin Antreich 
>> wrote:
>> > 
>> > > Hi Mark,
>> > > 
>> > > On Mon, Mar 12, 2018 at 03:49:42PM +, Mark Adams wrote:
>> > > > Hi All,
>> > > > 
>> > > > Has anyone looked at or thought of making a version of pve-zsync for
>> > > ceph?
>> > > > 
>> > > > This would be great for DR scenarios...
>> > > > 
>> > > > How easy do you think this would be to do? I imagine it wouId it be
>> quite
>> > > > similar to pve-zsync, but using rbd export-diff and rbd import-diff
>> > > instead
>> > > > of zfs send and zfs receive? so could the existing script be
>> relatively
>> > > > easily modified? (I know nothing about perl)
>> > > > 
>> > > > Cheers,
>> > > > Mark
>> > > > ___
>> > > > pve-user mailing list
>> > > &

Re: [PVE-User] pve-csync version of pve-zsync?

[Alexandre DERUMIER]

>>Could you please elaborate more on how you have implemented ceph 
>>replication using proxmox?

As I said, I didn't replicate it with proxmox or proxmox code currently.

only custom scripts calling ceph api directly.

I need to dig a little bit more in current proxmox zfs replication, 
because it' mainly focus on local storage replication.
so it's a little it different with a shared storage (vm live migration, ha 
failover,...)


- Mail original -
De: "Mark Adams" <m...@openvs.co.uk>
À: "proxmoxve" <pve-user@pve.proxmox.com>
Envoyé: Jeudi 17 Mai 2018 17:36:43
Objet: Re: [PVE-User] pve-csync version of pve-zsync?

Hi Alexander, 

Could you please elaborate more on how you have implemented ceph 
replication using proxmox? 

Thanks, 
Mark 


On Thu, 17 May 2018, 15:26 Alexandre DERUMIER, <aderum...@odiso.com> wrote: 

> Hi, 
> 
> I'm currently a lot busy working on network code. 
> 
> for now, we have implemented ceph replication out of proxmox code, I'll 
> try to work on it this summer. 
> 
> 
> - Mail original - 
> De: "Mark Adams" <m...@openvs.co.uk> 
> À: "proxmoxve" <pve-user@pve.proxmox.com> 
> Envoyé: Mardi 15 Mai 2018 00:13:03 
> Objet: Re: [PVE-User] pve-csync version of pve-zsync? 
> 
> Hi Alexandre, 
> 
> Did you ever get a chance to take a look at this? 
> 
> Regards, 
> Mark 
> 
> On 13 March 2018 at 18:32, Alexandre DERUMIER <aderum...@odiso.com> 
> wrote: 
> 
> > Hi, 
> > 
> > I have plans to implement storage replication for rbd in proxmox, 
> > like for zfs export|import. (with rbd export-diff |rbd import-diff ) 
> > 
> > I'll try to work on it next month. 
> > 
> > I'm not sure that currently a plugin infrastructe in done in code, 
> > and that it's able to manage storages with differents name. 
> > 
> > Can't tell if it'll be hard to implement, but the workflow is almost the 
> > same. 
> > 
> > I'll try to look also at rbd mirror, but it's only work with librbd in 
> > qemu, not with krbd, 
> > so it can't be implemented for container. 
> > 
> > 
> > - Mail original - 
> > De: "Mark Adams" <m...@openvs.co.uk> 
> > À: "proxmoxve" <pve-user@pve.proxmox.com> 
> > Envoyé: Mardi 13 Mars 2018 18:52:21 
> > Objet: Re: [PVE-User] pve-csync version of pve-zsync? 
> > 
> > Hi Alwin, 
> > 
> > I might have to take another look at it, but have you actually done this 
> > with 2 proxmox clusters? I can't remember the exact part I got stuck on 
> as 
> > it was quite a while ago, but it wasn't as straight forward as you 
> > suggest. 
> > I think you couldn't use the same cluster name, which in turn created 
> > issues trying to use the "remote" (backup/dr/whatever you wanna call it) 
> > cluster with proxmox because it needed to be called ceph. 
> > 
> > The docs I was referring to were the ceph ones yes. Some of the options 
> > listed in that doc do not work in the current proxmox version (I think 
> the 
> > doc hasn't been updated for newer versions...) 
> > 
> > Regards, 
> > Mark 
> > 
> > On 13 March 2018 at 17:19, Alwin Antreich <a.antre...@proxmox.com> 
> wrote: 
> > 
> > > On Mon, Mar 12, 2018 at 04:51:32PM +, Mark Adams wrote: 
> > > > Hi Alwin, 
> > > > 
> > > > The last I looked at it, rbd mirror only worked if you had different 
> > > > cluster names. Tried to get it working with proxmox but to no avail, 
> > > > without really messing with how proxmox uses ceph I'm not sure it's 
> > > > feasible, as proxmox assumes the default cluster name for 
> > everything... 
> > > That isn't mentioned anywhere in the ceph docs, they use for ease of 
> > > explaining two different cluster names. 
> > > 
> > > If you have a config file named after the cluster, then you can 
> specifiy 
> > > it on the command line. 
> > > http://docs.ceph.com/docs/master/rados/configuration/ 
> > > ceph-conf/#running-multiple-clusters 
> > > 
> > > > 
> > > > Also the documentation was a bit poor for it IMO. 
> > > Which documentation do you mean? 
> > > ? -> http://docs.ceph.com/docs/master/rbd/rbd-mirroring/ 
> > > 
> > > > 
> > > > Would also be nice to choose specifically which VM's you want to be 
> > > > mirroring, rather than the whole cluster. 
> > > It is done either per pool or image separately. See the link above. 
> > > 
> > > > 
&

Re: [PVE-User] pve-csync version of pve-zsync?

[Mark Adams]

Hi Alexander,

Could you please elaborate more on how you have implemented ceph
replication using proxmox?

Thanks,
Mark


On Thu, 17 May 2018, 15:26 Alexandre DERUMIER, <aderum...@odiso.com> wrote:

> Hi,
>
> I'm currently a lot busy working on network code.
>
> for now, we have implemented ceph replication out of proxmox code, I'll
> try to work on it this summer.
>
>
> - Mail original -
> De: "Mark Adams" <m...@openvs.co.uk>
> À: "proxmoxve" <pve-user@pve.proxmox.com>
> Envoyé: Mardi 15 Mai 2018 00:13:03
> Objet: Re: [PVE-User] pve-csync version of pve-zsync?
>
> Hi Alexandre,
>
> Did you ever get a chance to take a look at this?
>
> Regards,
> Mark
>
> On 13 March 2018 at 18:32, Alexandre DERUMIER <aderum...@odiso.com>
> wrote:
>
> > Hi,
> >
> > I have plans to implement storage replication for rbd in proxmox,
> > like for zfs export|import. (with rbd export-diff |rbd import-diff )
> >
> > I'll try to work on it next month.
> >
> > I'm not sure that currently a plugin infrastructe in done in code,
> > and that it's able to manage storages with differents name.
> >
> > Can't tell if it'll be hard to implement, but the workflow is almost the
> > same.
> >
> > I'll try to look also at rbd mirror, but it's only work with librbd in
> > qemu, not with krbd,
> > so it can't be implemented for container.
> >
> >
> > - Mail original -
> > De: "Mark Adams" <m...@openvs.co.uk>
> > À: "proxmoxve" <pve-user@pve.proxmox.com>
> > Envoyé: Mardi 13 Mars 2018 18:52:21
> > Objet: Re: [PVE-User] pve-csync version of pve-zsync?
> >
> > Hi Alwin,
> >
> > I might have to take another look at it, but have you actually done this
> > with 2 proxmox clusters? I can't remember the exact part I got stuck on
> as
> > it was quite a while ago, but it wasn't as straight forward as you
> > suggest.
> > I think you couldn't use the same cluster name, which in turn created
> > issues trying to use the "remote" (backup/dr/whatever you wanna call it)
> > cluster with proxmox because it needed to be called ceph.
> >
> > The docs I was referring to were the ceph ones yes. Some of the options
> > listed in that doc do not work in the current proxmox version (I think
> the
> > doc hasn't been updated for newer versions...)
> >
> > Regards,
> > Mark
> >
> > On 13 March 2018 at 17:19, Alwin Antreich <a.antre...@proxmox.com>
> wrote:
> >
> > > On Mon, Mar 12, 2018 at 04:51:32PM +, Mark Adams wrote:
> > > > Hi Alwin,
> > > >
> > > > The last I looked at it, rbd mirror only worked if you had different
> > > > cluster names. Tried to get it working with proxmox but to no avail,
> > > > without really messing with how proxmox uses ceph I'm not sure it's
> > > > feasible, as proxmox assumes the default cluster name for
> > everything...
> > > That isn't mentioned anywhere in the ceph docs, they use for ease of
> > > explaining two different cluster names.
> > >
> > > If you have a config file named after the cluster, then you can
> specifiy
> > > it on the command line.
> > > http://docs.ceph.com/docs/master/rados/configuration/
> > > ceph-conf/#running-multiple-clusters
> > >
> > > >
> > > > Also the documentation was a bit poor for it IMO.
> > > Which documentation do you mean?
> > > ? -> http://docs.ceph.com/docs/master/rbd/rbd-mirroring/
> > >
> > > >
> > > > Would also be nice to choose specifically which VM's you want to be
> > > > mirroring, rather than the whole cluster.
> > > It is done either per pool or image separately. See the link above.
> > >
> > > >
> > > > I've manually done rbd export-diff and rbd import-diff between 2
> > separate
> > > > proxmox clusters over ssh, and it seems to work really well... It
> > would
> > > > just be nice to have a tool like pve-zsync so I don't have to write
> > some
> > > > script myself. Seems to me like something that would be desirable as
> > part
> > > > of proxmox as well?
> > > That would basically implement the ceph rbd mirror feature.
> > >
> > > >
> > > > Cheers,
> > > > Mark
> > > >
> > > > On 12 March 2018 at 16:37, Alwin Antreich <a.antre...@proxmox.com>
> > > wrote:
> > > >
>

Re: [PVE-User] pve-csync version of pve-zsync?

[Alexandre DERUMIER]

Hi,

I'm currently a lot busy working on network code.

for now, we have implemented ceph replication out of proxmox code, I'll try to 
work on it this summer.


- Mail original -
De: "Mark Adams" <m...@openvs.co.uk>
À: "proxmoxve" <pve-user@pve.proxmox.com>
Envoyé: Mardi 15 Mai 2018 00:13:03
Objet: Re: [PVE-User] pve-csync version of pve-zsync?

Hi Alexandre, 

Did you ever get a chance to take a look at this? 

Regards, 
Mark 

On 13 March 2018 at 18:32, Alexandre DERUMIER <aderum...@odiso.com> wrote: 

> Hi, 
> 
> I have plans to implement storage replication for rbd in proxmox, 
> like for zfs export|import. (with rbd export-diff |rbd import-diff ) 
> 
> I'll try to work on it next month. 
> 
> I'm not sure that currently a plugin infrastructe in done in code, 
> and that it's able to manage storages with differents name. 
> 
> Can't tell if it'll be hard to implement, but the workflow is almost the 
> same. 
> 
> I'll try to look also at rbd mirror, but it's only work with librbd in 
> qemu, not with krbd, 
> so it can't be implemented for container. 
> 
> 
> - Mail original - 
> De: "Mark Adams" <m...@openvs.co.uk> 
> À: "proxmoxve" <pve-user@pve.proxmox.com> 
> Envoyé: Mardi 13 Mars 2018 18:52:21 
> Objet: Re: [PVE-User] pve-csync version of pve-zsync? 
> 
> Hi Alwin, 
> 
> I might have to take another look at it, but have you actually done this 
> with 2 proxmox clusters? I can't remember the exact part I got stuck on as 
> it was quite a while ago, but it wasn't as straight forward as you 
> suggest. 
> I think you couldn't use the same cluster name, which in turn created 
> issues trying to use the "remote" (backup/dr/whatever you wanna call it) 
> cluster with proxmox because it needed to be called ceph. 
> 
> The docs I was referring to were the ceph ones yes. Some of the options 
> listed in that doc do not work in the current proxmox version (I think the 
> doc hasn't been updated for newer versions...) 
> 
> Regards, 
> Mark 
> 
> On 13 March 2018 at 17:19, Alwin Antreich <a.antre...@proxmox.com> wrote: 
> 
> > On Mon, Mar 12, 2018 at 04:51:32PM +, Mark Adams wrote: 
> > > Hi Alwin, 
> > > 
> > > The last I looked at it, rbd mirror only worked if you had different 
> > > cluster names. Tried to get it working with proxmox but to no avail, 
> > > without really messing with how proxmox uses ceph I'm not sure it's 
> > > feasible, as proxmox assumes the default cluster name for 
> everything... 
> > That isn't mentioned anywhere in the ceph docs, they use for ease of 
> > explaining two different cluster names. 
> > 
> > If you have a config file named after the cluster, then you can specifiy 
> > it on the command line. 
> > http://docs.ceph.com/docs/master/rados/configuration/ 
> > ceph-conf/#running-multiple-clusters 
> > 
> > > 
> > > Also the documentation was a bit poor for it IMO. 
> > Which documentation do you mean? 
> > ? -> http://docs.ceph.com/docs/master/rbd/rbd-mirroring/ 
> > 
> > > 
> > > Would also be nice to choose specifically which VM's you want to be 
> > > mirroring, rather than the whole cluster. 
> > It is done either per pool or image separately. See the link above. 
> > 
> > > 
> > > I've manually done rbd export-diff and rbd import-diff between 2 
> separate 
> > > proxmox clusters over ssh, and it seems to work really well... It 
> would 
> > > just be nice to have a tool like pve-zsync so I don't have to write 
> some 
> > > script myself. Seems to me like something that would be desirable as 
> part 
> > > of proxmox as well? 
> > That would basically implement the ceph rbd mirror feature. 
> > 
> > > 
> > > Cheers, 
> > > Mark 
> > > 
> > > On 12 March 2018 at 16:37, Alwin Antreich <a.antre...@proxmox.com> 
> > wrote: 
> > > 
> > > > Hi Mark, 
> > > > 
> > > > On Mon, Mar 12, 2018 at 03:49:42PM +, Mark Adams wrote: 
> > > > > Hi All, 
> > > > > 
> > > > > Has anyone looked at or thought of making a version of pve-zsync 
> for 
> > > > ceph? 
> > > > > 
> > > > > This would be great for DR scenarios... 
> > > > > 
> > > > > How easy do you think this would be to do? I imagine it wouId it 
> be 
> > quite 
> > > > > similar to pve-zsync, but using rbd export-diff and rbd 
> import-diff 
> > > > instead 
>

Re: [PVE-User] pve-csync version of pve-zsync?

[Mark Adams]

Hi Alexandre,

Did you ever get a chance to take a look at this?

Regards,
Mark

On 13 March 2018 at 18:32, Alexandre DERUMIER <aderum...@odiso.com> wrote:

> Hi,
>
> I have plans to implement storage replication for rbd in proxmox,
> like for zfs export|import.  (with rbd export-diff |rbd import-diff )
>
> I'll try to work on it next month.
>
> I'm not sure that currently a plugin infrastructe in done in code,
> and that it's able to manage storages with differents name.
>
> Can't tell if it'll be hard to implement, but the workflow is almost the
> same.
>
> I'll try to look also at rbd mirror, but it's only work with librbd in
> qemu, not with krbd,
> so it can't be implemented for container.
>
>
> - Mail original -
> De: "Mark Adams" <m...@openvs.co.uk>
> À: "proxmoxve" <pve-user@pve.proxmox.com>
> Envoyé: Mardi 13 Mars 2018 18:52:21
> Objet: Re: [PVE-User] pve-csync version of pve-zsync?
>
> Hi Alwin,
>
> I might have to take another look at it, but have you actually done this
> with 2 proxmox clusters? I can't remember the exact part I got stuck on as
> it was quite a while ago, but it wasn't as straight forward as you
> suggest.
> I think you couldn't use the same cluster name, which in turn created
> issues trying to use the "remote" (backup/dr/whatever you wanna call it)
> cluster with proxmox because it needed to be called ceph.
>
> The docs I was referring to were the ceph ones yes. Some of the options
> listed in that doc do not work in the current proxmox version (I think the
> doc hasn't been updated for newer versions...)
>
> Regards,
> Mark
>
> On 13 March 2018 at 17:19, Alwin Antreich <a.antre...@proxmox.com> wrote:
>
> > On Mon, Mar 12, 2018 at 04:51:32PM +, Mark Adams wrote:
> > > Hi Alwin,
> > >
> > > The last I looked at it, rbd mirror only worked if you had different
> > > cluster names. Tried to get it working with proxmox but to no avail,
> > > without really messing with how proxmox uses ceph I'm not sure it's
> > > feasible, as proxmox assumes the default cluster name for
> everything...
> > That isn't mentioned anywhere in the ceph docs, they use for ease of
> > explaining two different cluster names.
> >
> > If you have a config file named after the cluster, then you can specifiy
> > it on the command line.
> > http://docs.ceph.com/docs/master/rados/configuration/
> > ceph-conf/#running-multiple-clusters
> >
> > >
> > > Also the documentation was a bit poor for it IMO.
> > Which documentation do you mean?
> > ? -> http://docs.ceph.com/docs/master/rbd/rbd-mirroring/
> >
> > >
> > > Would also be nice to choose specifically which VM's you want to be
> > > mirroring, rather than the whole cluster.
> > It is done either per pool or image separately. See the link above.
> >
> > >
> > > I've manually done rbd export-diff and rbd import-diff between 2
> separate
> > > proxmox clusters over ssh, and it seems to work really well... It
> would
> > > just be nice to have a tool like pve-zsync so I don't have to write
> some
> > > script myself. Seems to me like something that would be desirable as
> part
> > > of proxmox as well?
> > That would basically implement the ceph rbd mirror feature.
> >
> > >
> > > Cheers,
> > > Mark
> > >
> > > On 12 March 2018 at 16:37, Alwin Antreich <a.antre...@proxmox.com>
> > wrote:
> > >
> > > > Hi Mark,
> > > >
> > > > On Mon, Mar 12, 2018 at 03:49:42PM +, Mark Adams wrote:
> > > > > Hi All,
> > > > >
> > > > > Has anyone looked at or thought of making a version of pve-zsync
> for
> > > > ceph?
> > > > >
> > > > > This would be great for DR scenarios...
> > > > >
> > > > > How easy do you think this would be to do? I imagine it wouId it
> be
> > quite
> > > > > similar to pve-zsync, but using rbd export-diff and rbd
> import-diff
> > > > instead
> > > > > of zfs send and zfs receive? so could the existing script be
> > relatively
> > > > > easily modified? (I know nothing about perl)
> > > > >
> > > > > Cheers,
> > > > > Mark
> > > > > ___
> > > > > pve-user mailing list
> > > > > pve-user@pve.proxmox.com
> > > > > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
> > > > Isn't ceph mirror already what you want? It can mirror a image or a
> > > > whole pool. It keeps track of changes and serves remote image
> deletes
> > > > (adjustable delay).
> > > >
> >
> > ___
> > pve-user mailing list
> > pve-user@pve.proxmox.com
> > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
> >
>
___
pve-user mailing list
pve-user@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user

Re: [PVE-User] pve-csync version of pve-zsync?

[Alexandre DERUMIER]

Hi,

I have plans to implement storage replication for rbd in proxmox,
like for zfs export|import.  (with rbd export-diff |rbd import-diff )

I'll try to work on it next month.

I'm not sure that currently a plugin infrastructe in done in code,
and that it's able to manage storages with differents name.

Can't tell if it'll be hard to implement, but the workflow is almost the same.

I'll try to look also at rbd mirror, but it's only work with librbd in qemu, 
not with krbd,
so it can't be implemented for container.


- Mail original -
De: "Mark Adams" <m...@openvs.co.uk>
À: "proxmoxve" <pve-user@pve.proxmox.com>
Envoyé: Mardi 13 Mars 2018 18:52:21
Objet: Re: [PVE-User] pve-csync version of pve-zsync?

Hi Alwin, 

I might have to take another look at it, but have you actually done this 
with 2 proxmox clusters? I can't remember the exact part I got stuck on as 
it was quite a while ago, but it wasn't as straight forward as you suggest. 
I think you couldn't use the same cluster name, which in turn created 
issues trying to use the "remote" (backup/dr/whatever you wanna call it) 
cluster with proxmox because it needed to be called ceph. 

The docs I was referring to were the ceph ones yes. Some of the options 
listed in that doc do not work in the current proxmox version (I think the 
doc hasn't been updated for newer versions...) 

Regards, 
Mark 

On 13 March 2018 at 17:19, Alwin Antreich <a.antre...@proxmox.com> wrote: 

> On Mon, Mar 12, 2018 at 04:51:32PM +, Mark Adams wrote: 
> > Hi Alwin, 
> > 
> > The last I looked at it, rbd mirror only worked if you had different 
> > cluster names. Tried to get it working with proxmox but to no avail, 
> > without really messing with how proxmox uses ceph I'm not sure it's 
> > feasible, as proxmox assumes the default cluster name for everything... 
> That isn't mentioned anywhere in the ceph docs, they use for ease of 
> explaining two different cluster names. 
> 
> If you have a config file named after the cluster, then you can specifiy 
> it on the command line. 
> http://docs.ceph.com/docs/master/rados/configuration/ 
> ceph-conf/#running-multiple-clusters 
> 
> > 
> > Also the documentation was a bit poor for it IMO. 
> Which documentation do you mean? 
> ? -> http://docs.ceph.com/docs/master/rbd/rbd-mirroring/ 
> 
> > 
> > Would also be nice to choose specifically which VM's you want to be 
> > mirroring, rather than the whole cluster. 
> It is done either per pool or image separately. See the link above. 
> 
> > 
> > I've manually done rbd export-diff and rbd import-diff between 2 separate 
> > proxmox clusters over ssh, and it seems to work really well... It would 
> > just be nice to have a tool like pve-zsync so I don't have to write some 
> > script myself. Seems to me like something that would be desirable as part 
> > of proxmox as well? 
> That would basically implement the ceph rbd mirror feature. 
> 
> > 
> > Cheers, 
> > Mark 
> > 
> > On 12 March 2018 at 16:37, Alwin Antreich <a.antre...@proxmox.com> 
> wrote: 
> > 
> > > Hi Mark, 
> > > 
> > > On Mon, Mar 12, 2018 at 03:49:42PM +, Mark Adams wrote: 
> > > > Hi All, 
> > > > 
> > > > Has anyone looked at or thought of making a version of pve-zsync for 
> > > ceph? 
> > > > 
> > > > This would be great for DR scenarios... 
> > > > 
> > > > How easy do you think this would be to do? I imagine it wouId it be 
> quite 
> > > > similar to pve-zsync, but using rbd export-diff and rbd import-diff 
> > > instead 
> > > > of zfs send and zfs receive? so could the existing script be 
> relatively 
> > > > easily modified? (I know nothing about perl) 
> > > > 
> > > > Cheers, 
> > > > Mark 
> > > > ___ 
> > > > pve-user mailing list 
> > > > pve-user@pve.proxmox.com 
> > > > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user 
> > > Isn't ceph mirror already what you want? It can mirror a image or a 
> > > whole pool. It keeps track of changes and serves remote image deletes 
> > > (adjustable delay). 
> > > 
> 
> ___ 
> pve-user mailing list 
> pve-user@pve.proxmox.com 
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user 
> 
___ 
pve-user mailing list 
pve-user@pve.proxmox.com 
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user 

___
pve-user mailing list
pve-user@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user

Re: [PVE-User] pve-csync version of pve-zsync?

[Mark Adams]

Hi Alwin,

I might have to take another look at it, but have you actually done this
with 2 proxmox clusters? I can't remember the exact part I got stuck on as
it was quite a while ago, but it wasn't as straight forward as you suggest.
I think you couldn't use the same cluster name, which in turn created
issues trying to use the "remote" (backup/dr/whatever you wanna call it)
cluster with proxmox because it needed to be called ceph.

The docs I was referring to were the ceph ones yes. Some of the options
listed in that doc do not work in the current proxmox version (I think the
doc hasn't been updated for newer versions...)

Regards,
Mark

On 13 March 2018 at 17:19, Alwin Antreich  wrote:

> On Mon, Mar 12, 2018 at 04:51:32PM +, Mark Adams wrote:
> > Hi Alwin,
> >
> > The last I looked at it, rbd mirror only worked if you had different
> > cluster names. Tried to get it working with proxmox but to no avail,
> > without really messing with how proxmox uses ceph I'm not sure it's
> > feasible, as proxmox assumes the default cluster name for everything...
> That isn't mentioned anywhere in the ceph docs, they use for ease of
> explaining two different cluster names.
>
> If you have a config file named after the cluster, then you can specifiy
> it on the command line.
> http://docs.ceph.com/docs/master/rados/configuration/
> ceph-conf/#running-multiple-clusters
>
> >
> > Also the documentation was a bit poor for it IMO.
> Which documentation do you mean?
> ? -> http://docs.ceph.com/docs/master/rbd/rbd-mirroring/
>
> >
> > Would also be nice to choose specifically which VM's you want to be
> > mirroring, rather than the whole cluster.
> It is done either per pool or image separately. See the link above.
>
> >
> > I've manually done rbd export-diff and rbd import-diff between 2 separate
> > proxmox clusters over ssh, and it seems to work really well... It would
> > just be nice to have a tool like pve-zsync so I don't have to write some
> > script myself. Seems to me like something that would be desirable as part
> > of proxmox as well?
> That would basically implement the ceph rbd mirror feature.
>
> >
> > Cheers,
> > Mark
> >
> > On 12 March 2018 at 16:37, Alwin Antreich 
> wrote:
> >
> > > Hi Mark,
> > >
> > > On Mon, Mar 12, 2018 at 03:49:42PM +, Mark Adams wrote:
> > > > Hi All,
> > > >
> > > > Has anyone looked at or thought of making a version of pve-zsync for
> > > ceph?
> > > >
> > > > This would be great for DR scenarios...
> > > >
> > > > How easy do you think this would be to do? I imagine it wouId it be
> quite
> > > > similar to pve-zsync, but using rbd export-diff and rbd import-diff
> > > instead
> > > > of zfs send and zfs receive? so could the existing script be
> relatively
> > > > easily modified? (I know nothing about perl)
> > > >
> > > > Cheers,
> > > > Mark
> > > > ___
> > > > pve-user mailing list
> > > > pve-user@pve.proxmox.com
> > > > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
> > > Isn't ceph mirror already what you want? It can mirror a image or a
> > > whole pool. It keeps track of changes and serves remote image deletes
> > > (adjustable delay).
> > >
>
> ___
> pve-user mailing list
> pve-user@pve.proxmox.com
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>
___
pve-user mailing list
pve-user@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user

Re: [PVE-User] pve-csync version of pve-zsync?

[Alwin Antreich]

On Mon, Mar 12, 2018 at 04:51:32PM +, Mark Adams wrote:
> Hi Alwin,
>
> The last I looked at it, rbd mirror only worked if you had different
> cluster names. Tried to get it working with proxmox but to no avail,
> without really messing with how proxmox uses ceph I'm not sure it's
> feasible, as proxmox assumes the default cluster name for everything...
That isn't mentioned anywhere in the ceph docs, they use for ease of
explaining two different cluster names.

If you have a config file named after the cluster, then you can specifiy
it on the command line.
http://docs.ceph.com/docs/master/rados/configuration/ceph-conf/#running-multiple-clusters

>
> Also the documentation was a bit poor for it IMO.
Which documentation do you mean?
? -> http://docs.ceph.com/docs/master/rbd/rbd-mirroring/

>
> Would also be nice to choose specifically which VM's you want to be
> mirroring, rather than the whole cluster.
It is done either per pool or image separately. See the link above.

>
> I've manually done rbd export-diff and rbd import-diff between 2 separate
> proxmox clusters over ssh, and it seems to work really well... It would
> just be nice to have a tool like pve-zsync so I don't have to write some
> script myself. Seems to me like something that would be desirable as part
> of proxmox as well?
That would basically implement the ceph rbd mirror feature.

>
> Cheers,
> Mark
>
> On 12 March 2018 at 16:37, Alwin Antreich  wrote:
>
> > Hi Mark,
> >
> > On Mon, Mar 12, 2018 at 03:49:42PM +, Mark Adams wrote:
> > > Hi All,
> > >
> > > Has anyone looked at or thought of making a version of pve-zsync for
> > ceph?
> > >
> > > This would be great for DR scenarios...
> > >
> > > How easy do you think this would be to do? I imagine it wouId it be quite
> > > similar to pve-zsync, but using rbd export-diff and rbd import-diff
> > instead
> > > of zfs send and zfs receive? so could the existing script be relatively
> > > easily modified? (I know nothing about perl)
> > >
> > > Cheers,
> > > Mark
> > > ___
> > > pve-user mailing list
> > > pve-user@pve.proxmox.com
> > > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
> > Isn't ceph mirror already what you want? It can mirror a image or a
> > whole pool. It keeps track of changes and serves remote image deletes
> > (adjustable delay).
> >

___
pve-user mailing list
pve-user@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user

Re: [PVE-User] pve-csync version of pve-zsync?

[Mark Adams]

Hi Alwin,

The last I looked at it, rbd mirror only worked if you had different
cluster names. Tried to get it working with proxmox but to no avail,
without really messing with how proxmox uses ceph I'm not sure it's
feasible, as proxmox assumes the default cluster name for everything...

Also the documentation was a bit poor for it IMO.

Would also be nice to choose specifically which VM's you want to be
mirroring, rather than the whole cluster.

I've manually done rbd export-diff and rbd import-diff between 2 separate
proxmox clusters over ssh, and it seems to work really well... It would
just be nice to have a tool like pve-zsync so I don't have to write some
script myself. Seems to me like something that would be desirable as part
of proxmox as well?

Cheers,
Mark

On 12 March 2018 at 16:37, Alwin Antreich  wrote:

> Hi Mark,
>
> On Mon, Mar 12, 2018 at 03:49:42PM +, Mark Adams wrote:
> > Hi All,
> >
> > Has anyone looked at or thought of making a version of pve-zsync for
> ceph?
> >
> > This would be great for DR scenarios...
> >
> > How easy do you think this would be to do? I imagine it wouId it be quite
> > similar to pve-zsync, but using rbd export-diff and rbd import-diff
> instead
> > of zfs send and zfs receive? so could the existing script be relatively
> > easily modified? (I know nothing about perl)
> >
> > Cheers,
> > Mark
> > ___
> > pve-user mailing list
> > pve-user@pve.proxmox.com
> > https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
> Isn't ceph mirror already what you want? It can mirror a image or a
> whole pool. It keeps track of changes and serves remote image deletes
> (adjustable delay).
>
>
> --
> Cheers,
> Alwin
>
> ___
> pve-user mailing list
> pve-user@pve.proxmox.com
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
___
pve-user mailing list
pve-user@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user

Re: [PVE-User] pve-csync version of pve-zsync?

[Alwin Antreich]

Hi Mark,

On Mon, Mar 12, 2018 at 03:49:42PM +, Mark Adams wrote:
> Hi All,
>
> Has anyone looked at or thought of making a version of pve-zsync for ceph?
>
> This would be great for DR scenarios...
>
> How easy do you think this would be to do? I imagine it wouId it be quite
> similar to pve-zsync, but using rbd export-diff and rbd import-diff instead
> of zfs send and zfs receive? so could the existing script be relatively
> easily modified? (I know nothing about perl)
>
> Cheers,
> Mark
> ___
> pve-user mailing list
> pve-user@pve.proxmox.com
> https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
Isn't ceph mirror already what you want? It can mirror a image or a
whole pool. It keeps track of changes and serves remote image deletes
(adjustable delay).


--
Cheers,
Alwin

___
pve-user mailing list
pve-user@pve.proxmox.com
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user