Re: [gentoo-user] How to synchronise between 2 locations
On Wed 27 Mar 2024 20:37:27 GMT, Frank Steinmetzger wrote: > +1 for Unison. I’ve been using it for many years now to synchronise between > the four PC systems in my household. > > Unison creates a local index of all files it syncronised. So when you move a > file around on one end, Unison will notice that because the file at the new > location has the same hash as the file at the old location. As a result, it > does not transmit the file anew to the remote host, but instead copies it > locally on the remote host. > > Since Unison uses ssh underneath, you can use ssh’s transparent compression > to speed up the transfer. I’ve been thinking about using it to synchronise dovecot maildir folders, since dsync is now deprecated. But I’m not sure about it as I never used it under “heavy” loads. Do you have any thoughts about it? -- Alarig
Re: [gentoo-user] How to synchronise between 2 locations
Am Wed, Mar 27, 2024 at 03:59:18PM -0400 schrieb Matt Connell: > > Syncthing is also a good idea. The major difference: syncthing is a > > permanently running daemon, so changes are synced very fast (the > > interval is configurable, IIRC). OTOH, Unison is run individually by > > you. That’s why I prefer the latter: in case I broke some file on my > > machine, I can get it back from another machine without having to > > break out the backup disk (which may not even have what I need > > because my backup interval is too big). > > Good point. I mainly use syncthing as a "stuff I need on multiple > machines" bucket, rather than a big directory of active working files. I sync most of my files on the home and media partition. So all my documents, photos and music library. I do use syncthing -- between my android phone and PC. Because I don’t like to fiddle with the filesystem on the very constrained UI of touch devices. -- Grüße | Greetings | Salut | Qapla’ Please do not share anything from, with or about me on any social network. Can you give me a cigarette? Mine are still in the vending machine. signature.asc Description: PGP signature
Re: [gentoo-user] How to synchronise between 2 locations
On 2024-03-27 20:54+0100 Frank Steinmetzger wrote: > Am Wed, Mar 27, 2024 at 03:42:07PM -0400 schrieb Matt Connell: > > On Wed, 2024-03-27 at 19:58 +0100, J. Roeleveld wrote: > > > Hi all, > > > > > > I am looking for a way to synchronise a filesystem between 2 > > > servers. Changes can occur on both sides which means I need to > > > have it synchronise in both directions. > > > > > > Does anyone have any thoughts on this? > > > > > > Also, both servers are connected using a slow VPN link, which is > > > why I can't simply access files on the remote server. > > > > I've been using syncthing for years and am extremely pleased with > > it. It works so well that I sometimes forget that its there, truly > > in the It Just Works category of software. > > Syncthing is also a good idea. The major difference: syncthing is a > permanently running daemon, so changes are synced very fast (the > interval is configurable, IIRC). OTOH, Unison is run individually by > you. That’s why I prefer the latter: in case I broke some file on my > machine, I can get it back from another machine without having to > break out the backup disk (which may not even have what I need > because my backup interval is too big). syncthing has inbuilt backups if you enable it
Re: [gentoo-user] How to synchronise between 2 locations
On Wed, 2024-03-27 at 20:54 +0100, Frank Steinmetzger wrote: > Am Wed, Mar 27, 2024 at 03:42:07PM -0400 schrieb Matt Connell: > > On Wed, 2024-03-27 at 19:58 +0100, J. Roeleveld wrote: > > > Hi all, > > > > > > I am looking for a way to synchronise a filesystem between 2 > > > servers. Changes can occur on both sides which means I need to > > > have it synchronise in both directions. > > > > > > Does anyone have any thoughts on this? > > > > > > Also, both servers are connected using a slow VPN link, which is > > > why I can't simply access files on the remote server. > > > > I've been using syncthing for years and am extremely pleased with > > it. It works so well that I sometimes forget that its there, truly > > in the It Just Works category of software. > > Syncthing is also a good idea. The major difference: syncthing is a > permanently running daemon, so changes are synced very fast (the > interval is configurable, IIRC). OTOH, Unison is run individually by > you. That’s why I prefer the latter: in case I broke some file on my > machine, I can get it back from another machine without having to > break out the backup disk (which may not even have what I need > because my backup interval is too big). Good point. I mainly use syncthing as a "stuff I need on multiple machines" bucket, rather than a big directory of active working files. Think more along the lines of "I saved this PDF on my PC but I'll need it on my phone tomorrow so it goes into the Special Folder" kind of use case. As such it might not be the right fit for "synchronise a file system" use case.
Re: [gentoo-user] How to synchronise between 2 locations
Am Wed, Mar 27, 2024 at 03:42:07PM -0400 schrieb Matt Connell: > On Wed, 2024-03-27 at 19:58 +0100, J. Roeleveld wrote: > > Hi all, > > > > I am looking for a way to synchronise a filesystem between 2 servers. > > Changes can occur on both sides which means I need to have it > > synchronise in both directions. > > > > Does anyone have any thoughts on this? > > > > Also, both servers are connected using a slow VPN link, which is why > > I can't simply access files on the remote server. > > I've been using syncthing for years and am extremely pleased with it. > It works so well that I sometimes forget that its there, truly in the > It Just Works category of software. Syncthing is also a good idea. The major difference: syncthing is a permanently running daemon, so changes are synced very fast (the interval is configurable, IIRC). OTOH, Unison is run individually by you. That’s why I prefer the latter: in case I broke some file on my machine, I can get it back from another machine without having to break out the backup disk (which may not even have what I need because my backup interval is too big). -- Grüße | Greetings | Salut | Qapla’ Please do not share anything from, with or about me on any social network. I have seen things you lusers would not believe. I've seen Sun monitors on fire off the side of the multimedia lab. I've seen NTU lights glitter in the dark near the Mail Gate. All these things will be lost in time, like the root partition last week. Time to die. signature.asc Description: PGP signature
Re: [gentoo-user] How to synchronise between 2 locations
On Wed, 2024-03-27 at 19:58 +0100, J. Roeleveld wrote: > Hi all, > > I am looking for a way to synchronise a filesystem between 2 servers. > Changes can occur on both sides which means I need to have it > synchronise in both directions. > > Does anyone have any thoughts on this? > > Also, both servers are connected using a slow VPN link, which is why > I can't simply access files on the remote server. I've been using syncthing for years and am extremely pleased with it. It works so well that I sometimes forget that its there, truly in the It Just Works category of software.
Re: [gentoo-user] How to synchronise between 2 locations
Am Wed, Mar 27, 2024 at 08:18:14PM +0100 schrieb ralfconn: > Il 27/03/24 19:58, J. Roeleveld ha scritto: > > Hi all, > > > > I am looking for a way to synchronise a filesystem between 2 servers. > > Changes > > can occur on both sides which means I need to have it synchronise in both > > directions. > > > > Does anyone have any thoughts on this? > > > > Also, both servers are connected using a slow VPN link, which is why I can't > > simply access files on the remote server. +1 for Unison. I’ve been using it for many years now to synchronise between the four PC systems in my household. > I use it just for that but can't say anything about the VPN bit, my > servers are on local network. Unison creates a local index of all files it syncronised. So when you move a file around on one end, Unison will notice that because the file at the new location has the same hash as the file at the old location. As a result, it does not transmit the file anew to the remote host, but instead copies it locally on the remote host. Since Unison uses ssh underneath, you can use ssh’s transparent compression to speed up the transfer. -- Grüße | Greetings | Salut | Qapla’ Please do not share anything from, with or about me on any social network. If all people were the same, one would basically suffice. signature.asc Description: PGP signature
Re: [gentoo-user] How to synchronise between 2 locations
Il 27/03/24 19:58, J. Roeleveld ha scritto: Hi all, I am looking for a way to synchronise a filesystem between 2 servers. Changes can occur on both sides which means I need to have it synchronise in both directions. Does anyone have any thoughts on this? Also, both servers are connected using a slow VPN link, which is why I can't simply access files on the remote server. -- Joost Unison. I use it just for that but can't say anything about the VPN bit, my servers are on local network. raffaele
Re: [gentoo-user] How to synchronise between 2 locations
On Wed, Mar 27, 2024 at 11:59 AM J. Roeleveld wrote: > > Hi all, > > I am looking for a way to synchronise a filesystem between 2 servers. Changes > can occur on both sides which means I need to have it synchronise in both > directions. > > Does anyone have any thoughts on this? > > Also, both servers are connected using a slow VPN link, which is why I can't > simply access files on the remote server. > > -- > Joost > > How synchronized? For instance, does it need to handle identicals where a file is on both sides but has been moved? - Mark
[gentoo-user] How to synchronise between 2 locations
Hi all, I am looking for a way to synchronise a filesystem between 2 servers. Changes can occur on both sides which means I need to have it synchronise in both directions. Does anyone have any thoughts on this? Also, both servers are connected using a slow VPN link, which is why I can't simply access files on the remote server. -- Joost
