Re: [gentoo-user] Backup program that compresses data but only changes new files.

Am Mon, 15 Aug 2022 12:43:19 +0100 schrieb Michael : > Even if compression delivers some small space saving, given Dale's new > faster Internet link and local video storage tendencies, compression > will only kick the can down the road. If these are not private or rare > videos and remain

Re: [gentoo-user] Backup program that compresses data but only changes new files.

J. Roeleveld wrote: > On Monday, August 15, 2022 9:07:41 PM CEST Dale wrote: >> J. Roeleveld wrote: >>> On Monday, August 15, 2022 12:44:11 AM CEST Dale wrote: Howdy, With my new fiber internet, my poor disks are getting a work out, and also filling up. First casualty, my

Re: [gentoo-user] Backup program that compresses data but only changes new files.

Mark Knecht wrote: > > > On Mon, Aug 15, 2022 at 1:17 PM Dale > wrote: > > > > Mark Knecht wrote: > > > > > > > As it is, I have several options.  In a way, I wish I could tell > > > rsync to do 1st half of alphabet to one drive and then with next > > > command tell

Re: [gentoo-user] Backup program that compresses data but only changes new files.

Laurence Perkins wrote: > >> -Original Message- >> From: Rich Freeman >> Sent: Monday, August 15, 2022 12:52 PM >> To: gentoo-user@lists.gentoo.org >> Subject: Re: [gentoo-user] Backup program that compresses data but only >> changes new files. >> >> On Mon, Aug 15, 2022 at 3:41 PM Dale

RE: [gentoo-user] Backup program that compresses data but only changes new files.

>-Original Message- >From: Rich Freeman >Sent: Monday, August 15, 2022 12:52 PM >To: gentoo-user@lists.gentoo.org >Subject: Re: [gentoo-user] Backup program that compresses data but only >changes new files. > >On Mon, Aug 15, 2022 at 3:41 PM Dale wrote: >> >> Glad to know what I

RE: [gentoo-user] Backup program that compresses data but only changes new files.

>-Original Message- >From: Dale >Sent: Monday, August 15, 2022 12:47 PM >To: gentoo-user@lists.gentoo.org >Subject: Re: [gentoo-user] Backup program that compresses data but only >changes new files. > >Wol wrote: >> On 15/08/2022 10:45, John Covici wrote: >>> zfs would solve your

Re: [gentoo-user] Backup program that compresses data but only changes new files.

Rich Freeman wrote: > On Mon, Aug 15, 2022 at 3:41 PM Dale wrote: >> Glad to know what I found was good info. I just wonder how long it will >> be before even 10TB drives will be SMR. I also dread having to search >> out a 14TB drive later. :/ >> > I think it will be a long time if ever, and

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On Mon, Aug 15, 2022 at 1:17 PM Dale wrote: > > Mark Knecht wrote: > > > > > As it is, I have several options. In a way, I wish I could tell > > rsync to do 1st half of alphabet to one drive and then with next > > command tell it to do the 2nd half of alphabet. That would likely > > split the

Re: [gentoo-user] Backup program that compresses data but only changes new files.

Mark Knecht wrote: > > > As it is, I have several options.  In a way, I wish I could tell > rsync to do 1st half of alphabet to one drive and then with next > command tell it to do the 2nd half of alphabet.  That would likely > split the data in half for each one.   > > You can do that, at least

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On Mon, Aug 15, 2022 at 3:41 PM Dale wrote: > > Glad to know what I found was good info. I just wonder how long it will > be before even 10TB drives will be SMR. I also dread having to search > out a 14TB drive later. :/ > I think it will be a long time if ever, and here is why. There are

Re: [gentoo-user] Backup program that compresses data but only changes new files.

> As it is, I have several options. In a way, I wish I could tell rsync to do 1st half of alphabet to one drive and then with next command tell it to do the 2nd half of alphabet. That would likely split the data in half for each one. You can do that, at least with a small kludge I'm sure. rsync

Re: [gentoo-user] Backup program that compresses data but only changes new files.

Wol wrote: > On 15/08/2022 10:45, John Covici wrote: >> zfs would solve your problem of corruption, even without versioning. >> You do a scrub at short intervals and at least you would know if the >> file is corrupted.  Of course, redundancy is better, such as mirroring >> and backups take a very

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On Mon, Aug 15, 2022 at 3:28 PM Dale wrote: > > Given my weird way of doing backups, rsync may be the best option. > Plus, easier to restore from as well since it just requires a copy > command, any of them will do. > If you don't make small changes inside of large files, you might actually be

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On Mon, Aug 15, 2022 at 3:20 PM J. Roeleveld wrote: > > Actually, you can with the "-p / --pause" option. > Also, as per the man-page, if you forget this, the process will simply inform > you the target location is full and you can move slices away to a different > location: > " > If the

Re: [gentoo-user] Backup program that compresses data but only changes new files.

Wol wrote: > On 15/08/2022 08:52, Dale wrote: >> I just hope this 10TB drive isn't a SMR.  I googled around and the best >> I could find is anything above 8TB is CMR.  It's a WD101EDBZ-11B1DA0.  I >> hope that is right.  I'm not totally opposed to SMR even as a backup but >> I'd rather not.  The

Re: [gentoo-user] Backup program that compresses data but only changes new files.

Michael wrote: > On Monday, 15 August 2022 11:58:14 BST Gerrit Kühn wrote: >> Am Mon, 15 Aug 2022 12:50:37 +0200 >> >> schrieb Gerrit Kühn : >>> Being a happy restic user myself, I'd like to mention that compression is >>> available meanwhile >>>

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On Monday, August 15, 2022 9:07:41 PM CEST Dale wrote: > J. Roeleveld wrote: > > On Monday, August 15, 2022 12:44:11 AM CEST Dale wrote: > >> Howdy, > >> > >> With my new fiber internet, my poor disks are getting a work out, and > >> also filling up. First casualty, my backup disk. I have one

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On Monday, August 15, 2022 8:56:30 PM CEST Rich Freeman wrote: > On Mon, Aug 15, 2022 at 2:34 PM J. Roeleveld wrote: > > Actually, there still is a piece of software that does this: > > " app-backup/dar " > > You can tell it to split the backups into slices of a specific size. > > dar is a great

Re: [gentoo-user] Backup program that compresses data but only changes new files.

Mark Knecht wrote: > > > On Sun, Aug 14, 2022 at 4:21 PM Dale > wrote: > > > > Mark Knecht wrote: > > > > > > > > > > > Do you happen to have an old computer laying around? If so check > > out TrueNAS Core. > > > That may be a option later.  I'm actually considering

Re: [gentoo-user] Backup program that compresses data but only changes new files.

J. Roeleveld wrote: > On Monday, August 15, 2022 12:44:11 AM CEST Dale wrote: >> Howdy, >> >> With my new fiber internet, my poor disks are getting a work out, and >> also filling up. First casualty, my backup disk. I have one directory >> that is . . . well . . . huge. It's about 7TBs or so.

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On Mon, Aug 15, 2022 at 2:34 PM J. Roeleveld wrote: > > Actually, there still is a piece of software that does this: > " app-backup/dar " > You can tell it to split the backups into slices of a specific size. dar is a great tool, but unless something changed I don't think you can tell it to

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On Mon, Aug 15, 2022 at 2:32 PM Wol wrote: > > On 15/08/2022 11:11, Rich Freeman wrote: > > I see lots of talk of NAS and zfs/btrfs and snapshots. IMO these are > > NOT really great solutions for backup. NAS can work of course but it > > is overkill for backup storage. > > Do you want multiple

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On Monday, August 15, 2022 9:52:26 AM CEST Dale wrote: > Julien Roy wrote: > > Hello, > > > > On 8/14/22 18:44, Dale wrote: > >> Thoughts? Ideas? > > > > You might be interested in borgbackup [1] > > It takes delta backups and has de-duplication and compression to save > > some space. It

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On 15/08/2022 08:52, Dale wrote: I just hope this 10TB drive isn't a SMR.  I googled around and the best I could find is anything above 8TB is CMR.  It's a WD101EDBZ-11B1DA0.  I hope that is right.  I'm not totally opposed to SMR even as a backup but I'd rather not.  The deal I found was for a

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On Monday, August 15, 2022 12:11:34 PM CEST Rich Freeman wrote: > The main issue I think you're going to have is having support for > multi-volume backups if you need to be able to split a backup across > drives. The only thing I've found on Linux that does this is bacula, > and it is a royal

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On Monday, August 15, 2022 9:05:24 AM CEST Dale wrote: > Rich Freeman wrote: > > On Sun, Aug 14, 2022 at 6:44 PM Dale wrote: > >> Right now, I'm using rsync which doesn't compress files but does just > >> update things that have changed. I'd like to find some way, software > >> but maybe there

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On 15/08/2022 11:11, Rich Freeman wrote: I see lots of talk of NAS and zfs/btrfs and snapshots. IMO these are NOT really great solutions for backup. NAS can work of course but it is overkill for backup storage. Do you want multiple *independent* backups, or do you want *incremental* backups

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On 15/08/2022 10:45, John Covici wrote: zfs would solve your problem of corruption, even without versioning. You do a scrub at short intervals and at least you would know if the file is corrupted. Of course, redundancy is better, such as mirroring and backups take a very short time because

RE: [gentoo-user] Backup program that compresses data but only changes new files.

>> > > >Duplicity sounds interesting except that I already have the drive encrypted. >Keep in mind, these are external drives that I hook up long enough to complete >the backups then back in a fire safe they go. The reason I mentioned being >like rsync, I don't want to rebuild a backup from

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On Sun, Aug 14, 2022 at 4:21 PM Dale wrote: > > Mark Knecht wrote: > > > > On Sun, Aug 14, 2022 at 3:44 PM Dale wrote: > > > > > > > Thoughts? Ideas? > > > > Dale > > > > :-) :-) > > Do you happen to have an old computer laying around? If so check > out TrueNAS Core. > That may be a option

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On Sun, 2022-08-14 at 21:42 -0400, Julien Roy wrote: > Hello, > > On 8/14/22 18:44, Dale wrote: > > Thoughts?  Ideas? > > You might be interested in borgbackup [1] > It takes delta backups and has de-duplication and compression to save > some space. It supports encryption too. > It's packaged

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On Monday, 15 August 2022 11:58:14 BST Gerrit Kühn wrote: > Am Mon, 15 Aug 2022 12:50:37 +0200 > > schrieb Gerrit Kühn : > > Being a happy restic user myself, I'd like to mention that compression is > > available meanwhile > >

Re: [gentoo-user] Backup program that compresses data but only changes new files.

Am Mon, 15 Aug 2022 12:50:37 +0200 schrieb Gerrit Kühn : > Being a happy restic user myself, I'd like to mention that compression is > available meanwhile > (https://restic.readthedocs.io/en/latest/047_tuning_backup_parameters.html#compression). > However, the feature is rather new, I did not use

Re: [gentoo-user] Backup program that compresses data but only changes new files.

Am Mon, 15 Aug 2022 03:02:19 -0400 schrieb John Covici : > I have been using restic for a while, and although it does not do > compression, there are a couple of nice things it does Being a happy restic user myself, I'd like to mention that compression is available meanwhile

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On Mon, Aug 15, 2022 at 3:05 AM Dale wrote: > > Rich Freeman wrote: > > > > Duplicity uses librsync, so it backs up exactly the same data as rsync > > would, except instead of replicating entire files, it creates streams > > of data more like something like tar. So if you back up a million > >

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On Mon, 15 Aug 2022 04:33:44 -0400, Dale wrote: > > William Kenworthy wrote: > > > > On 15/8/22 06:44, Dale wrote: > >> Howdy, > >> > >> With my new fiber internet, my poor disks are getting a work out, and > >> also filling up.  First casualty, my backup disk.  I have one directory > >> that is

[gentoo-user] Re: Layman adding git over ssh only repository

On 2022-08-15, Alexander Puchmayr wrote: > Hi there, > > I tried to add a repository which is only reachable via git over ssh; no > access via git port (9418 according to /etc/services) or http(s). Only ssh > connections with public key are accepted. > > I tried > Layman -o

Re: [gentoo-user] Backup program that compresses data but only changes new files.

William Kenworthy wrote: > > On 15/8/22 06:44, Dale wrote: >> Howdy, >> >> With my new fiber internet, my poor disks are getting a work out, and >> also filling up.  First casualty, my backup disk.  I have one directory >> that is . . . well . . . huge.  It's about 7TBs or so.  This is where it >>

Re: [gentoo-user] Backup program that compresses data but only changes new files.

Julien Roy wrote: > Hello, > > On 8/14/22 18:44, Dale wrote: >> Thoughts?  Ideas? > > You might be interested in borgbackup [1] > It takes delta backups and has de-duplication and compression to save > some space. It supports encryption too. > It's packaged in ::gentoo and you run it on whatever

[gentoo-user] Layman adding git over ssh only repository

Hi there, I tried to add a repository which is only reachable via git over ssh; no access via git port (9418 according to /etc/services) or http(s). Only ssh connections with public key are accepted. I tried Layman -o ssh://git@myserver/path/to/repo.git -f -a myrepo, but failed with "invalid

Re: [gentoo-user] Backup program that compresses data but only changes new files.

Rich Freeman wrote: > On Sun, Aug 14, 2022 at 6:44 PM Dale wrote: >> Right now, I'm using rsync which doesn't compress files but does just >> update things that have changed. I'd like to find some way, software >> but maybe there is already a tool I'm unaware of, to compress data and >> work a

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On Sun, 14 Aug 2022 19:03:25 -0400, Rich Freeman wrote: > > On Sun, Aug 14, 2022 at 6:44 PM Dale wrote: > > > > Right now, I'm using rsync which doesn't compress files but does just > > update things that have changed. I'd like to find some way, software > > but maybe there is already a tool

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On Monday, August 15, 2022 12:44:11 AM CEST Dale wrote: > Howdy, > > With my new fiber internet, my poor disks are getting a work out, and > also filling up. First casualty, my backup disk. I have one directory > that is . . . well . . . huge. It's about 7TBs or so. This is where it > is

Re: [gentoo-user] Backup program that compresses data but only changes new files.

On 15/8/22 06:44, Dale wrote: Howdy, With my new fiber internet, my poor disks are getting a work out, and also filling up.  First casualty, my backup disk.  I have one directory that is . . . well . . . huge.  It's about 7TBs or so.  This is where it is right now and it's still trying to