Re: [BackupPC-users] Interrupted rsyncd backups on Backuppc4 and rsyncTMP.XXXX files, these files never get cleaned out.

2017-02-01 Thread Mike Dresser
Now that I've poked this again, even a network error such as the client 
went away while backup was in progress will leave behind these files.  A 
really unstable client could leave a lot of orphan rsyncTmp's.

Mike


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Problems using the wiki script

2017-02-01 Thread Kent Tenney
On Tue, Jan 31, 2017 at 1:14 AM, Johan Ehnberg  wrote:

> On 01/30/2017 04:58 PM, Kent Tenney wrote:
> > The error msg has changed with current version:
> > commit edbd1a4613e0125ed65372738abff935230db075
> >
> > when the script executes 'makeDist ...'
> >
> > Unexpected Conf var RefCntFsck in bin/BackupPC_refCountUpdate
> > Exiting because of errors
> >
> > (also added to issue 45)
> >
>
> Looks like there is a lot of development going on, this is good. V4 is
> still not finished after all, so I guess these transitional issues are
> to be expected.
>

I must admit I'm confused regarding versions: is trunk:master v3 or v4?


> Best regards,
> Johan
>
> 
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Compression benchmark

2017-02-01 Thread Les Mikesell
On Wed, Feb 1, 2017 at 2:53 AM, Jan Stransky
 wrote:
>
> 3) Full backup of each dataset as separate host, then second with
> already filled pool. Preferably from SSD to SSD to not be IO limited.
>

In practice if you use the --checksum-seed option with rsync the
timing of the 3rd full is the one that matters although it isn't a
good benchmark test because it will depend on the amount the target
changes.   The 2nd time an unchanged file is backed up the block
checksums are cached so the 3rd and subsequent runs do not need to
uncompress the archived copy for the rsync comparison to work.

-- 
   Les Mikesell
 lesmikes...@gmail.com

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


[BackupPC-users] Compression benchmark

2017-02-01 Thread Jan Stransky
Hi,

as I have installed BackupPC, I was pleasantly surprised with 
compression effectiveness (data savings), but unpleasantly surprised 
with its CPU dependence.

Therefore, I am thinking about preparing some compression CPU 
performance benchmark for BackupPC. Potential new users or HW buyers 
would have a feeling what can they expect. In my example, I have bought 
Intel NUC with Pentium N3700 and backups with compression is 10x slower. 
Knowing that eariler, I would look for version with i3 or i5. Or not, if 
they are still to weak.

The benchmark idea:

1) Docker image/Dockerfile with preconfigured BackupPC

2) Few datasets: bunch of general documents, images; images with virtual 
machines; some movies? Few GBs each.

3) Full backup of each dataset as separate host, then second with 
already filled pool. Preferably from SSD to SSD to not be IO limited.

4) Report backup speeds and timing given by BackupPC

What do you think? Would you run the tests on your HW to fill a 
database? Is it worth doing?

Jan


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] skip folders with ignore file or whitelist

2017-02-01 Thread Jan Stransky
I think you would have to make a script to modify host-specific config 
file for backuppc.
Jan

On 02/01/2017 09:26 AM, Andreas Roth wrote:
> Hi all,
>
> I want to backup a filesystem structure of a big data application. The
> application having a data directory structure. Every directory
> Which don't need to be backed up contains a kind of  ignore file.
>
> Is there a possibility to configure backuppc to skip a complete folder when 
> there is a kind of .ignore file?
> Otherwise I could create a list of dirs to backup with a prescript. I'm not 
> if it's possible to pass a directory list to
> backuppc and save this whitelist.
>
> Thanks for your help in advance,
>
> Andreas
>
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


[BackupPC-users] skip folders with ignore file or whitelist

2017-02-01 Thread Andreas Roth
Hi all,

I want to backup a filesystem structure of a big data application. The
application having a data directory structure. Every directory
Which don't need to be backed up contains a kind of  ignore file. 

Is there a possibility to configure backuppc to skip a complete folder when 
there is a kind of .ignore file?
Otherwise I could create a list of dirs to backup with a prescript. I'm not if 
it's possible to pass a directory list to
backuppc and save this whitelist.

Thanks for your help in advance,

Andreas

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/