Re: [BackupPC-users] [BackupPC] Cpool and pc quite are big according to size of backuped data and backup config

Hervé Richard Wed, 26 Mar 2008 09:30:39 -0700

Les Mikesell wrote:

Hervé Richard wrote:

My backup server with backuppc don't backup anymore, backup hdd is full :-/
So I checked a little bit the backuped data to see what is taking so much space.

Let me explain my configuration:

I have 12Gb of data to backup on my server.
I configured 1 full backup every Sunday at 3AM and Incr every other day of the week at 3AM too
I configured backuppc to keep 2 full backup and 12 Incr.

Then after a while my backup hdd was filled ....

I check the size of the Cpool dir and it takes about 45GB on the drive and pc dir is about 26Gb...

This doesn't sound right if you only have one target. Does the server and the backuppc service run continuously? Maybe it isn't running the backuppc_nightly job that removes the unneeded pool/cpool copies.

Yes in fact the server and backuppc run continuously and the server backup files stored on itself.
I took care of not backing up backuppc files as mentioned in the backuppc faq.

For backuppc_nightly job:
Maybe :-/
I don't know how to configure/force backuppc_nightly job to removes unneeded pool/cpool :-/
Maybe it's automatic... check every age of every backuped files and delete everyone older than configured in:

$Conf{FullKeepCnt} = 2;
and
$Conf{IncrKeepCnt} = 12;

I have this message in every log:

Cpool nightly clean removed 0 files of size 0.00GB

There are no big file transfer between two Incr backup which could have filled the disk and only 12GB of data to backup.

If you are using rsync, any large files that grow or have small changes (databases, logs, etc.) will only transfer the difference but the server side will reconstruct the full size file and store it as a separate copy.

I'm using Tar.

Did I missed something?

If your target is a 64-bit linux system, be sure you aren't backing up /var/log/lastlog - or at least check its size. On some versions this is a huge sparse file that copies generally don't handle very well.

My target is the server itself and has been installed as an i686 SMP .

Here is my "client" config.pl:
(Here the $Conf{TarShareName} and the $Conf{BackupFilesExclude} are missing but are well configured in my install)

$Conf{FullPeriod} = 6.97;

$Conf{IncrPeriod} = 0.97;


$Conf{FullKeepCnt} = 2;

$Conf{IncrKeepCnt} = 12;

$Conf{XferMethod} = 'tar';

$Conf{TarClientCmd} = '/usr/bin/sudo $tarPath -c -v -f - -C $shareName  --totals';

$Conf{TarFullArgs} = '$fileList';

$Conf{TarIncrArgs} = '--newer=$incrDate $fileList';

$Conf{TarClientRestoreCmd} = '/usr/bin/sudo $tarPath -x -p --numeric-owner --same-owner -v -f - -C $shareName';

And the "server side" config.pl:

$Conf{ServerHost} = 'localhost';
$Conf{ServerPort} = -1;
$Conf{ServerMesgSecret} = '****';
$Conf{MyPath} = '/bin';
$Conf{UmaskMode} = 027;
$Conf{WakeupSchedule} = [3.5];
$Conf{MaxBackups} = 4;
$Conf{MaxUserBackups} = 4;
$Conf{MaxPendingCmds} = 10;
$Conf{MaxBackupPCNightlyJobs} = 2;
$Conf{BackupPCNightlyPeriod} = 1;
$Conf{MaxOldLogFiles} = 14;
$Conf{MaxPendingCmds} = 10;
$Conf{DfPath} = '/bin/df';
$Conf{DfCmd} = '$dfPath $topDir';
$Conf{SplitPath} = '/usr/bin/split';
$Conf{ParPath} = '/usr/bin/par2';
$Conf{CatPath} = '/bin/cat';
$Conf{GzipPath} = '/bin/gzip';
$Conf{Bzip2Path} = '/usr/bin/bzip2';
$Conf{DfMaxUsagePct} = 95;
$Conf{TrashCleanSleepSec} = 300;

$Conf{DHCPAddressRanges} = [
        {
            ipAddrBase => '192.168.0',
            first => 65,
            last  => 66,
        },
    ];
$Conf{BackupPCUser} = 'backuppc';
$Conf{CgiDir} = '/opt/backuppc/cgi-bin';
$Conf{InstallDir} = '/usr/local';
$Conf{BackupPCUserVerify} = 1;
$Conf{HardLinkMax} = 31999;

$Conf{SmbShareName} = ['C$'];
$Conf{SmbShareUserName} = '****';
$Conf{SmbSharePasswd} = '****';
$Conf{TarShareName} = ['/'];
$Conf{FullPeriod} = 6.97;
$Conf{IncrPeriod} = 0.97;
$Conf{FullKeepCnt} = 1;
$Conf{FullKeepCntMin} = 1;
$Conf{FullAgeMax} = 90;
$Conf{IncrKeepCnt} = 6;
$Conf{IncrKeepCntMin} = 1;
$Conf{IncrAgeMax} = 30;
$Conf{PartialAgeMax} = 3;
$Conf{IncrFill} = 0;
$Conf{RestoreInfoKeepCnt} = 10;
$Conf{ArchiveInfoKeepCnt} = 10;
$Conf{BackupFilesOnly} = undef;
$Conf{BackupFilesExclude} = undef;
$Conf{BlackoutBadPingLimit} = 3;
$Conf{BlackoutGoodCnt} = 7;

$Conf{BlackoutPeriods} = [
    {
	hourBegin =>  7.0,
	hourEnd   => 19.5,
	weekDays  => [1, 2, 3, 4, 5],
    },
];
$Conf{BackupZeroFilesIsFatal} = 0;

$Conf{XferMethod} = 'archive';
$Conf{XferLogLevel} = '1';
$Conf{SmbClientPath} = '/usr/bin/smbclient';
$Conf{SmbClientFullCmd} = '$smbClientPath \\\\$host\\$shareName $I_option -U $userName -E -N -d 1 -c tarmode\\ full -Tc$X_option - $fileList';
$Conf{SmbClientIncrCmd} = '$smbClientPath \\\\$host\\$shareName $I_option -U $userName -E -N -d 1 -c tarmode\\ full -TcN$X_option $timeStampFile - $fileList';
$Conf{SmbClientRestoreCmd} = '$smbClientPath \\\\$host\\$shareName $I_option -U $userName -E -N -d 1 -c tarmode\\ full -Tx -';
$Conf{TarClientCmd} = '$sshPath -q -x -n -l root $host $tarPath -c -v -f - -C $shareName+ --totals';
$Conf{TarFullArgs} = '$fileList+';
$Conf{TarIncrArgs} = '--newer=$incrDate+ $fileList+';
$Conf{TarClientRestoreCmd} = '$sshPath -q -x -l root $host $tarPath -x -p --numeric-owner --same-owner -v -f - -C $shareName+';
$Conf{TarClientPath} = '/bin/tar';
$Conf{RsyncClientPath} = '/usr/bin/rsync';
$Conf{RsyncClientCmd} = '$sshPath -q -x -l root $host $rsyncPath $argList+';
$Conf{RsyncClientRestoreCmd} = '$sshPath -q -x -l root $host $rsyncPath $argList+';
$Conf{RsyncShareName} = ['/'];
$Conf{RsyncdClientPort} = 873;
$Conf{RsyncdUserName} = '';
$Conf{RsyncdPasswd} = '****';
$Conf{RsyncdAuthRequired} = 1;
$Conf{RsyncCsumCacheVerifyProb} = 0.01;

$Conf{RsyncArgs} = [

            '--numeric-ids',
            '--perms',
            '--owner',
            '--group',
            '-D',
            '--links',
            '--times',
            '--block-size=2048',
            '--recursive',

];


$Conf{RsyncRestoreArgs} = [
	   
	    '--numeric-ids',
	    '--perms',
	    '--owner',
	    '--group',
	    '-D',
	    '--links',
	    '--times',
	    '--block-size=2048',
	    '--relative',
	    '--ignore-times',
	    '--recursive',

];
$Conf{ArchiveDest} = '/tmp';
$Conf{ArchiveComp} = 'gzip';
$Conf{ArchivePar} = 0;
$Conf{ArchiveSplit} = 0;
$Conf{ArchiveClientCmd} = '$Installdir/bin/BackupPC_archiveHost $tarCreatePath $splitpath $parpath $host $backupnumber $compression $compext $splitsize $archiveloc $parfile *';
$Conf{SshPath} = '/usr/bin/ssh';
$Conf{NmbLookupPath} = '/usr/bin/nmblookup';
$Conf{NmbLookupCmd} = '$nmbLookupPath -A $host';
$Conf{NmbLookupFindHostCmd} = '$nmbLookupPath $host';
$Conf{FixedIPNetBiosNameCheck} = '0';
$Conf{PingPath} = '/bin/ping';
$Conf{PingCmd} = '$pingPath -c 1 $host';
$Conf{ServerInitdPath} = '/etc/rc.d/init.d/backuppc';
$Conf{ServerInitdStartCmd} = '$serverInitdPath start';
$Conf{CompressLevel} = 3;
$Conf{PingMaxMsec} = 20;
$Conf{ClientTimeout} = 72000;
$Conf{MaxOldPerPCLogFiles} = 12;
$Conf{DumpPreUserCmd} = undef;
$Conf{DumpPostUserCmd} = undef;
$Conf{RestorePreUserCmd} = undef;
$Conf{RestorePostUserCmd} = undef;
$Conf{ArchivePreUserCmd} = undef;
$Conf{ArchivePostUserCmd} = undef;
$Conf{ClientNameAlias} = undef;
$Conf{PerlModuleLoad} = undef;
$Conf{SendmailPath} = '/usr/sbin/sendmail';
$Conf{EMailNotifyMinDays} = 2.5;
$Conf{EMailFromUserName} = 'backuppc';
$Conf{EMailAdminUserName} = 'admin';
$Conf{EMailUserDestDomain} = '[EMAIL PROTECTED]';
$Conf{EMailNoBackupEverSubj} = undef;
$Conf{EMailNoBackupEverMesg} = undef;
$Conf{EMailNotifyOldBackupDays} = 7.0;
$Conf{EMailNoBackupRecentSubj} = undef;
$Conf{EMailNoBackupRecentMesg} = undef;
$Conf{EMailNotifyOldOutlookDays} = 5.0;
$Conf{EMailOutlookBackupSubj} = undef;
$Conf{EMailOutlookBackupMesg} = undef;

$Conf{CgiAdminUserGroup} = '';
$Conf{CgiAdminUsers} = 'admin';
$Conf{CgiURL} = '/backup/cgi-bin/BackupPC_Admin';
$Conf{Language} = 'en';
$Conf{CgiUserHomePageCheck} = '';
$Conf{CgiUserUrlCreate} = 'mailto:%s';
$Conf{CgiDateFormatMMDD} = '1';
$Conf{CgiNavBarAdminAllHosts} = '1';
$Conf{CgiSearchBoxEnable} = '1';

$Conf{CgiNavBarLinks} = [
    {
        link  => "?action=""
        lname => "Documentation",    # actually displays $Lang->Documentation
    },
    {
        link  => "http://backuppc.sourceforge.net/faq",
        name  => "FAQ",              # displays literal "FAQ"
    },
    {
        link  => "http://backuppc.sourceforge.net",
        name  => "SourceForge",      # displays literal "SourceForge"
    },
];

$Conf{CgiStatusHilightColor} = {
    Reason_backup_failed           => '#ffcccc',
    Reason_backup_done             => '#ccffcc',
    Reason_no_ping                 => '#ffff99',
    Reason_backup_canceled_by_user => '#ff9900',
    Status_backup_in_progress      => '#66cc99',
};
$Conf{CgiHeaders} = '<meta http-equiv="pragma" content="no-cache">';
$Conf{CgiImageDir} = '/opt/backuppc/html';
$Conf{CgiExt2ContentType} = {};
$Conf{CgiImageDirURL} = '/backup';
$Conf{CgiCSSFile} = 'BackupPC_stnd.css';

Thanks for your help,

Hervé

begin:vcard
fn;quoted-printable:Herv=C3=A9 Richard
n;quoted-printable:Richard;Herv=C3=A9
org:PERIACTES
adr:;;Av. de l'hippodrome, 147;Brussels;;1050;Belgium
email;internet:[EMAIL PROTECTED]
tel;work:+32 (0) 2 649 80 89
tel;fax:+32 (0) 2 648 27 22
x-mozilla-html:FALSE
url:http://www.periactes.com
version:2.1
end:vcard

-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace

_______________________________________________
BackupPC-users mailing list
[email protected]
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] [BackupPC] Cpool and pc quite are big according to size of backuped data and backup config

Reply via email to