[BackupPC-users] BackupPC not cleaning out cpool --- Anyone have anymore ideas?
Original Message Subject: Re: [BackupPC-users] BackupPC not cleaning out cpool. From:Joseph Holland joseph.holl...@kepak.com Date:Tue, February 16, 2010 8:57 am To: General list for user discussion, questions and support backuppc-users@lists.sourceforge.net -- @Matthias strangely, indeed. du delivers a roughly estimation, not an exact value. But we are speaking about 140GB vs 540GB. 1) du and GUI use the same directory? I have /var/lib/backuppc and not /var/data/backuppc. 2) There are no extra files from you on your /var/data/backuppc? I don't know how the GUI calculates the usage of space. 1) The /var/data/backuppc is where I have the partition mounted and then it's symlinked to the /var/lib/backuppc folder. 2) No there are no extra files in that directory. If I run the du -xsmh on the /var/lib/backuppc/cpool directory I get back 540GB. On 14/02/2010 21:38, Craig Barratt wrote: Joe, Yes, you have the IO::Dirent problem, and it sounds like it is fixed, since BackupPC_nightly reports non-zero information. However, it doesn't report that it removed any files, so every cpool file (at least for the output you included) has at least 2 links. However, BackupPC_trashClean (which is started once when BackupPC first starts) will also have the same problem. Did you re-start BackupPC after patching $IODirentOk? You should check to see if /var/data/backuppc/trash has a lot of files. If so, that's the problem. After those files are removed, then BackupPC_nightly will find files that only have one link, and will remove them. Craig That's what I though too. There appears to be no files in the /var/lib/backuppc/trash directory though. Regards, Joe. -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackupPC not cleaning out cpool.
@Matthias strangely, indeed. du delivers a roughly estimation, not an exact value. But we are speaking about 140GB vs 540GB. 1) du and GUI use the same directory? I have /var/lib/backuppc and not /var/data/backuppc. 2) There are no extra files from you on your /var/data/backuppc? I don't know how the GUI calculates the usage of space. 1) The /var/data/backuppc is where I have the partition mounted and then it's symlinked to the /var/lib/backuppc folder. 2) No there are no extra files in that directory. If I run the du -xsmh on the /var/lib/backuppc/cpool directory I get back 540GB. On 14/02/2010 21:38, Craig Barratt wrote: Joe, Yes, you have the IO::Dirent problem, and it sounds like it is fixed, since BackupPC_nightly reports non-zero information. However, it doesn't report that it removed any files, so every cpool file (at least for the output you included) has at least 2 links. However, BackupPC_trashClean (which is started once when BackupPC first starts) will also have the same problem. Did you re-start BackupPC after patching $IODirentOk? You should check to see if /var/data/backuppc/trash has a lot of files. If so, that's the problem. After those files are removed, then BackupPC_nightly will find files that only have one link, and will remove them. Craig That's what I though too. There appears to be no files in the /var/lib/backuppc/trash directory though. Regards, Joe. -- This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited. The Company accepts no liability for the content of this e-mail, or for the consequences of any actions taken on the basis of the information provided, unless that information is subsequently confirmed in writing. The Company accepts no liability for the damage caused by any virus transmitted by this email. Any views or opinions presented in this email are solely those of the author and do not necessarily represent those of The Company. Employees are expressly required not to make defamatory statements and not to infringe or authorize any infringement of copyright or any other legal right by email communications. Any such communication is contrary to company policy and outside the scope of the employment of the individual concerned. The Company will not accept any liability in respect of such communication. No employee or agent is authorised to enter into any legally binding Sale or Purchase Contract on behalf of The Company with another party unless and until The Company has issued either a formal Sales Confirmation or Purchase Contract (as appropriate). Any confirmation of a sale or purchase transaction by e-mail only shall not become legally binding on The Company unless and until it has also issued a formal Sale Confirmation or Purchase Contract (as appropriate). CONSIDER OUR ENVIRONMENT. WE ENCOURAGE YOU TO ONLY PRINT THIS EMAIL IF ABSOLUTELY NECESSARY This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. -- SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW http://p.sf.net/sfu/solaris-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackupPC not cleaning out cpool.
Joseph Holland wrote: # du -xsmh /var/data/backuppc/ 544G/var/data/backuppc/ Joe. On 11/02/2010 22:45, Matthias Meyer wrote: Joseph Holland wrote: We are having a problem with many of our BackupPC servers in our company at the moment. We are running Debian Lenny and BackupPC 3.1.0. The data volumes since we upgraded to this version have seemed to just be filling up at a constant rate. The web interface is saying that the pool is 136.98GB but when you do a du -smh on the topdir /var/data/backuppc it returns 543GB used. Try du -xsmh br Matthias strangely, indeed. du delivers a roughly estimation, not an exact value. But we are speaking about 140GB vs 540GB. 1) du and GUI use the same directory? I have /var/lib/backuppc and not /var/data/backuppc. 2) There are no extra files from you on your /var/data/backuppc? I don't know how the GUI calculates the usage of space. Sorry Matthias -- Don't Panic -- SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW http://p.sf.net/sfu/solaris-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackupPC not cleaning out cpool.
Joe, Yes, you have the IO::Dirent problem, and it sounds like it is fixed, since BackupPC_nightly reports non-zero information. However, it doesn't report that it removed any files, so every cpool file (at least for the output you included) has at least 2 links. However, BackupPC_trashClean (which is started once when BackupPC first starts) will also have the same problem. Did you re-start BackupPC after patching $IODirentOk? You should check to see if /var/data/backuppc/trash has a lot of files. If so, that's the problem. After those files are removed, then BackupPC_nightly will find files that only have one link, and will remove them. Craig -- SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW http://p.sf.net/sfu/solaris-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] BackupPC not cleaning out cpool.
We are having a problem with many of our BackupPC servers in our company
at the moment. We are running Debian Lenny and BackupPC 3.1.0. The
data volumes since we upgraded to this version have seemed to just be
filling up at a constant rate.
The web interface is saying that the pool is 136.98GB but when you do a
du -smh on the topdir /var/data/backuppc it returns 543GB used.
We have the topdir mounted as /var/data/backuppc and symlinked to
/var/lib/backuppc. The filesystem that the topdir resides on is JFS.
I've double checked the permissions on the topdir and sub-directories.
I have searched through the backuppc-users archive and have tried the
fixes mentioned here:
http://www.backupcentral.com/phpBB2/two-way-mirrors-of-external-mailing-lists-3/backuppc-21/pool-is-0-00gb-comprising-0-files-and-0-directories-98371/
and here:
http://www.mail-archive.com/backuppc-users@lists.sourceforge.net/msg09902.html
But to no avail.
When I run the BackupPC_nightly script as the backuppc user with the
args 0 255 I get the expected output.
$ ./BackupPC_nightly 0 255
Here's some of the output from that command. There's nothing in the
stats for the pool and the cpool stats ONLY work when line 82 of the
Lib.pm $IODirentOk is set to 0 (I know this is due to issue using
IODirent and certain filesystems).
BackupPC_stats 253 = pool,0,0,0,0,0,0,0,0,0,0,
BackupPC_stats 254 = pool,0,0,0,0,0,0,0,0,0,0,
BackupPC_stats 255 = pool,0,0,0,0,0,0,0,0,0,0,
BackupPC_stats 0 = cpool,553,18,192124,58280,0,0,2,1,0,157,3539
BackupPC_stats 1 = cpool,512,17,605328,375780,0,0,1,1,0,43,6530
BackupPC_stats 2 = cpool,553,17,249388,28828,0,0,1,1,0,253,10237
But nothing seems to be being deleted when the script completes.
I tried running the script with perl -w and get back the following two
lines in between every line of the normal output. So:
$ perl -w ../BackupPC_nightly 0 255
Here's some of the output from that command:
Use of uninitialized value in string ne at
/usr/share/backuppc/lib/BackupPC/Lib.pm line 487.
Use of uninitialized value in string ne at
/usr/share/backuppc/lib/BackupPC/Lib.pm line 528.
Use of uninitialized value in string ne at
/usr/share/backuppc/lib/BackupPC/Lib.pm line 487.
Use of uninitialized value in string ne at
/usr/share/backuppc/lib/BackupPC/Lib.pm line 528.
Use of uninitialized value in string ne at
/usr/share/backuppc/lib/BackupPC/Lib.pm line 487.
Use of uninitialized value in string ne at
/usr/share/backuppc/lib/BackupPC/Lib.pm line 528.
BackupPC_stats 254 = cpool,546,17,168344,14688,0,0,0,0,0,115,874742
This is what's on line 487 of the Lib.pm:
from_to($path, utf8, $need-{charsetLegacy})
if ( $need-{charsetLegacy} ne );
return if ( !opendir(my $fh, $path) );
if ( $IODirentOk ) {
@entries = sort({ $a-{inode} = $b-{inode} } readdirent($fh));
map { $_-{type} = 0 + $_-{type} } @entries; # make type numeric
} else {
@entries = map { { name = $_} } readdir($fh);
}
and this is what's on line 528:
if ( $need-{charsetLegacy} ne ) {
for ( my $i = 0 ; $i @entries ; $i++ ) {
from_to($entries[$i]{name}, $need-{charsetLegacy}, utf8);
}
}
return \...@entries;
}
I know it's got something to do with the IODirent, I'm just not sure of
what or the fix.
Anyone have any ideas?
Thanks in advance,
Joe.
--
This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom they are
addressed. Please notify the sender immediately by e-mail if you have
received this e-mail by mistake and delete this e-mail from your system.
If you are not the intended recipient you are notified that disclosing,
copying, distributing or taking any action in reliance on the contents
of this information is strictly prohibited. The Company accepts no
liability for the content of this e-mail, or for the consequences of any
actions taken on the basis of the information provided, unless that
information is subsequently confirmed in writing. The Company accepts no
liability for the damage caused by any virus transmitted by this email.
Any views or opinions presented in this email are solely those of the
author and do not necessarily represent those of The Company. Employees
are expressly required not to make defamatory statements and not to
infringe or authorize any infringement of copyright or any other legal
right by email communications. Any such communication is contrary to
company policy and outside the scope of the employment of the individual
concerned. The Company will not accept any liability in respect of such
communication.
No employee or agent is authorised to enter into any legally binding
Sale or Purchase Contract on behalf of The Company with another party
unless and until The Company has issued either a formal Sales
Confirmation or Purchase Contract (as appropriate). Any confirmation of
a sale or purchase transaction
Re: [BackupPC-users] BackupPC not cleaning out cpool.
Joseph Holland wrote: We are having a problem with many of our BackupPC servers in our company at the moment. We are running Debian Lenny and BackupPC 3.1.0. The data volumes since we upgraded to this version have seemed to just be filling up at a constant rate. The web interface is saying that the pool is 136.98GB but when you do a du -smh on the topdir /var/data/backuppc it returns 543GB used. Try du -xsmh br Matthias -- Don't Panic -- SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW http://p.sf.net/sfu/solaris-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackupPC not cleaning out cpool.
# du -xsmh /var/data/backuppc/ 544G/var/data/backuppc/ Joe. On 11/02/2010 22:45, Matthias Meyer wrote: Joseph Holland wrote: We are having a problem with many of our BackupPC servers in our company at the moment. We are running Debian Lenny and BackupPC 3.1.0. The data volumes since we upgraded to this version have seemed to just be filling up at a constant rate. The web interface is saying that the pool is 136.98GB but when you do a du -smh on the topdir /var/data/backuppc it returns 543GB used. Try du -xsmh br Matthias -- This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited. The Company accepts no liability for the content of this e-mail, or for the consequences of any actions taken on the basis of the information provided, unless that information is subsequently confirmed in writing. The Company accepts no liability for the damage caused by any virus transmitted by this email. Any views or opinions presented in this email are solely those of the author and do not necessarily represent those of The Company. Employees are expressly required not to make defamatory statements and not to infringe or authorize any infringement of copyright or any other legal right by email communications. Any such communication is contrary to company policy and outside the scope of the employment of the individual concerned. The Company will not accept any liability in respect of such communication. No employee or agent is authorised to enter into any legally binding Sale or Purchase Contract on behalf of The Company with another party unless and until The Company has issued either a formal Sales Confirmation or Purchase Contract (as appropriate). Any confirmation of a sale or purchase transaction by e-mail only shall not become legally binding on The Company unless and until it has also issued a formal Sale Confirmation or Purchase Contract (as appropriate). CONSIDER OUR ENVIRONMENT. WE ENCOURAGE YOU TO ONLY PRINT THIS EMAIL IF ABSOLUTELY NECESSARY This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. -- SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW http://p.sf.net/sfu/solaris-dev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] BackupPc not cleaning out cpool
So I'm using BackupPC version 3.0 and in the last couple of weeks our disk usage has gone through the roof. We're currently at 96% full on 750GB disks. If you look at the web interface of the BackupPC it says that it's only using 158GB in the pool, but if you do a du -smh on the cpool directory it comes back with over 500GB. The BackupPC trash cleans seem to be working (you can see that it cleaned 4GB from the pool last night). Anyone ever see anything like this before. Joe. -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100url=/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
