Re: [BackupPC-users] Problems with slow backups
Hi, thank you for your suggestions so far. I have now moved the files to new filesystems running reiser instead of XFS and tried tuning the ssh connection by adding the -C flag. Let me guess: ext3 filesystem? If yes, you've just been hit by the ext3 doesn't scale for large number of files problem. Use reiser or xfs. Wrong guess :-) The box runs XFS and reiserfs. It's a Suse 8.2 box that has been upgraded to 9.2. Hm. Strange. The slowdown didn't appear just after you upgraded the box to 9.2 but later? Just to be sure: your /var/lib/backuppc isn't on a broken raid volume? Or dma has been disabled on your disks? What hardware are you running on the backuppc server? It's an AMD 1,4 ghz box with 256 mb ram and a stadnard IDE harddrive. I did a grep on the transfer log to see what's happening there, except for the normal messages. I got a few interesting results. I'm running the backup with the --one-file-system switch so therefore the log contains many shutdowns and startups of the rsync process. It seems that not all went well: Xfer PIDs are now 21852 Got remote protocol 28 Checksum caching enabled (checksumSeed = 32761) Xfer PIDs are now 21852,21853 .. lots of files transfered finish: removing in-process file filename removed Child is aborting Done: 22623 files, 2548985137 bytes Got fatal error during xfer (aborted by user (signal=INT)) Backup aborted by user signal What I am wondering about on this is who is the user? Is that backuppc? If so, is it possible for backuppc to provide more info on why it ended the transfer? Will this file contain the logs of more than one transfer if a backup has been stoped and then later started? Also, it seems that there have been some linking problems: I got a few (20+ out of 500 000 files) of these: Unable to link /backup/pc/hostname/635/f%2fboot/fgrub/fstage2 to /backup/pc/hostname/new//f%2fboot/fgrub/fstage2 Any tips on why? All were related to one small directory, the /boot partition. THE MAIN PROBLEM: I've been writing on this email for a day now as the backup goes on and off. Now, I think I've found the major problem. In the logs I find a huge amount of errors like these: pool 764 1007/51347727360 Filename Unable to open /backup/pc/host/new/f%2fdata%path to fil for writing Botch, no matches on /backup/pc/mail2.bergfald.no/same file (ed89e29bec3a01b565ad5cbbb89a3c9a) It continues like that for quite some time before exiting. So, does anyone have a suggestion for this one? Kind regards, Tarjei I would run BackupPC_dump for a known slow host manually with the -v flag, so you can see what's going on. If that doesn't provide enough info, try to strace -p the process and see what's going on. I can think of 2 problems which can cause what you're seeing: 1. you run out of memory with the rsync filelist, which makes the server start to swap and after that everything goes horribly slow. 2. something is wrong with the filesystem. Kind regards Tarjei Hth, -- -- Tarjei Huse [EMAIL PROTECTED] --- This SF.Net email is sponsored by the JBoss Inc. Get Certified Today Register for a JBoss Training Course. Free Certification Exam for All Training Attendees Through End of 2005. For more info visit: http://ads.osdn.com/?ad_id=7628alloc_id=16845op=click ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
[BackupPC-users] removeing backups vom the list?
Hi, i have installed backuppc and it work SOOO FINE for me. And now my question. Is there a way to remove my 20 testing backups from the backuplist, or is the only way to wait till they doesnt match fullkeepcnt an the nightly job will delete them? Jan _ NOD32 EMON 1.1295 (20051120) Information _Diese Nachricht wurde vom NOD32 antivirus system geprfthttp://www.nod32.com
[BackupPC-users] Workstations at night.
Hi, it me again, i set backuppc to backup two worstations. That works fine. But now it says The connection was 7 times good and the backup will run out of the workingtime but the worstations are turned off at night.. Does Backuppc run the backup when the clients turned on again in the morning? Thanks for help. Jan _ NOD32 EMON 1.1295 (20051120) Information _Diese Nachricht wurde vom NOD32 antivirus system geprfthttp://www.nod32.com
Re: [BackupPC-users] Error when trying to archive a host
Nicolai Rasmussen wrote:
I get this error when trying, via the cgi interface, to run an archive on one
of my hosts:
Error: Can't open/create ${EscHTML($TopDir/pc/$hostDest/$reqFileName)}
The config file for the archive host looks like this:
$Conf{XferMethod} = 'archive';
$Conf{XferLogLevel} = 1;
$Conf{ArchiveDest} = '/tmp';
The permissions for the /tmp folder is:
drwxrwxrwt 2 root root 4096 2005-11-18 16:28 tmp
I get the same error when trying to archive the localhost (and I only have one
client, and a local host configured...)
Btw, my config.pl files are located in /etc/backuppc/client.pl - not
/var/lib/backuppc/pc/client
- The backup seems though to be working from the client.pl files in
/etc/backuppc, so I dont see a point in moving them...
Should I move them?
I've also been wondering, why backuppc doesnt create an archive folder under
/var/lib/backuppc/pc/?
- And since this is not the case, I'm not able to move the archive.pl file to
this directory, as the documentation for backuppc states I should do...
(Running version 2.1.1-3, just for the record).
I usually create the client folders themselves, after I add them to the
hosts file, and copy/create the config file in there. I then do a chown
-R backuppc:backuppc newhost
HTH,
Alex
---
This SF.Net email is sponsored by the JBoss Inc. Get Certified Today
Register for a JBoss Training Course. Free Certification Exam
for All Training Attendees Through End of 2005. For more info visit:
http://ads.osdn.com/?ad_id=7628alloc_id=16845op=click
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/
[BackupPC-users] Backup with rsyncd failed after 20mn
Hi, I don't succeed to backup my /home directory I got the error message: 2005/11/20 17:14:06 [30114] rsync: writefd_unbuffered failed to write 4096 bytes: phase unknown [sender]: Connection reset by peer (104) 2005/11/20 17:14:06 [30114] rsync error: error in rsync protocol data stream (code 12) at io.c(1099) I use a Debian sarge as BackupPC server and client. The client is on ADSL server on ISP hosting, and rsync version 2.6.6 protocol version 29 What's wrong ? Sam. -- Ce message a été vérifié par MailScanner pour des virus ou des polluriels et rien de suspect n'a été trouvé. --- This SF.Net email is sponsored by the JBoss Inc. Get Certified Today Register for a JBoss Training Course. Free Certification Exam for All Training Attendees Through End of 2005. For more info visit: http://ads.osdn.com/?ad_id=7628alloc_id=16845op=click ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
[BackupPC-users] How much time does it take to finish a backup?
Hi I notice the thread Backup of one server hangs. It sounds like my problem but I'm not sure if it's the same. Our primary file server is running WinNT4 and we are using the rsyncd method to back it up. I cannot use the smb method, as testing showed that it will cause the backup server to quickly run out of memory. Backuppc has been backing up two (very large) directories on the server, and it ran fine. However, there are more files that should be backed up, and about 10 days ago I added another (very large) directory to the list of directories to back up. IIRC, it has not been adding any more files since more than a week ago, but the backup job is still running, and I don't know what it is doing. (I have been upping the timeout value every day thinking that the backup will finish the next day.) The logs doesn't say much, but the timestamps of the files in the new directory are changing. It also seems to be acting strangely. Backup jobs are not being run today, as if the nightly job is still running. The combined size of the 3 directories being backed up is less than 17GB. The backup partition is currently about 35% full. Backuppc version is 2.1.1 and I am using Debian testing (but not using the backuppc from Debian). Kernel is Linux 2.4.28. (BTW, I have had a similar thing happening some weeks before when I first tried using backuppc. If I interrupt/kill backuppc, I expect the backup to fail.]) I wonder if this is normal for some configurations, and, if it is not normal, any recommended steps to solve the problem. Thanks for any insights into this. Regards, Ambrose Li --- This SF.Net email is sponsored by the JBoss Inc. Get Certified Today Register for a JBoss Training Course. Free Certification Exam for All Training Attendees Through End of 2005. For more info visit: http://ads.osdn.com/?ad_idv28alloc_id845op=click ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] cygwin-rsyncd vs. backuppc-rsyncd
I am having problem with Cygwin's rsyncd (tunneled through ssh) and did not know of a Backuppc rsyncd. (I'm getting an rsync protocol mismatch, I'm thinking it has something to do with my Backuppc machine running on a AMD64 system). On 11/21/05, Carl Wilhelm Soderstrom [EMAIL PROTECTED] wrote: I've finally run into a situation where the Windoze machine to be backed up, has a cygwin installation already. Should I use the backuppc-rsyncd package, or use the one included with cygwin? I believe in the past it was advised to use the backuppc-specific one; but I can't remember because it didn't matter to me at the time. Google is not helpful in searching the archives. (At least not with the search terms I can think of). -- Carl Soderstrom Systems Administrator Real-Time Enterprises www.real-time.com --- This SF.Net email is sponsored by the JBoss Inc. Get Certified Today Register for a JBoss Training Course. Free Certification Exam for All Training Attendees Through End of 2005. For more info visit: http://ads.osdn.com/?ad_id=7628alloc_id=16845op=click ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/ --- This SF.Net email is sponsored by the JBoss Inc. Get Certified Today Register for a JBoss Training Course. Free Certification Exam for All Training Attendees Through End of 2005. For more info visit: http://ads.osdn.com/?ad_idv28alloc_id845op=click ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] cygwin-rsyncd vs. backuppc-rsyncd
It took some fiddling, but I got the regular cygwin version to work ok : try this site http://www.gaztronics.net/rsync.php cheers L. From: Carl Wilhelm Soderstrom [EMAIL PROTECTED] To: backuppc-users@lists.sourceforge.net Subject:[BackupPC-users] cygwin-rsyncd vs. backuppc-rsyncd Date sent: Mon, 21 Nov 2005 11:46:26 -0600 I've finally run into a situation where the Windoze machine to be backed up, has a cygwin installation already. Should I use the backuppc-rsyncd package, or use the one included with cygwin? I believe in the past it was advised to use the backuppc-specific one; but I can't remember because it didn't matter to me at the time. Google is not helpful in searching the archives. (At least not with the search terms I can think of). -- Carl Soderstrom Systems Administrator Real-Time Enterprises www.real-time.com --- Lachlan Simpson, National Database IT Support Officer National Office The Wilderness Society 57E Brisbane Street, Hobart TAS 7000, AUSTRALIA [EMAIL PROTECTED] Ph (03) 6270 1798 http://www.wilderness.org.au --- This SF.Net email is sponsored by the JBoss Inc. Get Certified Today Register for a JBoss Training Course. Free Certification Exam for All Training Attendees Through End of 2005. For more info visit: http://ads.osdn.com/?ad_id=7628alloc_id=16845op=click ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] cygwin-rsyncd vs. backuppc-rsyncd
On Mon, 2005-11-21 at 12:41 -0600, Carl Wilhelm Soderstrom wrote: On 11/21 01:39 , Joe Hood wrote: I am having problem with Cygwin's rsyncd (tunneled through ssh) and did not know of a Backuppc rsyncd. last I knew, rsync+ssh didn't work properly on Windoze machines. Someone reported success recently, but I don't know what they did differently. I think Joe is using rsyncd, not rysnc with ssh transport. Rysnc does not work with Cygwin ssh last I tried. It will work only for small transfers and then crap out. -- Travis Fraser [EMAIL PROTECTED] --- This SF.Net email is sponsored by the JBoss Inc. Get Certified Today Register for a JBoss Training Course. Free Certification Exam for All Training Attendees Through End of 2005. For more info visit: http://ads.osdn.com/?ad_id=7628alloc_id=16845op=click ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Problems with slow backups
Hi, thank you for your suggestions so far. I have now moved the files to new filesystems running reiser instead of XFS and tried tuning the ssh connection by adding the -C flag. Let me guess: ext3 filesystem? If yes, you've just been hit by the ext3 doesn't scale for large number of files problem. Use reiser or xfs. Wrong guess :-) The box runs XFS and reiserfs. It's a Suse 8.2 box that has been upgraded to 9.2. Hm. Strange. The slowdown didn't appear just after you upgraded the box to 9.2 but later? Just to be sure: your /var/lib/backuppc isn't on a broken raid volume? Or dma has been disabled on your disks? What hardware are you running on the backuppc server? It's an AMD 1,4 ghz box with 256 mb ram and a stadnard IDE harddrive. I did a grep on the transfer log to see what's happening there, except for the normal messages. I got a few interesting results. I'm running the backup with the --one-file-system switch so therefore the log contains many shutdowns and startups of the rsync process. It seems that not all went well: Xfer PIDs are now 21852 Got remote protocol 28 Checksum caching enabled (checksumSeed = 32761) Xfer PIDs are now 21852,21853 .. lots of files transfered finish: removing in-process file filename removed Child is aborting Done: 22623 files, 2548985137 bytes Got fatal error during xfer (aborted by user (signal=INT)) Backup aborted by user signal What I am wondering about on this is who is the user? Is that backuppc? If so, is it possible for backuppc to provide more info on why it ended the transfer? Will this file contain the logs of more than one transfer if a backup has been stoped and then later started? Also, it seems that there have been some linking problems: I got a few (20+ out of 500 000 files) of these: Unable to link /backup/pc/hostname/635/f%2fboot/fgrub/fstage2 to /backup/pc/hostname/new//f%2fboot/fgrub/fstage2 Any tips on why? All were related to one small directory, the /boot partition. THE MAIN PROBLEM: I've been writing on this email for a day now as the backup goes on and off. Now, I think I've found the major problem. In the logs I find a huge amount of errors like these: pool 764 1007/51347727360 Filename Unable to open /backup/pc/host/new/f%2fdata%path to fil for writing Botch, no matches on /backup/pc/mail2.bergfald.no/same file (ed89e29bec3a01b565ad5cbbb89a3c9a) It continues like that for quite some time before exiting. So, does anyone have a suggestion for this one? Kind regards, Tarjei I would run BackupPC_dump for a known slow host manually with the -v flag, so you can see what's going on. If that doesn't provide enough info, try to strace -p the process and see what's going on. I can think of 2 problems which can cause what you're seeing: 1. you run out of memory with the rsync filelist, which makes the server start to swap and after that everything goes horribly slow. 2. something is wrong with the filesystem. Kind regards Tarjei Hth, -- --- This SF.Net email is sponsored by the JBoss Inc. Get Certified Today Register for a JBoss Training Course. Free Certification Exam for All Training Attendees Through End of 2005. For more info visit: http://ads.osdn.com/?ad_id=7628alloc_id=16845op=click ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
[BackupPC-users] Backing up only the latest backups for each pc
Hello, The program works simply great. But I have a problem, the external disk, where I put all the information for around thirty PCs, is not big enough. I was copying the whole /var/lib/backuppc, but now I would like to backup only the latest backup for each PC, since that will save lots of space (the biggest files are those that change often). Any ideas on how to go about it? Regards, Eduardo. --- This SF.Net email is sponsored by the JBoss Inc. Get Certified Today Register for a JBoss Training Course. Free Certification Exam for All Training Attendees Through End of 2005. For more info visit: http://ads.osdn.com/?ad_id=7628alloc_id=16845op=click ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
