Bruno Faria wrote: > Hello to everyone, > > Lately for some reason, BackupPC has been running very slow on a > server that we have configured to do backups. Just so that you guys > can have an idea of how slow it really is going, it took BackupPC > 10265.2 minutes to backup 1656103 files totaling to only 24 gigabytes > worth of files. Obviously, I can't really wait a week for a 24 > gigbyte backup to be done. Now here's what makes me think that this > problem with BackupPC could be due to server hardware: I first > started started doing backups for one pc at a time, and it took > BackupPC 468.8 minutes to backup 2626069 files or 32 gigabyte worth > of files for that same computer. But now I have about 45 computers > added to BackupPC and sometimes BackupPC is backing up 30 of them or > more at the same time, and that's when the server really goes slow. > > Here's the top command when the BackupPC server is going slow: > top - 19:06:36 up 15 days, 6:11, 3 users, load average: 28.76, > 39.03, 32.14 > Tasks: 156 total, 1 running, 155 sleeping, 0 stopped, 0 zombie > Cpu(s): 3.7% us, 2.2% sy, 0.0% ni, 7.7% id, 86.0% wa, 0.4% hi, > 0.0% si > Mem: 1033496k total, 1019896k used, 13600k free, 141720k > buffers > Swap: 5116692k total, 2538712k used, 2577980k free, 41932k > cached > > Here's the hardware and BackupPC specs: BackupPC is running on server > that has 5 terabytes of disk space, 1 gb of RAM, and a 5 gb swap, > with intell xeon processor. I was using rsync as my backup method, > but I switched to tar to see if that would improve performance. > BackupPC is backing up about 45 servers (all linux). > > So in conclusion, how can I make BackupPC run faster? What's the > fastest backup method, what can I modify on config.pl to make it run > faster, etc? Is not enough RAM what's causing backuppc to run slow? > Is there anything on my hardware that would make it run faster? > > Thank you, and I hope that you guys can help me with speeding up > BackupPC!
>From your top command: 86.0% wa This looks like you are limited by your disk speed. Everything is waiting on IO. Looks like your storage can't keep up with 20 backups at once. Also, if you are running 20 rsync backups at once, rsync will load the entire directory tree into memory before it starts. Full directory trees for 20 servers loaded into memory at once could be causing memory problems. If your computer starts swapping, then everything slows down and depending on your storage setup, the swap process could also be getting caught in the IO bottleneck from the backups causing even worse slowdowns. My advise would be to reduce the number of simultaneous backups and see what happens. -- Bowie ------------------------------------------------------------------------- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ BackupPC-users mailing list [email protected] List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
