Re: [BackupPC-users] MOTD breaking rsync...
I can't believe what i've read. Go but whatever you like, and make sure it is a comercial software. Please, don't forget to pay for the support, this is quite important in your case. You need some you can call on the phone and tell them they don't know what they're doing. Please, go now, before you get another Mail from this list, it could hurt you really bad. iPhone El 21/09/2010, a las 01:52, RC cool...@gmail.com escribió: Jon Craig cannedspam.cant at gmail.com writes: Maybe you better explain what you know and what you've tried so we are not forced to go over ground you may already have covered. Your very first post calls BackupPC's methods fragile and complains about a documented requirement of the login process. There's no question RsyncP is fragile, hence the problem I reported (that rsync does not exhibit). Since it's clear no-one here wants bug-reports, I wont provide any more. Maybe my education is lacking. Could you explain to me how rsync avoids checksumming the entire filesystem without using file timestamps to include / exclude files and how backuppc's full/incremental behaves differently. After running the first (full) backup, you can use --link-dest= $LAST_FOLDER to only update the files which have changed (size timestamp) and just linking all others (ala IncrFill=1). You can do this, indefinitely. You do not need to re-checksum everything the next week. Add to this checksums of a small percentage of file on each run (ala RsyncCsumCacheVerifyProb) to verify nothing bad is happening, and you should be quite secure. I have been offering those solutions short of a rewrite of the application. Are you living with specific security requirements? Did you try setting rsync and the login shell? What result? Are you considering setup of VPN? I've pointed out a bug in RsyncP. Fixing it does not require a rewrite of any applications. Since nobody here has expressed any interest, it looks like I'll end up doing it on my own. I am not considering any more workarounds. I can think of a few, but all are invasive and complex. I didn't try changing root's login shell to rsync, because I know it won't work. Ditto for the .hushlogin suggestion, but I did it anyhow, because that was extremely quick to test. Setting up rsyncd and a VPN for numerous systems would be a huge waste of time, and sure to result in added administration down the road. Either I'll fix RsyncP myself, or because of this and other limitations, (the most significant of which I have outlined) we might opt to not roll-out BackupPC at all, and use either commercial options, or in-house automation of rsync. If the only thing your willing to live with is a rewrite of the entire system so that it behaves in a way you believe it can and should then I for one am done. I appreciate your attempts to help, and really don't mind them intermingled with hostility and insults. However, since I've sunk plenty of time into this list, and not gotten the least bit of new information, I'll call this thread done myself. My time could have been, and now will be, much better spent. --- --- --- - Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Failing incrementals and fulls resolved by moving aside prior full?
On Fri, Sep 17, 2010 at 02:02:10PM -0500, Les Mikesell wrote: On 9/17/2010 1:10 PM, John Rouillard wrote: I mention this since there seem to have been a few other mentions of hangs over the years and this may get somebody past the problem. Also I am hoping that somebody can figure out what is happening here. It seems that some state in the prior (reference) backup is causing the rsync protocol to stall. So anybody with a bright idea of what I can try looking at? I think most of the stalls were either buggy cygwin/windows versions or some stateful firewall/nat network device in the path that time out and break the connection between devices in the long idle times you might have in a backup run with mostly-identical files. If neither of these are possible, maybe you have filesystem corruption of some kind. All good ideas. They also remind me that I forgot to supply some info this time around. This is centos 5.5 to centos 5.5 with kernel 2.6.18-194.3.1.el5 on the server and 2.6.16-xenU on the client. However this has happened in the past with the same 2.6.18 kernel on both (real) boxes. Also this eliminates the whole windows morass. The backup is occurring over a vpn w/o any firewalls/nat. Also we have ServerAlive messages enabled every 30 seconds for the ssh session (because the route to some of the hosts we back up do have stateful firewalls in place). I can see ssh traffic using tcpdump when the rsync is stalled which tells me that the network/ssh layer is fine and the rsync protocol is wacky. Disk corruption isn't impossible. However the filesystem is a 4.5TB ext3 on top of 2 software (md) raid 6 arrays with 7 disks that are striped (raid 0) together. Forcing an fsck's in the past hasn't turned up any issues (but does take backups offline for a long bit 8-(). The arrays are scrubbed weekly and disk selftests (using smartctl) are done monthly. When I have increased the logging level in the past to try to diagnose this, no obvious errors popped up. It proceeded normally until it just kind of stopped. Then there was the sigalarm notice. -- -- rouilj John Rouillard System Administrator Renesys Corporation 603-244-9084 (cell) 603-643-9300 x 111 -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] backing up large files from windows machines
so what do we use to back up large files on windows machines? the documentation implies that samba has a 4 gig limit, and that rsync might have an 8 gig limit. then what...? thanks! -- We are all faced with a series of great opportunities brilliantly disguised as impossible situations... -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] General Praise.
On Mon, Sep 20, 2010 at 09:56:33PM -0700, Robin Lee Powell wrote: We've got 3 machines with 3.2T, 4.2T, and 851G of backups, all gathered via rsync over ssh *across the network between distant data centers* (the backups are in a totally different location than the servers), each server with 150+ machines to backup every day... and it's actually working. Backup server is in DC, servers it's backing up in Miami, it turns out. -Robin -- http://singinst.org/ : Our last, best hope for a fantastic future. Lojban (http://www.lojban.org/): The language in which this parrot is dead is ti poi spitaki cu morsi, but this sentence is false is na nei. My personal page: http://www.digitalkingdom.org/rlp/ -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Why does my rsync backup takes 7 hours?
On 09/15 04:49 , Les Mikesell wrote: Perhaps you could start a run manually when going to lunch or some other known slack time. Or maybe the bulk of files could be moved to an always-on server and mapped back to this machine for access. I have a couple of client locations where I use cron jobs to force a backup of people's laptops to take place at noon or whatever other time the user tends to go to lunch or a meeting. It's not a great solution, but it does work. Crashplan (http://b3.crashplan.com/landing/index.html) is kind of nice in that it can automatically throttle its disk and CPU usage so the user isn't impacted as adversely as they would be by backuppc. (One can set up a bandwidth limit in rsync, but it's not dynamic according to available cycled). -- Carl Soderstrom Systems Administrator Real-Time Enterprises www.real-time.com -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Why does my rsync backup takes 7 hours?
On Tue, Sep 21, 2010 at 2:19 PM, Carl Wilhelm Soderstrom chr...@real-time.com wrote: On 09/15 04:49 , Les Mikesell wrote: Perhaps you could start a run manually when going to lunch or some other known slack time. Or maybe the bulk of files could be moved to an always-on server and mapped back to this machine for access. I have a couple of client locations where I use cron jobs to force a backup of people's laptops to take place at noon or whatever other time the user tends to go to lunch or a meeting. It's not a great solution, but it does work. Crashplan (http://b3.crashplan.com/landing/index.html) is kind of nice in that it can automatically throttle its disk and CPU usage so the user isn't impacted as adversely as they would be by backuppc. (One can set up a bandwidth limit in rsync, but it's not dynamic according to available cycled). Does cygwin support 'nice' levels[1]? Or maybe even 'ionice'[2]? That may be one way of keeping the user from feeling the backup load. Richard [1] http://linux.about.com/library/cmd/blcmdl1_nice.htm [2] http://friedcpu.wordpress.com/2007/07/17/why-arent-you-using-ionice-yet/ -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Jeff, script question (was Re: How to run night manually?)
On Mon, Sep 20, 2010 at 11:08:17AM +0200, Sorin Srbu wrote: -Original Message- From: Robin Lee Powell [mailto:rlpow...@digitalkingdom.org] Sent: Monday, September 20, 2010 3:47 AM To: sorin.s...@orgfarm.uu.se; General list for user discussion, questions and support Subject: How to run night manually? On Fri, Sep 17, 2010 at 01:48:55PM +0200, Sorin Srbu wrote: Wasn't there a gotcha' running the nightly cleanup manually? Was there? I'd very much like to hear about it. What's the right way to do that? I based my comment on the warning(s) given in the http://sourceforge.net/apps/mediawiki/backuppc/index.php?title=How_to_delete_backups wiki article. You might find more articles of use to you on http://sourceforge.net/apps/mediawiki/backuppc/index.php?title=Special%3ASearchsearch=BackupPC_nightlygo=Go. Oooh, http://sourceforge.net/apps/mediawiki/backuppc/index.php?title=BackupPC_FixLinks looks very nifty! My question is (for Jeff, really): when you run nightly via the server like that, does it respect MaxBackupPCNightlyJobs and BackupPCNightlyPeriod ? I wanted to force a do everything, please run. -Robin -- http://singinst.org/ : Our last, best hope for a fantastic future. Lojban (http://www.lojban.org/): The language in which this parrot is dead is ti poi spitaki cu morsi, but this sentence is false is na nei. My personal page: http://www.digitalkingdom.org/rlp/ -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
