Brendan Simon wrote: > I need to really speed up my backup of Linux boxes/directories !!! > I'm using ssh/rsync to do Linux backups. As an example (see end for > more details): > > * a backup of a 22.6GB Linux directory is taking 2037 minutes (34 > hours = 1.4 days). > * a backup of a 131.4GB WinXP directory is taking 1245 minutes (21 > hours = 0.87 days). > > > I thought rsync is supposed to be more efficient than a raw copy, but > obviously not. I'm presuming it is rsync that is issue here. > Would rsyncd improve the speed? > Maybe it would be faster with nfs/tar but I'm a little concerned about > security ? > > How can I get my Linux backups to be at least as fast as the Windows > backups. > > Thanks heaps, > Brendan.
your windows box has 1/10th the number of files - file size is a big driver in performance (rsync and smb) lost of small files = slow. If you compare apples to apples with the same data set rsync is usually faster if you have checksum caching on because it doesn't need to re-read the data on the server and it's not constrained by line speed. John > > > *A backup of a Linux home directory using ssh/rsync.* > > Backup# Type Filled Start Date Duration/mins Age/days > Server > Backup Path > 337 > <http://backup/backuppc/index.cgi?action=browse&host=chief-aegis&num=337> > full yes 11/17 10:22 2037.2 30.0 > /var/lib/backuppc/pc/chief-repo/337 > > > > > Totals Existing Files New Files > Backup# Type #Files Size/MB MB/sec #Files Size/MB > #Files Size/MB > 337 > <http://backup/backuppc/index.cgi?action=browse&host=chief-aegis&num=337> > full 1348171 22686.3 0.19 1347279 22611.0 > 1675 75.6 > > > > *A backup of a WinXP box using SMB.* > > Backup# Type Filled Start Date Duration/mins Age/days > Server > Backup Path > 113 > <http://backup/backuppc/index.cgi?action=browse&host=dell669&num=113> > full > yes 12/15 19:50 1254.4 1.6 /var/lib/backuppc/pc/dell669/113 > > > > Totals Existing Files New Files > Backup# Type #Files Size/MB MB/sec #Files Size/MB > #Files Size/MB > 113 > <http://backup/backuppc/index.cgi?action=browse&host=dell669&num=113> > full > 148560 131444.0 1.75 145423 128912.0 > 0.0 > > > > ------------------------------------------------------------------------ > > ------------------------------------------------------------------------- > SF.Net email is sponsored by: > Check out the new SourceForge.net Marketplace. > It's the best place to buy or sell services > for just about anything Open Source. > http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace > ------------------------------------------------------------------------ > > _______________________________________________ > BackupPC-users mailing list > [email protected] > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki: http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ > ------------------------------------------------------------------------- SF.Net email is sponsored by: Check out the new SourceForge.net Marketplace. It's the best place to buy or sell services for just about anything Open Source. http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace _______________________________________________ BackupPC-users mailing list [email protected] List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
