Try if are a problem of try rsync or a copy try cp and see if the size are difernt.
try too rsyncd in the server or rsynd in the other side. "do you has similar results?" make a fsck of ocfs2 system for discard errors On Tue, Apr 3, 2012 at 8:37 PM, Dirk Bonenkamp - ProActive < d...@proactive.nl> wrote: > Hi, > > I've did the --stats thing: > > Number of files: 1495981 > Number of files transferred: 2944 > Total file size: 201701039047 bytes > Total transferred file size: 613318155 bytes > Literal data: 613292255 bytes > Matched data: 25900 bytes > File list size: 24705311 > File list generation time: 0.001 seconds > File list transfer time: 0.000 seconds > Total bytes sent: 118692 > Total bytes received: 638195567 > > sent 118692 bytes received 638195567 bytes 154163.57 bytes/sec > total size is 201701039047 speedup is 315.99 > > This took a staggering 69 minutes, over a Gb connection, useing rsync > direcly (no ssh overhead) > > To compare this, this is a similar backup, only this is an ext3 filesystem > over a 100 Mbit connection, using an ssh shell: > > Number of files: 6486854 > Number of files transferred: 0 > Total file size: 506568034168 bytes > Total transferred file size: 0 bytes > Literal data: 0 bytes > Matched data: 0 bytes > File list size: 153625912 > File list generation time: 0.001 seconds > File list transfer time: 0.000 seconds > Total bytes sent: 335 > Total bytes received: 153627330 > > sent 335 bytes received 153627330 bytes 419175.08 bytes/sec > total size is 506568034168 speedup is 3297.38 > Total backup took 368 seconds. > Rsync took 368 seconds. > > (I left the -q switch in this the first time... oeps, so this is the > second run. It took 1315 seconds (21 minutes) the first time, transferring > about 10.000 files). > > Any ideas? > > Kind regards, > > Dirk > > > Op 3-4-2012 11:26, Eduardo Diaz - Gmail schreef: > > For backup I use a local copy using tar, but I use rsync too. > > I don't compare but if you send any stadistics about rsync we can said > more information. > > use rsync *--stats > > I don't note difernt speed, but did you make a full rsync, and show > --progress for see that file it is going at what speed? > > regards > * > > On Mon, Apr 2, 2012 at 9:04 PM, Dirk Bonenkamp - ProActive < > d...@proactive.nl> wrote: > >> Hi All, >> >> I'm currently testing a OCFS2 set-up, and I'm having issues with >> creating backups. >> >> I have a 2 node cluster, running OCFS2 on a dual primary DRBD device. >> >> The file system is 3.7Tb of which 211 Gb is used: about 1.5 million >> files in 95 directories. >> >> Everything works fine, except for the backups, which are taking way more >> time than on 'regular' file systems. >> >> I'm using rsync for my backups. When I rsync the file system above, this >> takes more than an hour, without any modifications to the file system. >> >> Network / disk speed is good. I can rsync a 10 Gb file from the OCFS2 >> filesystem to the same backup server with just under 100 Mb/s. >> >> I know there is some penalty to be expected from a clustered file >> system, but this is al lot. Rsyncing an ext3 file system double the size >> (in Mb's and files) of this file system takes about 600 seconds... >> >> Has anybody some advice on a backup strategy for me? Or some tuning tips? >> >> Thanks in advance, >> >> Dirk >> >> -- >> <http://www.proactive.nl> >> T 023 - 5422299 >> F 023 - 5422728 >> >> www.proactive.nl <http://www.proactive.nl> >> >> >> >> _______________________________________________ >> Ocfs2-users mailing list >> Ocfs2-users@oss.oracle.com >> http://oss.oracle.com/mailman/listinfo/ocfs2-users >> > > > -- > <http://www.proactive.nl> > > T 023 - 5422299 F 023 - 5422728 www.proactive.nl >
<<signature.gif>>
_______________________________________________ Ocfs2-users mailing list Ocfs2-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs2-users
