Hi,
I've did the --stats thing:
Number of files: 1495981
Number of files transferred: 2944
Total file size: 201701039047 bytes
Total transferred file size:
613318155
bytes
Literal data:
613292255
bytes
Matched data: 25900 bytes
File list size: 24705311
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 118692
Total bytes received:
638195567
sent 118692 bytes received
638195567
bytes 154163.57 bytes/sec
total size is 201701039047 speedup is 315.99
This took a staggering 69 minutes, over a Gb connection,
useing rsync direcly (no ssh overhead)
To compare this, this is a similar backup, only this is an
ext3 filesystem over a 100 Mbit connection, using an ssh
shell:
Number of files: 6486854
Number of files transferred: 0
Total file size: 506568034168 bytes
Total transferred file size: 0 bytes
Literal data: 0 bytes
Matched data: 0 bytes
File list size: 153625912
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 335
Total bytes received: 153627330
sent 335 bytes received 153627330 bytes 419175.08
bytes/sec
total size is 506568034168 speedup is 3297.38
Total backup took 368 seconds.
Rsync took 368 seconds.
(I left the -q switch in this the first time... oeps, so
this is the second run. It took 1315 seconds (21 minutes)
the first time, transferring about 10.000 files).
Any ideas?
Kind regards,
Dirk
Op 3-4-2012 11:26, Eduardo Diaz - Gmail schreef:
For backup I use a local copy
using tar, but I use rsync too.
I don't compare but if you send any stadistics about
rsync we can said more information.
use rsync --stats
I don't note difernt speed, but did you make a
full rsync, and show --progress for see that file
it is going at what speed?
regards
On Mon, Apr 2, 2012 at 9:04
PM, Dirk Bonenkamp - ProActive
<d...@proactive.nl>
wrote:
Hi
All,
I'm currently testing a OCFS2 set-up, and I'm
having issues with
creating backups.
I have a 2 node cluster, running OCFS2 on a dual
primary DRBD device.
The file system is 3.7Tb of which 211 Gb is used:
about 1.5 million
files in 95 directories.
Everything works fine, except for the backups,
which are taking way more
time than on 'regular' file systems.
I'm using rsync for my backups. When I rsync the
file system above, this
takes more than an hour, without any modifications
to the file system.
Network / disk speed is good. I can rsync a 10 Gb
file from the OCFS2
filesystem to the same backup server with just
under 100 Mb/s.
I know there is some penalty to be expected from a
clustered file
system, but this is al lot. Rsyncing an ext3 file
system double the size
(in Mb's and files) of this file system takes
about 600 seconds...
Has anybody some advice on a backup strategy for
me? Or some tuning tips?
Thanks in advance,
Dirk
--
<http://www.proactive.nl>
T 023 - 5422299
F 023 - 5422728
www.proactive.nl
<http://www.proactive.nl>
_______________________________________________
Ocfs2-users mailing list
Ocfs2-users@oss.oracle.com
http://oss.oracle.com/mailman/listinfo/ocfs2-users
--
