Re: rsycing very small files
On 27-Feb-2009, at 21:16, Daniel.Li wrote: On Fri, 2009-02-27 at 08:20 -0500, Mag Gam wrote: it works. But takes hours to do it. Was wondering if there was a faster way How much speed do u get to backup these files? Average? I would thing that rsync 3.x would make a large difference on the speed. Are you using 2.6.9 or something? -- In the velvet darkness of the the blackest night Burning bright There's a guiding star -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsycing very small files
lewis butler wrote: On 27-Feb-2009, at 21:16, Daniel.Li wrote: On Fri, 2009-02-27 at 08:20 -0500, Mag Gam wrote: it works. But takes hours to do it. Was wondering if there was a faster way How much speed do u get to backup these files? Average? I would thing that rsync 3.x would make a large difference on the speed. Are you using 2.6.9 or something? Try the -z option if it's across a slow network and not using ssh. (With ssh, -z should make little difference.) Or try not using the -z option :-) -- Jamie -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsycing very small files
Hi, On Sat, 28 Feb 2009, lewis butler wrote: On 27-Feb-2009, at 21:16, Daniel.Li wrote: On Fri, 2009-02-27 at 08:20 -0500, Mag Gam wrote: it works. But takes hours to do it. Was wondering if there was a faster way How much speed do u get to backup these files? Average? I would thing that rsync 3.x would make a large difference on the speed. Are you using 2.6.9 or something? Even with rsync-2.6.8 (SUSE SLES10) I see: Number of files: 5599821 Number of files transferred: 1164 Total file size: 4409434193460 bytes Total transferred file size: 2062944264 bytes Literal data: 1729055258 bytes Matched data: 333889006 bytes File list size: 180403610 File list generation time: 2121.930 seconds File list transfer time: 0.000 seconds Total bytes sent: 2083653 Total bytes received: 1910410098 sent 2083653 bytes received 1910410098 bytes 279175.79 bytes/sec total size is 4409434193460 speedup is 2305.59 end RC=0 090228.2127 090228.2331 with a duration of 2 hours 4 minutes. Viele Grüße Eberhard Mönkeberg (emoe...@gwdg.de, e...@kki.org) -- Eberhard Mönkeberg Arbeitsgruppe IT-Infrastruktur E-Mail: emoe...@gwdg.de Tel.: +49 (0)551 201-1551 - Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen (GWDG) Am Fassberg 11, 37077 Göttingen URL:http://www.gwdg.de E-Mail: g...@gwdg.de Tel.: +49 (0)551 201-1510Fax:+49 (0)551 201-2150 Geschäftsführer: Prof. Dr. Bernhard Neumair Aufsichtsratsvorsitzender: Dipl.-Kfm. Markus Hoppe Sitz der Gesellschaft: Göttingen Registergericht: Göttingen Handelsregister-Nr. B 598 --- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsycing very small files
On Fri 27 Feb 2009, Mag Gam wrote: I have to rsync 200k files which range in size from 5kb to 800kb. Is there an optimal way to do this using rsync? or shall I use tar for this? Just do it, there's no reason why it shouldn't work. Paul -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsycing very small files
it works. But takes hours to do it. Was wondering if there was a faster way On Fri, Feb 27, 2009 at 8:04 AM, Paul Slootman paul+rs...@wurtel.net wrote: On Fri 27 Feb 2009, Mag Gam wrote: I have to rsync 200k files which range in size from 5kb to 800kb. Is there an optimal way to do this using rsync? or shall I use tar for this? Just do it, there's no reason why it shouldn't work. Paul -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsycing very small files
1. On Fri, 2009-02-27 at 08:20 -0500, Mag Gam wrote: it works. But takes hours to do it. Was wondering if there was a faster way How much speed do u get to backup these files? Average? On Fri, Feb 27, 2009 at 8:04 AM, Paul Slootman paul+rs...@wurtel.net wrote: On Fri 27 Feb 2009, Mag Gam wrote: I have to rsync 200k files which range in size from 5kb to 800kb. Is there an optimal way to do this using rsync? or shall I use tar for this? Just do it, there's no reason why it shouldn't work. Paul -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- USI/SH RD Dept. Universal Scientific Industrial (Shanghai) Co., Ltd Fax: +86-21-58967931Tel: +86-21-58966996 ext. 1400 42th building, 1387 Zhang Dong road, Pudong New Area, Shanghai, P.R. China 201203 -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsycing very small files
On Fri, Feb 27, 2009 at 7:20 AM, Mag Gam magaw...@gmail.com wrote: it works. But takes hours to do it. Was wondering if there was a faster way http://rob.sun3.org/misc/parallelizing-rsync-processes/ -- RPM -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
