On 30/04/05, K. Shantanu <[EMAIL PROTECTED]> wrote: > * Binand Sethumadhavan <[EMAIL PROTECTED]> [050430 05:46]: > > I need to solve the problem of transferring about 250 MB of data > > across the Atlantic every few minutes. > > I too had a similar problem except the files needed to be transferred every > few hours I got it solved using rsync and even had wget (which is scriptable) > doing it. Maybe they can help you out. Even though I use download accelerators > in Windows I am not too comfortable with them.
Rsync and Wget are not download accelerators. Rsync is a synchronisation tool, and is really slow for pure file transfers. Wget does not multithread. For example, I can download a 250 MB file in 30-odd seconds using Axel with 20 threads (and a heavily tuned Apache at the server side), whereas wget takes about 8 minutes. I am now inclined to blame NFS now for my problems (my setup downloads onto an NFS mounted volume). I haven't seen many download corruptions when I try to download to the local disk. Perhaps it is a bug in the lseek() implementation on the NFS client (Linux) or server (EMC Celerra). Trying to figure out which is a big pain, since the corruption is very random and not at all consistently reproducible :( Binand ------------------------------------------------------- This SF.Net email is sponsored by: NEC IT Guy Games. Get your fingers limbered up and give it your best shot. 4 great events, 4 opportunities to win big! Highest score wins.NEC IT Guy Games. Play to win an NEC 61 plasma display. Visit http://www.necitguy.com/?r _______________________________________________ linux-india-help mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/linux-india-help
