Hi, Les Mikesell wrote on 2013-04-12 15:05:27 -0500 [Re: [BackupPC-users] Stuck in a loop??????]: > On Fri, Apr 12, 2013 at 2:31 PM, Gregory Malsack > <gmals...@coastalacq.com> wrote: > > > > Been having problems with BackupPC backing up our primary storage server > > using rsync. It seems to run, but is taking a ridiculous long time, so I'm > > not sure if it's really working. [...] > > Thus with 2gb of bandwidth I wouldn't expect it to take hours on top of > > hours to backup 1.6tb...
really? I would. You don't mention how fast your storage system is, but a quick estimation gives me 4.66 hours at a sustained data rate of 100MB/s just to *read* the data from a source disk, and that is not doing anything with the data yet (filesystem overhead, calculate block checksums, build directory tree, network *latency* - raw throughput is not the whole story, compress files on the server, etc.). I doubt your bottleneck is the network, and that's the only thing you've given details on. 1.6 TB is a *lot* of data. You shouldn't forget that. > > [...] > > write(7, > > "x^\355\3201\1\0\0\0\302\240\365Om\f\37\210@a\300\200\1\3\6\f\0300`\300\200\1\3"..., > > 82371) = 82371 > > It does seem to be reading/writing the same blocks. We see the first few bytes of 80 KiB (for each syscall). That's not really much to base a comparison on. What would an rsync directory tree exchange look like? What does a normal data exchange look like? > Might be worth an fsck to see if the underlying filesystem is corrupted. That can't hurt in any case. > Or maybe the file it is working on holds some repeated > data. I haven't seen anything surprising so far. How long have you let it run? Does it complete eventually if you just give it a few days? Regards, Holger ------------------------------------------------------------------------------ Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account! http://www2.precog.com/precogplatform/slashdotnewsletter _______________________________________________ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
