I'm still confused on what you meant about the migration system and the
different digests available. I'd suggest some kind of converter if you are
allowing us to change the digest as that could cause a lot of issues and some
people might do it the md5 way and then get a hardware-based SHA
I went way off-topic in asking about the pool and would like a moderator to
move the last few posts since mine into another topic if possible please.
Thanks Les for answering those questions. I guess it makes more sense, but it's
not completely apparently what all is going on from what you
Les Mikesell wrote:
Saturn2888 wrote:
I actually do have DDNS setup, but it's based on my DHCP server and that
doesn't tell it, if the machine connected on Wi-Fi, to prioritize the DNS
name hostname.local to 192.168.0.12 instead of 192.168.0.13. The easiest
way to do any
Is there a way to add compression to BackupPC backups using Rsyncd without
having to using a VPN or by somehow enabling SSH compression? My wireless
machines are taking anywhere from six to ten times as long to backup since I
switched from Samba to Rsyncd which means they're backing up in
I'm pretty sure, when using Rsync, this is done automatically. Secondly,
there's a way to fill in your incrementals and make them no-longer dependent on
the full backups.
+--
|This was sent by saturn2...@gmail.com via Backup
I am listing the observations and complaints of mine after using BackupPC for 5
months. My system is running Ubuntu Hardy and has been kept up with the latest
updates and patches. I upgraded from 3.0.0 to 3.1.0 within my first few months
and have kept this computer solely a BackupPC machine.
',
'/home/dan/excludes',
'/home/ddr/logs/',
'/home/sokg/logs/',
'/home/saturn2888/logs/',
'/umkcddr.com/extg',
'/Program Files (x86)/Electronic Arts/Burnout(TM) Paradise The Ultimate
Box/*',
'/Folders/Learn Japanese',
'/Folders/zhid-e'
]
};
I've already factored in growing
',
'/home/dan/excludes',
'/home/ddr/logs/',
'/home/sokg/logs/',
'/home/saturn2888/logs/',
'/umkcddr.com/extg',
'/Program Files (x86)/Electronic Arts/Burnout(TM) Paradise The Ultimate
Box/*',
'/Folders/Learn Japanese',
'/Folders/zhid-e'
]
};
I've already factored in growing
I've seen so many things on the mailing list. I don't know how to respond, what
program to use if any, if there's some special way to keep track. Think of if
you've never come across a forum before. Someone would have to teach you how to
use it. This is the same thing. Pointing me to where a
Since it was mentioned before, here's iostat:
Every 2.0s: iostat
Fri Apr 23 05:34:51 2010
Linux
The web server is the one thing that's ever seemingly been fast. There's never
a problem so long as I use it.
+--
|This was sent by saturn2...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
Les Mikesell wrote:
Saturn2888 wrote:
Since it was mentioned before, here's iostat:
Every 2.0s: iostat
I was gonna put it on 2x400GB in RAID0 and having that data backed up on
another rig but didn't think that'd be such a good idea.
As an update, while my graphs haven't updated, my pool info is back! I realized
the extra 100GB was from the new files I wanted to start backing up so that
You need Rsync 3.0.6-1, 3.0.7-1 crashes in all my uses of it.
+--
|This was sent by saturn2...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
Use this as the root directory: http://badmarkup.com/backuppc/
Note, full-backups of laptops or netbooks are done using 100Mbits wired
Ethernet links, everything else is under 802.11g.
Since I can't upload any, here's my most-recent pic of the Host Summary screen.
As you can see, the smallest
Hey Les, after putting that checksum stuff in, I get a lot of errors which say
verified cached digest. To me that's not an error, that's a good thing right?
+--
|This was sent by saturn2...@gmail.com via Backup Central.
If that's the case, other computers would show the error too but they do not.
It's only that one PC that has 'em. It shows 139 errors for the last full
whereas the ones before had around 24. The previous fulls used to have a lot of
errors as well, but only because files were vanishing such
I've been reading a lot. Apparently Rsync over Cygwin or anything using those
DLLs hangs. I haven't yet felt like upgrading my memory for money reasons, but
I'm wondering if I should include the -W or --whole-file into the Rsync options
for backups. From what I read online, a lot of Windows
Correctioni, it took 8 hours for the full, and as you can see in
http://badmarkup.com/backuppc/majin.png, almost all of the files were already
backed up before.
+--
|This was sent by saturn2...@gmail.com via Backup Central.
I don't understand. Which DLLs and what versions? I use DeltaCopy and can't
imagine why I'd not need Rsyncd. Are you saying use it over mounted Samba
shares, or you're telling me to use SSH?
In DeltaCopy, I'm able to just pop in compatible Cygwin DLL files. Cygwin
itself is far too bulky and
Yeah, but with version of the DLL is the newest one in this case that solves
it? I refuse to install Cygwin, but I also can't seem to find that DLL on this
page: ftp://sourceware.org/pub/cygwinports/.
I would still need Cygwin to run an SSH server right or would I just use some
form of PuTTY?
The $100-worth of writes lowering the life of my SSD for features I don't ever
need nor will ever use in Windows ooor I find someone that has it installed or
could find the DLL and links me :P since I really only need cygwin1.dll. The
cwRsync one is from 1.7.2 which I believe is the version I
Yeah, I know that. That's why I keep saying, I need the DLL somehow to test if
it will fix this.
+--
|This was sent by saturn2...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
So after installing Cygwin into my RAID of hard drives and waiting the forever
it took, I finally have a cygwin1.dll. I gave up looking through those tar.bz2
files for it.
The cwRsync package had the same old 1.7.2 version of the DLL I already got in
February not the one being proposed.
The
Well I do have a Linux AD server. I also have a WinServer2008R2 for 6 months,
but it's having issues connecting into the domain for whatever reason. I was
referring to the SSH encryption. I don't recall Samba using encryption for file
transfers, just for user/pass, maybe even just pass.
Are
Raman Gupta's suggetion was definitely the best. Should Rsync copy files in
alphabetical order, than you can imagine how far you are by judging what's on
the drive. Right now BackupPC is in the /Windows folder in one of my machines.
Since there are a ton of itty bitty files in there, usually
I've had it happen to me, then 6 hours later it's like backup failed,
disconnection or something. I think there's a timeout issue in some cases. Was
yours really still working or did it eventually time out?
+--
|This was sent
Sorin, with your setup, VLANs don't seem out of the question.
In another case, I seem to be figuring out more and more why my machines are
taking so long, Windows and Linux ones included. This PC started backing up
over 8 hours ago. I looked at the PID, nothing. I looked at the Xfer PID,
Ah, you used OpenVPN. I backup a host using that too but over the Internet. Did
the freezing up stop?
+--
|This was sent by saturn2...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
So what's the maximum amount of incrementals I should do then? For wireless
devices it's best to keep it going and let the server handle the rest, for my
wired computers, I'm assuming anywhere from 6-8 is plenty and I should probably
not do more than that.
Yeah, that's what I meant, depth, not number. There are very few changes to
most of my systems, what does change are the file folders I'm backing up on my
main rig. Those files change daily, but not all of them of course. What are
your thoughts? Probably less level changes are good if there
Meh it's okay. I'd still like a feature like this, but I've never gotten a DNS
server to apply multiple IPs to a hostname sadly, only the other way around. Oh
well.
+--
|This was sent by saturn2...@gmail.com via Backup
:: INTRO ::
I've been really curious about a few things on backing up the backup because
I've been doing it for a while from an ext3 filesystem for a zfs one and have
noticed quite a few issues especially when my zfs drive suddenly filled up and
rm -rv pc/blah would give me immediate feedback
I would do successive incrementals, but only if the same exact files aren't
changing each time. For instance, successive incrementals do not benefit you if
files X changed today, and it changes tomorrow, and it changes the next day
only if file X is the file that chances the most.
If file X
I forgot to add, my rsync command also has --delete.
+--
|This was sent by saturn2...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
Your method is fine. I don't think it will be fast enough though. 5GB of daily
changes you said? You don't wanna do those all at once. My recommendation is
first, limit BackupPC to backing up a maximum of one host at a time. Second,
spread out the backups into multiple hosts. Instead of them
Add --checksum-seed=32761 and --inplace to your rsync arguments. I believe
those speed it up enough to notice.
+--
|This was sent by saturn2...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
@Josh Malone, what do you mean by that?
@Tyler J. Wagner, thanks! I'm gonna look at that article and see what I can do.
I haven't seen any numbers of the speed difference between LVM or no LVM so I
haven't yet used it. I'm wanting to make sure enabling LVM doesn't screw up my
current speed
Can't I just dd the entire partition or that one directory into a file?
+--
|This was sent by saturn2...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
Well BackupPC only runs in Linux I thought. I'm running BackupPC in Linux, the
zfs filesystem I'm copying this stuff to in an embedded FreeBSD 7.3. I say
embedded bc the OS is read-only and most of the normal functionality is missing
such as ports.
Over 4 hours for just hosts A through D, not even all the way to Z.
+--
|This was sent by saturn2...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
Things are changing. What I'm hoping for it that I can capture whatever I can.
I used to have a 700GB pool which is now only 366GB after I got rid of things I
don't need snapshots for (music, pictures, installer files). It still takes
freakin' forever though! Just deleting the files, which I'm
Well it might not be faster for BackupPC, that's for sure. I've gone ahead and
removed that part of it.
+--
|This was sent by saturn2...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
It's disk write speed which has always plagued rsync in my opinion. Normally
nearly none of my Gigabit network bandwidth is in use. I've even changed out
all the CAT5 and CAT5e cables to CAT6 to no avail so it's definitely disk
performance. As it stated though, it might actually make
So would it just turn it off automatically or did I screw things up?
+--
|This was sent by saturn2...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
there.
Les Mikesell wrote:
On 7/6/2010 11:57 AM, Saturn2888 wrote:
So would it just turn it off automatically or did I screw things up?
http://search.cpan.org/~cbarratt/File-RsyncP-0.68/lib/File/RsyncP.pm
doesn't show --inplace as an option, so I'd guess it doesn't do anything
Ah, good point! Hmm... I wonder about -z (--compress) then because when I've
turned that on for testing, it ran the same rsync job for days and did not
finish on any clients. I wonder if anyone's added it successfully not that
you'd ever need or want to.
I shrunk an ext3 partition and dd'd it over into an LVM2 partition on a Linux
Software RAID1 then I moved the /var/lib/backuppc out and deleted the rest of
the drive contents bc I'd already copied those manually. Then I upgraded the
file system to ext4 by doing some kinda tune2fs commands to
Not gigabytes, it was megabytes, but after searching this, either those files
never did get backed up or something else happened to them. Strangely, even
through all of this the pool size has only grown 3GB since I first turned it on
again. I'm very confused.
Missing files should lower the
An update, it's doing it now for newer files too and my log files are only
growing in size. What's with ext4? Is there a way to check if something's amok?
Fsck says the file system is clean.?
Saturn2888 wrote:
Not gigabytes, it was megabytes, but after searching this, either those files
Can't wait to find a backport for Lucid :)
+--
|This was sent by saturn2...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--
)
failed
2010-07-28 02:40:03 ERROR: opendir
(/var/lib/backuppc/pc/main/173/ffull-drive/fusr/flib/fperl5/fauto/fText/fCSV_XS)
failed
Saturn2888 wrote:
An update, it's doing it now for newer files too and my log files are only
growing in size. What's with ext4? Is there a way to check
.
Regards,
Tyler
On Wednesday 04 Aug 2010 14:53:38 Saturn2888 wrote:
Can't wait to find a backport for Lucid :)
+--
|This was sent by Saturn2888 at gmail.com via Backup Central.
|Forward SPAM to abuse
On Wednesday 04 Aug 2010 14:53:38 Saturn2888 wrote:
Can't wait to find a backport for Lucid :)
+--
|This was sent by Saturn2888 at gmail.com via Backup Central.
|Forward SPAM to abuse at backupcentral.com
it was unmounted before the last shutdown, not that the
structure is correct. Use a -f to force a check anyway.
Bad RAM can cause this sort of problem too.
Les Mikesell wrote:
On 8/4/2010 8:57 AM, Saturn2888 wrote:
To make it easier for people to know what I'm talking about, here
place. Second
sets of data seem to show that stuff is missing, but I don't know for sure.
Stuff is definitely there now, but I don't know if it either did not get backed
up, got deleted, or had some strange inode problems when converting to ext4.
Saturn2888 wrote:
I don't think the RAM is bad
Craig Barratt wrote:
Saturn2888 writes:
To make it easier for people to know what I'm talking about, here are the
errors I'm getting in my logs. It's a bunch of things like these for
different folders on different hosts.
2010-07-28 02:40:03 ERROR: opendir
(/var/lib/backuppc/pc
Trey Nolen wrote:
And what about rsync3 support in File::RsyncP ?
There's progress. Most of my BackupPC work recently has been on 4.x,
the next major version. Several months ago there were various emails
about the architecture. Yes, it will support rsync 3.x and
I'm also assuming this means it'll be harder to access the data outside of
BackupPC itself as well.
Craig Barratt wrote:
Trey writes:
I should probably look back at the archives for this, but no
hardlinks? I thought that was the way the pool was able to save disk
space -- an
Sorry to be off-topic, but since you're bringing it up, can you link to it too
please?
Jeffrey J. Kosowsky wrote:
Saturn2888 wrote at about 16:17:30 -0400 on Friday, August 6, 2010:
I'm also assuming this means it'll be harder to access the data outside of
BackupPC itself as well
Logs are now anywhere from 16MB to 30MB. The problem is only growing, and I
don't know why. If those are rsync errors, why am I seeing them only since the
upgrade to Lucid? In parts of my findings, they're benign, but the log sizes
being that large even compressed is pretty scary since they
-fuse module
you're referring to. Personally, all I have is backuppc_ls, and I do not have a
link to it as I don't know where I got it.
Jeffrey J. Kosowsky wrote:
I believe I found it on the Wikki somewhere. If not google is your friend...
Saturn2888 wrote at about 03:42:24 -0400 on Monday
Naw, the excluding is working just fine. Those files popping up aren't
excluded. In one case they were, but I fixed that; it was just one entry which
was broken.
Les Mikesell wrote:
On 8/9/2010 12:27 PM, Saturn2888 wrote:
Logs are now anywhere from 16MB to 30MB. The problem is only
/2010 2:59 PM, Saturn2888 wrote:
Naw, the excluding is working just fine. Those files popping up aren't
excluded. In one case they were, but I fixed that; it was just one entry
which was broken.
So what do some of the other log entries say? And if they are from the
remote rsync
Your month's almost up. Be ready Mr.!
Tyler J. Wagner wrote:
If you do, post it here please. If you haven't within a month, I'll repackage
it myself.
Regards,
Tyler
On Wednesday 04 Aug 2010 14:53:38 Saturn2888 wrote:
Can't wait to find a backport for Lucid
know.
--b
On Sun, Aug 29, 2010 at 8:42 AM, Saturn2888 backuppc-forum at
backupcentral.com (backuppc-forum at backupcentral.com) wrote:
Your month's almost up. Be ready Mr.!
Tyler J. Wagner wrote:
If you do, post it here please. If you haven't within a month, I'll
, Saturn2888 backuppc-forum at
backupcentral.com (backuppc-forum at backupcentral.com) wrote:
I use Ubuntu Lucid on that machine so I don't know if it'd be compatible.
I'm also not really liking to test things when they're associated with my
backup machine, haha. Test is bad, working
I'm using the forums. I've checked back and forth and haven't seen any
attachments.
B. Alexander wrote:
It was attached to my last email in this thread.
--b
On Mon, Aug 30, 2010 at 8:58 AM, Saturn2888 backuppc-forum at
backupcentral.com (backuppc-forum at backupcentral.com) wrote
Pool is 388.93GB comprising 2139798 files and 4369 directories (as of
2010-09-19 02:38),
Pool file system was recently at 77% (2010-09-19 08:23)
But df -h shows:
/dev/mapper/vg-backuppc 576G 420G 128G 77% /var/lib/backuppc
The volume group is only for BackupPC's pool, nothing else.
There's
Try
apt-get purge backuppc
and see if that helps you.
Can someone explain to me why the post box is only 1 line tall?
+--
|This was sent by saturn2...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
For some reason I get the error unexpected response rsync version 3.0.7
protocol version 30. The first time I received this error was almost 6 days
ago. I haven't restarted the machine, nothing's happened. I have no clue what's
caused this.
Pedro M. S. Oliveira wrote:
Hi,
Did you do an update on you server/client?
If I'm not wrong that has to do with Perl Rsync module.
Cheers
Pedro Oliveira
From my android HD2 On 8 Oct 2010 08:50, Saturn2888 backuppc-forum at
backupcentral.com (backuppc-forum at backupcentral.com
I noticed this: *** System restart required *** so I restarted the system.
We'll see what happens.
+--
|This was sent by saturn2...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
Still doing it, but I also saw this:
r...@computer#58;~# rsync localhost#58;#58;
rsync#58; server sent rsyncnbsp; version 3.0.7nbsp; protocol version 30
rather than greeting
rsync error#58; error starting client-server protocol #40;code 5#41; at
main.c#40;1524#41; #91;Receiver=3.0.7#93;
I also found it might be some kinda protocol issue with SSH:
http://www.gearhack.com/Forums/DisplayComments.php?file=Computer/Linux/rsync_with_server_on_non-standard_SSH_port.
I tried -e rsh and it gave some kinda error about needing a key.
Anyone know anything about this?
r...@name:~# rsync r...@localhost::
rsync: server sent rsync version 3.0.7 protocol version 30 rather than
greeting
rsync error: error starting client-server protocol (code 5) at main.c(1524)
[Receiver=3.0.7]
I've been getting this same error for months now.
Saturn2888 wrote:
I'm guessing that rsyncd there is the user? Am I thinking something wrong
here? How in the world does this command even work?
No no, root is the user, then that means somehow rsyncd --daemon is the command
being used. Although, when I'm typing in the command line I'd just
Funny you posted this yesterday because I was actually looking in my e-mail
logs for a link to the thread. Apparently it was a mistake in xinetd. In
/etc/inetd.conf, I put rsync stream tcp nowait root /usr/bin/rsync --daemon
instead of rsync stream tcp nowait root /usr/bin/rsync rsyncd --daemon
How would I cpan install this one?
+--
|This was sent by saturn2...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--
I appreciate the warning, but then, what am I going to do about the error
messages having installed from aptitude?
+--
|This was sent by saturn2...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
Let's how they do :). I thought the script was something simple to put in there
and run.
+--
|This was sent by saturn2...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
Was the conclusion that you could or could not rsync a logical volume? And even
if so, what are the speeds to run checksums on a device and compare it with
another device? I've got an iSCSI target setup and had a few ideas, all of
which failed. Here are my findings on various methodologies or
How do you know it's not working? And how did you install those packages? Did
you configure BackupPC to have compression enabled?
+--
|This was sent by saturn2...@gmail.com via Backup Central.
|Forward SPAM to
Does running cmd /c before the command fix it? And did you replace the
DeltaCopy files with the newer ones? Because I did this myself, go to
http://badmarkup.com/deltacopy/ and pickup the four non-setup.exe files from
there and replace them in your DeltaCopy folder. That should update a lot of
Have or use bandwidth?
+--
|This was sent by saturn2...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--
But none of that solves the issue we're having now. How in the world do we
backup the current pool of data?
+--
|This was sent by saturn2...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
Les, that's a pretty good idea, running two, but I cannot do that with these
systems sadly. It'd be really nice to not have to take the machine down to do
the backup though. So I guess that's my question, I'm looking for a way to
backup the pool over Ethernet while it's running. Double twice
My goodness that's a lot of replies; although, almost all of them are from a
post I made a while back which I've elaborated on at least 3 times since.
The main point here that I'm trying to get across, at least for my own setup,
is that I cannot handle dd'ing 1TB/day. That would literally take
88 matches
Mail list logo
