[BackupPC-users] New versions of Shadowmountrsync with Windoze ACL and cygwin 1.7 support posted to Wiki
I have posted the latest versions of 'shadowmountrsync' and the
one-liner cmd.exe helper script 'shadowexec.cmd' to the Backuppc Wiki.
https://sourceforge.net/apps/mediawiki/backuppc/index.php?title=User_Scripts_-_Client_-_Windows_VSS
To paraphrase the Wiki:
Shadowmountrsync automatically sets up Window shadow copies, mounts
them, and launches the rsync daemon without requiring any special
configuration or changes to your existing (non-shadow) rsyncd.conf
script. It also cleanly unwinds all the above when you are done
rsyncing your files. As a result, you should now be able to back up
any (and all) files that are locked under Windows such as registry
files (e.g. ntuser.dat) and databases (e.g. Outlook).
The latest version of the script also optionally dumps gzipped
versions of the ACLs (either in 'getfacl' and/or 'subinacl' format)
for each drive for automatic inclusion in each share backup.
The latest version also includes a number of minor bug fixes and
extensions.
The Change Log is as follows:
0.4.0 Updated for new Cygwin which doesn't like Win32 paths
0.4.1 Allow arbitrary cygdrive path prefixes ${CYGDRIVEPREFIX}
0.4.5 Add option to backup ACL's on each volume pre shadow/rsync launch
Changed '--strict' option to '--expire' -- see details
Bug fixes, code cleanup, additional logging instrumentation
0.4.5.1 Added ability to backup ACLs using 'subinacl' in addition to 'getfacl'
If you have trouble downloading or using these scripts or if you find
bugs or have enhancement requests, please post to the BackupPC mailing
list and I will try to help.
More generally, feedback and bug reports are always welcome.
Jeff
--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now. http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backuppc/rsync fails to preserve/detect hard links on Windows
Jeffrey, I'm not sure what is going on here. But the example you show appears to show different files from the ones in /c/cygwin/usr/share/man/man1. The files you copied with rsync are: > ls -inl > total 184 > 1130522 -rw-r--r-- 2 501 501 78716 Jul 24 08:57 gawk.1 > 1130521 -rw-r--r-- 1 501 501 1160 Jul 24 08:57 igawk.1 > 1130522 -rw-r--r-- 2 501 501 78716 Jul 24 08:57 pgawk.1 but the BackupPC_attribPrint output shows that gawk.1 has size 78211 (vs 78716) and mode 0700 (vs 644). Is the BackupPC data coming from a different directory or host? Craig -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] TextFileWrite: Failed to verify /etc/BackupPC/config.pl.new
Michael writes: > TextFileWrite: Failed to verify /etc/BackupPC/config.pl.new > > in the browser under the main "Hosts Xfer etc" area. > > I check the filesystem and see the file re-created: > > # ll conf* > -rw-r- 1 backuppc apache 78506 Nov 10 12:24 config.pl > -rw-r- 1 backuppc apache 0 Nov 11 17:04 config.pl.new > -rw-r- 1 backuppc apache 76236 Apr 29 2009 config.pl.old > -rw-r- 1 backuppc apache 75640 Jul 4 2008 config.pl.pre-3.1.0 > -rw-r- 1 backuppc apache 76236 Jul 19 06:03 config.pl.pre-3.2.0beta0 > > It seems to me the software tries to verify the config.pl file but can't write > the file for some reason? (even though the file can be written to the disk?). > > It's a strange problem which I think one of the developers who has an > understanding of the process the "Save" takes would be able to help with. The writing steps for any text data file in BackupPC (eg: config.pl, backups, restores etc) is: - open config.new for writing - write the new file contents - close the file - open config.new for reading - read the contents - close the file - if the contents match, then rename config.pl to config.pl.old and rename config.pl.new to config.pl. - otherwise, print the error that you see and leave the config.pl.new file as is. Could the file system be full? Craig -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] TextFileWrite: Failed to verify /etc/BackupPC/config.pl.new
Hi Mathias, > Michael Mansour wrote: > > > Hi, > > > > Since updating to the latest BackupPC version, I've never really had to > > make a mod to the config via the web interface. > > > > Anyway, I just tried to and got the error in the subject: > > > > TextFileWrite: Failed to verify /etc/BackupPC/config.pl.new > > > > Checking the /etc/BackupPC directory I have: > > > > -rw-r- 1 backuppc apache 78507 Jul 19 06:04 config.pl > > -rw-r- 1 backuppc apache 0 Nov 10 12:19 config.pl.new > > -rw-r- 1 backuppc apache 76236 Apr 29 2009 config.pl.old > > -rw-r- 1 backuppc apache 75640 Jul 4 2008 config.pl.pre-3.1.0 > > -rw-r- 1 backuppc apache 76236 Jul 19 06:03 config.pl.pre-3.2.0beta0 > > > > so it seems to create the file but can't "verify" it? > > > > Any ideas how I can fix this? > > > > Thanks. > > > > Michael. > > > I run V3.1.0 and have no config.pl.new. Nevertheless, the file is empty. > Try to remove it. I've removed it. Go back into the Web interface, make a change, click "Save" and get the error: TextFileWrite: Failed to verify /etc/BackupPC/config.pl.new in the browser under the main "Hosts Xfer etc" area. I check the filesystem and see the file re-created: # ll conf* -rw-r- 1 backuppc apache 78506 Nov 10 12:24 config.pl -rw-r- 1 backuppc apache 0 Nov 11 17:04 config.pl.new -rw-r- 1 backuppc apache 76236 Apr 29 2009 config.pl.old -rw-r- 1 backuppc apache 75640 Jul 4 2008 config.pl.pre-3.1.0 -rw-r- 1 backuppc apache 76236 Jul 19 06:03 config.pl.pre-3.2.0beta0 It seems to me the software tries to verify the config.pl file but can't write the file for some reason? (even though the file can be written to the disk?). It's a strange problem which I think one of the developers who has an understanding of the process the "Save" takes would be able to help with. Maybe raise a bug report? Regards, Michael. > br > Matthias > -- > Don't Panic > > -- > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 > 30-Day trial. Simplify your report design, integration and > deployment - and focus on what you do best, core application coding. > Discover what's new with Crystal Reports now. > http://p.sf.net/sfu/bobj-july ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ --- End of Original Message --- -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Compression Issue
Excellent it looks that fixed it. That's kinda lame you can't just change the TopDir. Thanks for the help. Heath On Nov 10, 2009, at 2:00 PM, Les Mikesell wrote: > Heath Yob wrote: >> I've changed the TopDir to /CLIENTBACKUPS. >> >> pc and cpool directories are in there now. >> >> I'm getting a bunch of errors like this on my PC clients: >> 2009-11-10 13:26:55 BackupPC_link got error -4 when calling >> MakeFileLink > > If you install from the tarball, there is a configuration step where > you > can set any location you want. If you installed from a distribution > package (RPM/deb), that step has already been done and you can't > change > the TopDir - but you can mount or symlink a replacement: > > http://sourceforge.net/apps/mediawiki/backuppc/index.php?title=Change_archive_directory > > -- > Les Mikesell >lesmikes...@gmail.com > > -- > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 > 30-Day > trial. Simplify your report design, integration and deployment - and > focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ > -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] backup
cannot be used for xp take me off your mailing list please paul -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Compression Issue
Heath Yob wrote: > I've changed the TopDir to /CLIENTBACKUPS. > > pc and cpool directories are in there now. > > I'm getting a bunch of errors like this on my PC clients: > 2009-11-10 13:26:55 BackupPC_link got error -4 when calling MakeFileLink If you install from the tarball, there is a configuration step where you can set any location you want. If you installed from a distribution package (RPM/deb), that step has already been done and you can't change the TopDir - but you can mount or symlink a replacement: http://sourceforge.net/apps/mediawiki/backuppc/index.php?title=Change_archive_directory -- Les Mikesell lesmikes...@gmail.com -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backup fails after running 8-10 hours
Does it work with rsyncd? On Tue, Nov 10, 2009 at 2:28 PM, Nick Bright wrote: > The backup successfully completed with the "tar" method. > > Shawn Perry wrote: >> That sounds like a different sort of problem then. >> >> A deduplicator is a program that walks through a filesystem and finds >> identical files, and then hard links them together to save space. >> >> On Tue, Nov 10, 2009 at 12:57 PM, Nick Bright wrote: >>> Shawn Perry wrote: Did you use a disk deduplicator on the drive? Is there a directory with alot of files in it? How many files are you backing up? >>> Sorry, I'm not familiar with a "deduplicator". >>> >>> There aren't any directories with "a lot" of files any more than any of >>> the other systems I'm backing up. >>> >>> There are 202,984 files on the system. >>> If you have MANY hardlinks on a file system, rsync with the --hard-links option has a tendency to croak, leaving tar as the best option. >>> find / -printf "%n %i %p\n" | sort -nr >>> >>> Doesn't seem to indicate that there is an unusually large number of hard >>> links. The only stuff listed with a sizable amount of hard links appear >>> to be directories that are all system stuff that would exists on all >>> servers. >>> >>> The system itself is a cPanel hosting server, and hasn't had anything >>> special done to it. Let me put it this way - I didn't do anything to >>> knowingly create "a lot" of hardlinks. I'm sure there's some, but >>> probably not an unusually high number. >>> Dirvish has this same issue. To answer your question, find a directory or a couple of them that have a lot of files. run "ls -l" or "ls -lR" (the latter is recursive) in that directory. Look at the output. sample: -rw-r--r-- 79 shawn users 37888 2005-12-04 14:36 X-mas list.xls The first field after the permissions us the number of links to the data in that file, 79 in this case. That means there are 79 hard links to that file. There will always be at least one. >>> Similar to the output of my find command, which was telling me how many >>> hard links it found for each file/directory on the system. As I said, >>> nothing that seemed to unusual. >>> Shawn >>> You mentioned TAR being a better option on a system with lots of hard >>> links. I'll give that a try and see if it's able to perform a successful >>> backup. >>> >>> I will point out that I have a 2nd BackupPC server that is backing up a >>> *different* machine running the cPanel system, which has many, many, >>> many more files/domains on it; and that is successfully backing up. >>> >>> I'll also try backing the client in question up to said 2nd BackupPC >>> server and see if that works. >>> On Tue, Nov 10, 2009 at 10:05 AM, Nick Bright wrote: >> Shawn Perry wrote: >> Does this host have alot of hard links? >> > That's a good question that I have no idea how to answer. > > -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ >>> -- >>> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day >>> trial. Simplify your report design, integration and deployment - and focus >>> on >>> what you do best, core application coding. Discover what's new with >>> Crystal Reports now. http://p.sf.net/sfu/bobj-july >>> ___ >>> BackupPC-users mailing list >>> BackupPC-users@lists.sourceforge.net >>> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users >>> Wiki: http://backuppc.wiki.sourceforge.net >>> Project: http://backuppc.sourceforge.net/ >>> >> >> -- >> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day >> trial. Simplify your report design, integration and deployment - and focus on >> what you do best, core application coding. Discover what's new with >> Crystal Reports now. http://p.sf.net/sfu/bobj-july >> ___ >> BackupPC-users mailing list >> BackupPC-users@lists.sourceforge.net >> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users >> Wiki: http://backuppc.wiki.sourceforge.net >> Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Compression Issue
I've changed the TopDir to /CLIENTBACKUPS.
pc and cpool directories are in there now.
I'm getting a bunch of errors like this on my PC clients:
2009-11-10 13:26:55 BackupPC_link got error -4 when calling MakeFileLink
Thanks,
Heath
On Nov 10, 2009, at 8:55 AM, Les Mikesell wrote:
Heath Yob wrote:
According to my config.pl file : $Conf{CompressLevel} = '9';
So that's correct.
ppo-backup:/CLIENTBACKUPS# du -sh cpool/
12K cpool/
ppo-backup:/CLIENTBACKUPS# du -sm cpool/
1 cpool/
There's nothing in my cpool directory.
Does that /CLIENTBACKUPS directory mean that you've changed the
location
of the cpool or did you do an install-from-tarball there? And are
your
logs full of "can't link" error messages?
--
Les Mikesell
lesmikes...@gmail.com
--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008
30-Day
trial. Simplify your report design, integration and deployment - and
focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now. http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now. http://p.sf.net/sfu/bobj-july___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backup fails after running 8-10 hours
The backup successfully completed with the "tar" method. Shawn Perry wrote: > That sounds like a different sort of problem then. > > A deduplicator is a program that walks through a filesystem and finds > identical files, and then hard links them together to save space. > > On Tue, Nov 10, 2009 at 12:57 PM, Nick Bright wrote: >> Shawn Perry wrote: >>> Did you use a disk deduplicator on the drive? Is there a directory >>> with alot of files in it? How many files are you backing up? >> Sorry, I'm not familiar with a "deduplicator". >> >> There aren't any directories with "a lot" of files any more than any of >> the other systems I'm backing up. >> >> There are 202,984 files on the system. >> >>> If you have MANY hardlinks on a file system, rsync with the >>> --hard-links option has a tendency to croak, leaving tar as the best >>> option. >> find / -printf "%n %i %p\n" | sort -nr >> >> Doesn't seem to indicate that there is an unusually large number of hard >> links. The only stuff listed with a sizable amount of hard links appear >> to be directories that are all system stuff that would exists on all >> servers. >> >> The system itself is a cPanel hosting server, and hasn't had anything >> special done to it. Let me put it this way - I didn't do anything to >> knowingly create "a lot" of hardlinks. I'm sure there's some, but >> probably not an unusually high number. >> >>> Dirvish has this same issue. >>> >>> To answer your question, find a directory or a couple of them that >>> have a lot of files. run "ls -l" or "ls -lR" (the latter is >>> recursive) in that directory. Look at the output. >>> >>> sample: >>> >>> -rw-r--r-- 79 shawn users 37888 2005-12-04 14:36 X-mas list.xls >>> >>> The first field after the permissions us the number of links to the >>> data in that file, 79 in this case. That means there are 79 hard >>> links to that file. There will always be at least one. >> Similar to the output of my find command, which was telling me how many >> hard links it found for each file/directory on the system. As I said, >> nothing that seemed to unusual. >> >>> Shawn >>> >> You mentioned TAR being a better option on a system with lots of hard >> links. I'll give that a try and see if it's able to perform a successful >> backup. >> >> I will point out that I have a 2nd BackupPC server that is backing up a >> *different* machine running the cPanel system, which has many, many, >> many more files/domains on it; and that is successfully backing up. >> >> I'll also try backing the client in question up to said 2nd BackupPC >> server and see if that works. >> >>> >>> On Tue, Nov 10, 2009 at 10:05 AM, Nick Bright >>> wrote: > Shawn Perry wrote: > Does this host have alot of hard links? > That's a good question that I have no idea how to answer. >>> -- >>> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day >>> trial. Simplify your report design, integration and deployment - and focus >>> on >>> what you do best, core application coding. Discover what's new with >>> Crystal Reports now. http://p.sf.net/sfu/bobj-july >>> ___ >>> BackupPC-users mailing list >>> BackupPC-users@lists.sourceforge.net >>> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users >>> Wiki:http://backuppc.wiki.sourceforge.net >>> Project: http://backuppc.sourceforge.net/ >> -- >> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day >> trial. Simplify your report design, integration and deployment - and focus on >> what you do best, core application coding. Discover what's new with >> Crystal Reports now. http://p.sf.net/sfu/bobj-july >> ___ >> BackupPC-users mailing list >> BackupPC-users@lists.sourceforge.net >> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users >> Wiki:http://backuppc.wiki.sourceforge.net >> Project: http://backuppc.sourceforge.net/ >> > > -- > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report desig
Re: [BackupPC-users] Backup fails after running 8-10 hours
That sounds like a different sort of problem then. A deduplicator is a program that walks through a filesystem and finds identical files, and then hard links them together to save space. On Tue, Nov 10, 2009 at 12:57 PM, Nick Bright wrote: > Shawn Perry wrote: >> Did you use a disk deduplicator on the drive? Is there a directory >> with alot of files in it? How many files are you backing up? > > Sorry, I'm not familiar with a "deduplicator". > > There aren't any directories with "a lot" of files any more than any of > the other systems I'm backing up. > > There are 202,984 files on the system. > >> >> If you have MANY hardlinks on a file system, rsync with the >> --hard-links option has a tendency to croak, leaving tar as the best >> option. > > find / -printf "%n %i %p\n" | sort -nr > > Doesn't seem to indicate that there is an unusually large number of hard > links. The only stuff listed with a sizable amount of hard links appear > to be directories that are all system stuff that would exists on all > servers. > > The system itself is a cPanel hosting server, and hasn't had anything > special done to it. Let me put it this way - I didn't do anything to > knowingly create "a lot" of hardlinks. I'm sure there's some, but > probably not an unusually high number. > >> >> Dirvish has this same issue. >> >> To answer your question, find a directory or a couple of them that >> have a lot of files. run "ls -l" or "ls -lR" (the latter is >> recursive) in that directory. Look at the output. >> >> sample: >> >> -rw-r--r-- 79 shawn users 37888 2005-12-04 14:36 X-mas list.xls >> >> The first field after the permissions us the number of links to the >> data in that file, 79 in this case. That means there are 79 hard >> links to that file. There will always be at least one. > > Similar to the output of my find command, which was telling me how many > hard links it found for each file/directory on the system. As I said, > nothing that seemed to unusual. > >> >> Shawn >> > > You mentioned TAR being a better option on a system with lots of hard > links. I'll give that a try and see if it's able to perform a successful > backup. > > I will point out that I have a 2nd BackupPC server that is backing up a > *different* machine running the cPanel system, which has many, many, > many more files/domains on it; and that is successfully backing up. > > I'll also try backing the client in question up to said 2nd BackupPC > server and see if that works. > >> >> >> On Tue, Nov 10, 2009 at 10:05 AM, Nick Bright wrote: Shawn Perry wrote: Does this host have alot of hard links? >>> That's a good question that I have no idea how to answer. >>> >>> >> >> -- >> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day >> trial. Simplify your report design, integration and deployment - and focus on >> what you do best, core application coding. Discover what's new with >> Crystal Reports now. http://p.sf.net/sfu/bobj-july >> ___ >> BackupPC-users mailing list >> BackupPC-users@lists.sourceforge.net >> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users >> Wiki: http://backuppc.wiki.sourceforge.net >> Project: http://backuppc.sourceforge.net/ > > -- > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki: http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ > -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backup fails after running 8-10 hours
Shawn Perry wrote: > Did you use a disk deduplicator on the drive? Is there a directory > with alot of files in it? How many files are you backing up? Sorry, I'm not familiar with a "deduplicator". There aren't any directories with "a lot" of files any more than any of the other systems I'm backing up. There are 202,984 files on the system. > > If you have MANY hardlinks on a file system, rsync with the > --hard-links option has a tendency to croak, leaving tar as the best > option. find / -printf "%n %i %p\n" | sort -nr Doesn't seem to indicate that there is an unusually large number of hard links. The only stuff listed with a sizable amount of hard links appear to be directories that are all system stuff that would exists on all servers. The system itself is a cPanel hosting server, and hasn't had anything special done to it. Let me put it this way - I didn't do anything to knowingly create "a lot" of hardlinks. I'm sure there's some, but probably not an unusually high number. > > Dirvish has this same issue. > > To answer your question, find a directory or a couple of them that > have a lot of files. run "ls -l" or "ls -lR" (the latter is > recursive) in that directory. Look at the output. > > sample: > > -rw-r--r-- 79 shawn users 37888 2005-12-04 14:36 X-mas list.xls > > The first field after the permissions us the number of links to the > data in that file, 79 in this case. That means there are 79 hard > links to that file. There will always be at least one. Similar to the output of my find command, which was telling me how many hard links it found for each file/directory on the system. As I said, nothing that seemed to unusual. > > Shawn > You mentioned TAR being a better option on a system with lots of hard links. I'll give that a try and see if it's able to perform a successful backup. I will point out that I have a 2nd BackupPC server that is backing up a *different* machine running the cPanel system, which has many, many, many more files/domains on it; and that is successfully backing up. I'll also try backing the client in question up to said 2nd BackupPC server and see if that works. > > > On Tue, Nov 10, 2009 at 10:05 AM, Nick Bright wrote: >>> Shawn Perry wrote: >>> Does this host have alot of hard links? >>> >> That's a good question that I have no idea how to answer. >> >> > > -- > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day > trial. Simplify your report design, integration and deployment - and focus on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backup fails after running 8-10 hours
Did you use a disk deduplicator on the drive? Is there a directory with alot of files in it? How many files are you backing up? If you have MANY hardlinks on a file system, rsync with the --hard-links option has a tendency to croak, leaving tar as the best option. Dirvish has this same issue. To answer your question, find a directory or a couple of them that have a lot of files. run "ls -l" or "ls -lR" (the latter is recursive) in that directory. Look at the output. sample: -rw-r--r-- 79 shawn users 37888 2005-12-04 14:36 X-mas list.xls The first field after the permissions us the number of links to the data in that file, 79 in this case. That means there are 79 hard links to that file. There will always be at least one. Shawn On Tue, Nov 10, 2009 at 10:05 AM, Nick Bright wrote: >>Shawn Perry wrote: >> Does this host have alot of hard links? >> > > That's a good question that I have no idea how to answer. > > -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] UPDATED: Fully automated script for creating shadow copies a
Michael Stowe wrote: >> Michael Stowe wrote: >> Your scripts run within a normal user which is in admin group? >> My problem, what is inexplicable for me, is that the at command will work >> from a vista command box but not from a ssh-session. Even thought both >> use the same account. >> >> Did you have to "rebase" cygwin within Windows7? >> I tried cygwin within the release canditate but it wasn't stable. The >> cygwin >> newsgroup told me I have to rebase all within Windows7. >> >> br >> Matthias >> -- >> Don't Panic > > Yes, a normal Admin user -- I don't use ssh at all, nor a full version of > cygwin. > > It's documented here: http://www.goodjobsucking.com/?p=62 > > (There's a download link in there somewhere, if you're interested, but > you'll need your own version of vshadow.exe.) > Thanks Matthias -- Don't Panic -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backup fails after running 8-10 hours
> On Mon, Nov 9, 2009 at 4:57 PM, Nick Bright wrote: >> Les Mikesell wrote: >>> Nick Bright wrote: I've got a bit of a strange situation. My backuppc server, which successfully backs up a half dozen or so machines, is unable to backup one particular host. This host is configured the same as all of my other hosts which backup successfully, but after running the rsync process for 8 to 10 hours, the backup fails with this entry in the XferLOG: full backup started for directory / Running: /usr/bin/ssh -q -x -l root cpanel /usr/bin/rsync --server --sender --numeric-ids --perms --owner --group -D --links --hard-links --times --block-size=2048 --recursive --ignore-times . / Xfer PIDs are now 27778 Got remote protocol 1768191091 Fatal error (bad version): stdin: is not a tty >>> I'm not sure it if causes this symptom, but one thing to check is that >>> the remote shell for root can't output anything (like a >>> message-of-the-day) before starting the specified program. >>> >> Thank you for your reply. I checked in to it, and determined that there >> isn't anything being output by logging in to the backuppc system and "su >> backuppc" then "ssh r...@cpanel": >> >> [backu...@backuppc ~]$ ssh r...@cpanel >> Last login: Sat Sep 26 16:08:46 2009 from backuppc >> r...@cpanel [~]# >> >> However, I did find that /etc/motd existed and was empty. I deleted it >> to see what would happen on the next backup cycle. SSHing into the >> client system under a normal user also does not result in any MOTD's or >> warning messages. >> >> - Nick >> >Shawn Perry wrote: > Does this host have alot of hard links? > That's a good question that I have no idea how to answer. -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Compression Issue
Heath Yob wrote:
> According to my config.pl file : $Conf{CompressLevel} = '9';
>
> So that's correct.
>
> ppo-backup:/CLIENTBACKUPS# du -sh cpool/
> 12K cpool/
> ppo-backup:/CLIENTBACKUPS# du -sm cpool/
> 1 cpool/
>
> There's nothing in my cpool directory.
Does that /CLIENTBACKUPS directory mean that you've changed the location
of the cpool or did you do an install-from-tarball there? And are your
logs full of "can't link" error messages?
--
Les Mikesell
lesmikes...@gmail.com
--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now. http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Compression Issue
According to my config.pl file : $Conf{CompressLevel} = '9';
So that's correct.
ppo-backup:/CLIENTBACKUPS# du -sh cpool/
12K cpool/
ppo-backup:/CLIENTBACKUPS# du -sm cpool/
1 cpool/
There's nothing in my cpool directory.
Thanks,
Heath
On Nov 10, 2009, at 1:34 AM, Adam Goryachev wrote:
> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA1
>
> Matthias Meyer wrote:
>> Heath Yob wrote:
>>
>>> It appears that I'm not getting any compression on my backups at
>>> least
>>> with my Windows clients.
>>> I think my mac clients are being compressed since it's actually
>>> stating a compression level in the host summary.
>>>
>>> I have the compression level set to 9.
>>>
>>> I have the Compress::Zlib perl library installed.
>>>
>>> ppo-backup:/home/heathy# perl -MCompress::Zlib -e "print \"Module
>>> installed.\\n\";"
>>> Module installed.
>>>
>>> Is there a secret to SMB compression?
>>>
>>> Heath
>>>
>> I don't believe compression constraint on transport.
>> Do you have files in /var/lib/backuppc/pool?
>> Check your configuration:
>> grep CompressLevel /etc/backuppc/*.p
>
> Keep in mind two things:
> 1) As above, there is no compression on the network level
> 2) Only new files not already stored in the pool will be compressed
> on disk.
>
> To see if it is working, just see if there are any files being added
> to
> the cpool folder:
> du -sm $TopDir/cpool
>
> Regards,
> Adam
>
> -BEGIN PGP SIGNATURE-
> Version: GnuPG v1.4.9 (GNU/Linux)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
>
> iEYEARECAAYFAkr5M6sACgkQGyoxogrTyiWlCQCgkFnTb0kdxKTB6LovPFsIkmtY
> 2Z0AoMzWobVJBW592173MpwVjfHU8m1t
> =CV1D
> -END PGP SIGNATURE-
>
> --
> Let Crystal Reports handle the reporting - Free Crystal Reports 2008
> 30-Day
> trial. Simplify your report design, integration and deployment - and
> focus on
> what you do best, core application coding. Discover what's new with
> Crystal Reports now. http://p.sf.net/sfu/bobj-july
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now. http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
[BackupPC-users] Backuppc/rsync fails to preserve/detect hard links on Windows
For example, on Windows, the gawk.1 and pgawk.1 manpage are hard
linked as shown by 'ls':
$ls -i /c/cygwin/usr/share/man/man1/*gawk.1
844424930186282 /c/cygwin/usr/share/man/man1/gawk.1
844424930186283 /c/cygwin/usr/share/man/man1/igawk.1
844424930186282 /c/cygwin/usr/share/man/man1/pgawk.1
Running straight rsync preserves hard links as desired.:
$ rsync -avxXH -e "ssh -l kosowsky"
wincomputer:/cygdrive/c/cygwin/usr/share/man/man1/*gawk* .
receiving incremental file list
igawk.1
pgawk.1
gawk.1 => pgawk.1
$ ls -inl *gawk*
ls -inl
total 184
1130522 -rw-r--r-- 2 501 501 78716 Jul 24 08:57 gawk.1
1130521 -rw-r--r-- 1 501 501 1160 Jul 24 08:57 igawk.1
1130522 -rw-r--r-- 2 501 501 78716 Jul 24 08:57 pgawk.1
So rsync alone works.
However, BackupPC_attribPrint shows that all the gawk files are backed
up as regular files (type=0) rather than as special hard link types.
'igawk.1' => {
'uid' => 1005,
'mtime' => 1193390884,
'mode' => 33216,
'size' => 1160,
'sizeDiv4GB' => 0,
'type' => 0,
'gid' => 513,
'sizeMod4GB' => 1160
},
'gawk.1' => {
'uid' => 1005,
'mtime' => 1193390883,
'mode' => 33216,
'size' => 78211,
'sizeDiv4GB' => 0,
'type' => 0,
'gid' => 513,
'sizeMod4GB' => 78211
},
'pgawk.1' => {
'uid' => 1005,
'mtime' => 1196873396,
'mode' => 33216,
'size' => 78211,
'sizeDiv4GB' => 0,
'type' => 0,
'gid' => 513,
'sizeMod4GB' => 78211
}
Also, the mtimes are not the same. Not sure what is going on here...
Interestingly it works when backing up a Linux server over rsync...
On a linux machine backup I get:
'pgawk.1.gz' => {
'uid' => 0,
'mtime' => 1171288387,
'mode' => 33188,
'size' => 25099,
'sizeDiv4GB' => 0,
'type' => 1,
'gid' => 0,
'sizeMod4GB' => 25099
'gawk.1.gz' => {
'uid' => 0,
'mtime' => 1171288387,
'mode' => 164260,
'size' => 25099,
'sizeDiv4GB' => 0,
'type' => 0,
'gid' => 0,
'sizeMod4GB' => 25099
'igawk.1.gz' => {
'uid' => 0,
'mtime' => 1171288387,
'mode' => 33188,
'size' => 657,
'sizeDiv4GB' => 0,
'type' => 0,
'gid' => 0,
'sizeMod4GB' => 657
},
Here we have type=1 appropriately for one of the files and the mtimes
are the same. So with Linux it seems to be working right...
Any idea what might be going on here
--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now. http://p.sf.net/sfu/bobj-july
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Compression Issue
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Matthias Meyer wrote: > Heath Yob wrote: > >> It appears that I'm not getting any compression on my backups at least >> with my Windows clients. >> I think my mac clients are being compressed since it's actually >> stating a compression level in the host summary. >> >> I have the compression level set to 9. >> >> I have the Compress::Zlib perl library installed. >> >> ppo-backup:/home/heathy# perl -MCompress::Zlib -e "print \"Module >> installed.\\n\";" >> Module installed. >> >> Is there a secret to SMB compression? >> >> Heath >> > I don't believe compression constraint on transport. > Do you have files in /var/lib/backuppc/pool? > Check your configuration: > grep CompressLevel /etc/backuppc/*.p Keep in mind two things: 1) As above, there is no compression on the network level 2) Only new files not already stored in the pool will be compressed on disk. To see if it is working, just see if there are any files being added to the cpool folder: du -sm $TopDir/cpool Regards, Adam -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.9 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkr5M6sACgkQGyoxogrTyiWlCQCgkFnTb0kdxKTB6LovPFsIkmtY 2Z0AoMzWobVJBW592173MpwVjfHU8m1t =CV1D -END PGP SIGNATURE- -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Compression Issue
Heath Yob wrote: > It appears that I'm not getting any compression on my backups at least > with my Windows clients. > I think my mac clients are being compressed since it's actually > stating a compression level in the host summary. > > I have the compression level set to 9. > > I have the Compress::Zlib perl library installed. > > ppo-backup:/home/heathy# perl -MCompress::Zlib -e "print \"Module > installed.\\n\";" > Module installed. > > Is there a secret to SMB compression? > > Heath > I don't believe compression constraint on transport. Do you have files in /var/lib/backuppc/pool? Check your configuration: grep CompressLevel /etc/backuppc/*.p br Matthias -- Don't Panic -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] TextFileWrite: Failed to verify /etc/BackupPC/config.pl.new
Michael Mansour wrote: > Hi, > > Since updating to the latest BackupPC version, I've never really had to > make a mod to the config via the web interface. > > Anyway, I just tried to and got the error in the subject: > > TextFileWrite: Failed to verify /etc/BackupPC/config.pl.new > > Checking the /etc/BackupPC directory I have: > > -rw-r- 1 backuppc apache 78507 Jul 19 06:04 config.pl > -rw-r- 1 backuppc apache 0 Nov 10 12:19 config.pl.new > -rw-r- 1 backuppc apache 76236 Apr 29 2009 config.pl.old > -rw-r- 1 backuppc apache 75640 Jul 4 2008 config.pl.pre-3.1.0 > -rw-r- 1 backuppc apache 76236 Jul 19 06:03 config.pl.pre-3.2.0beta0 > > so it seems to create the file but can't "verify" it? > > Any ideas how I can fix this? > > Thanks. > > Michael. > I run V3.1.0 and have no config.pl.new. Nevertheless, the file is empty. Try to remove it. br Matthias -- Don't Panic -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
