Re: [BackupPC-users] When will backuppc begin pooling?

[Adam Goryachev]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Brian Woodworth wrote:
> That's unfortunate.  I can't just mount my array there as it is
> basically my NAS that use to store all of my media.  It sounds like I
> will have to go without pooling if I want to back up to another location
> other than /var/lib/backuppc

Actually, not quite, any of the following should work:
1) mkdir /media/backups;chown backuppc.backuppc /media/backups;mv
/var/lib/backuppc/* /media/backups/;ln -s /media/backups /var/lib/backuppc
This will put the pool, pc, etc dirs onto /media/backups, and then
symlink /var/lib/backuppc to /media/backups. This should work, without
needing to modify TopDir/etc... put them all back as they were. Just be
careful when upgrading the package it doesn't remove the symlink in the
future.

2) http://linux.die.net/man/8/mount
[quote]
Since Linux 2.4.0 it is possible to remount part of the file hierarchy
somewhere else. The call is
mount --bind olddir newdir

In your case: "mount --bind /media/backups /var/lib/backuppc"

I'm sure there are other methods as well, just search the mailing list,
the wiki, etc for TopDir

Hope that helps.

Regards,
Adam

- --
Adam Goryachev
Website Managers
www.websitemanagers.com.au
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAkmVJk0ACgkQGyoxogrTyiWRDgCgrwzvxPl2LfbrgS2xgirZqtLK
+6wAoLKlAeiP/EFkKehT3Lj1h/7wz/jU
=+EHm
-END PGP SIGNATURE-

--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Revamping the Wiki

[Craig Barratt]

Cody writes:

> I'd be willing to do a lot of the cleaning myself, though I don't want
> to step on anyone's toes without talking with you first. Also, my
> knowledge of BackupPC is fairly limited to my setup (XP/Vista clients &
> Ubuntu server).

I agree it isn't very well organized.  I don't think anyone has
been keeping up the overall structure.  I'd be happy for you to
make the changes you want.

Craig

--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] When will backuppc begin pooling?

[Nils Breunese (Lemonbit)]

Brian Woodworth wrote:

> That's unfortunate.  I can't just mount my array there as it is  
> basically my NAS that use to store all of my media.  It sounds like  
> I will have to go without pooling if I want to back up to another  
> location other than /var/lib/backuppc

You can bind mount your array on /var/lib/backuppc or use a symlink.

Nils Breunese.

--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] 38GB file backup is hanging backuppc (more info and more questions)

[Craig Barratt]

Tony writes:

> I missed the original post, but  I run rsync with the --whole-file
> option, but I still get RStmp files, is that not supposed to happen?

RStmp is a temporary file used to store the uncompressed pool file,
which is needed for the rsync algorithm.  It's only used for larger
files - smaller files are uncompressed in memory.

RStmp is independent of --whole-file.

Craig

--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] When will backuppc begin pooling?

[Brian Woodworth]

That's unfortunate.  I can't just mount my array there as it is basically my
NAS that use to store all of my media.  It sounds like I will have to go
without pooling if I want to back up to another location other than
/var/lib/backuppc

thanks to everyone who responded

On Thu, Feb 12, 2009 at 7:43 PM, Adam Goryachev <
mailingli...@websitemanagers.com.au> wrote:

> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA1
>
> Brian Woodworth wrote:
> > yes.  it is different than the install directory.  I configured backuppc
> > to use my RAID 6 array to store the backups, not the system drive.  The
> > full and incremental backups work fine.  It just looks like the links
> > aren't being made properly.
>
> Correct, because this is not a supported method of changing the location
> for backups.
>
> You should revert (undo) the changes you made so that the pool is
> configured for the default /var/lib/backuppc and then mount your raid 6
> array at /var/lib/backuppc.
>
> This will solve the problems you are having, and from your next backup,
> pooling will start to be used.
>
> Regards,
> Adam
>
> - --
> Adam Goryachev
> Website Managers
> www.websitemanagers.com.au
> -BEGIN PGP SIGNATURE-
> Version: GnuPG v1.4.9 (GNU/Linux)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
>
> iEYEARECAAYFAkmU7G8ACgkQGyoxogrTyiUpowCbBp+kLz4KkuAr7Tog2zrEVCu3
> vcMAoJxBRVmpqx17I7VrW6YPhF7ICGVN
> =5DtO
> -END PGP SIGNATURE-
>
>
> --
> Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco,
> CA
> -OSBC tackles the biggest issue in open source: Open Sourcing the
> Enterprise
> -Strategies to boost innovation and cut costs with open source
> participation
> -Receive a $600 discount off the registration fee with the source code:
> SFAD
> http://p.sf.net/sfu/XcvMzF8H
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>



-- 
Brian Woodworth
bwoodwo...@gmail.com
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] When will backuppc begin pooling?

[Adam Goryachev]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Brian Woodworth wrote:
> yes.  it is different than the install directory.  I configured backuppc
> to use my RAID 6 array to store the backups, not the system drive.  The
> full and incremental backups work fine.  It just looks like the links
> aren't being made properly.

Correct, because this is not a supported method of changing the location
for backups.

You should revert (undo) the changes you made so that the pool is
configured for the default /var/lib/backuppc and then mount your raid 6
array at /var/lib/backuppc.

This will solve the problems you are having, and from your next backup,
pooling will start to be used.

Regards,
Adam

- --
Adam Goryachev
Website Managers
www.websitemanagers.com.au
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAkmU7G8ACgkQGyoxogrTyiUpowCbBp+kLz4KkuAr7Tog2zrEVCu3
vcMAoJxBRVmpqx17I7VrW6YPhF7ICGVN
=5DtO
-END PGP SIGNATURE-

--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] When will backuppc begin pooling?

[Brian Woodworth]

yes.  it is different than the install directory.  I configured backuppc to
use my RAID 6 array to store the backups, not the system drive.  The full
and incremental backups work fine.  It just looks like the links aren't
being made properly.

On Thu, Feb 12, 2009 at 7:24 PM, Les Mikesell  wrote:

> Brian Woodworth wrote:
> > It was an ubuntu package install.
> >
> > The log file contains this error for what seems like every file backed
> up:
> > 2009-02-12 01:00:11 Running BackupPC_link localhost <
> http://hedgewig/backuppc/index.cgi?host=localhost> (pid=25713)
> >
> > 2009-02-12 01:00:11 BackupPC_link got error -4 when calling
> MakeFileLink(/media/array/backuppc/pc/localhost <
> http://hedgewig/backuppc/index.cgi?host=localhost>/3//attrib,
> 94cb73220b92105a18967289b38bfc94, 1)
> >
> >
> Ubuntu wouldn't have installed on /media/array/...   Is that a different
> filesystem?
>
> --
>  Les Mikesell
>   lesmikes...@gmail.com
>
>
> --
> Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco,
> CA
> -OSBC tackles the biggest issue in open source: Open Sourcing the
> Enterprise
> -Strategies to boost innovation and cut costs with open source
> participation
> -Receive a $600 discount off the registration fee with the source code:
> SFAD
> http://p.sf.net/sfu/XcvMzF8H
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>



-- 
Brian Woodworth
bwoodwo...@gmail.com
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] When will backuppc begin pooling?

[Les Mikesell]

Brian Woodworth wrote:
> It was an ubuntu package install.
>
> The log file contains this error for what seems like every file backed up:
> 2009-02-12 01:00:11 Running BackupPC_link localhost 
>  (pid=25713)
>
> 2009-02-12 01:00:11 BackupPC_link got error -4 when calling 
> MakeFileLink(/media/array/backuppc/pc/localhost 
> /3//attrib, 
> 94cb73220b92105a18967289b38bfc94, 1)
>
>   
Ubuntu wouldn't have installed on /media/array/...   Is that a different 
filesystem?

-- 
  Les Mikesell
   lesmikes...@gmail.com

--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] When will backuppc begin pooling?

[Brian Woodworth]

It was an ubuntu package install.

The log file contains this error for what seems like every file backed up:

2009-02-12 01:00:11 Running BackupPC_link localhost
 (pid=25713)
2009-02-12 01:00:11 BackupPC_link got error -4 when calling
MakeFileLink(/media/array/backuppc/pc/localhost
/3//attrib,
94cb73220b92105a18967289b38bfc94, 1)



On Thu, Feb 12, 2009 at 5:22 PM, Tino Schwarze wrote:

> On Thu, Feb 12, 2009 at 06:14:00PM -0600, Les Mikesell wrote:
> > Brian Woodworth wrote:
> > > The file system with the backups is ext3
> >
> > I think you have some other problem, then.  Is this a ubuntu-package
> > install or did you install it yourself from sourceforge?
>
> Next question: What's in BackupPC's log file?
>
> Tino.
>
> --
> "What we nourish flourishes." - "Was wir nähren erblüht."
>
> www.lichtkreis-chemnitz.de
> www.craniosacralzentrum.de
>
>
> --
> Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco,
> CA
> -OSBC tackles the biggest issue in open source: Open Sourcing the
> Enterprise
> -Strategies to boost innovation and cut costs with open source
> participation
> -Receive a $600 discount off the registration fee with the source code:
> SFAD
> http://p.sf.net/sfu/XcvMzF8H
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>



-- 
Brian Woodworth
bwoodwo...@gmail.com
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] When will backuppc begin pooling?

[Tino Schwarze]

On Thu, Feb 12, 2009 at 06:14:00PM -0600, Les Mikesell wrote:
> Brian Woodworth wrote:
> > The file system with the backups is ext3
> 
> I think you have some other problem, then.  Is this a ubuntu-package 
> install or did you install it yourself from sourceforge?

Next question: What's in BackupPC's log file?

Tino.

-- 
"What we nourish flourishes." - "Was wir nähren erblüht."

www.lichtkreis-chemnitz.de
www.craniosacralzentrum.de

--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] When will backuppc begin pooling?

[Les Mikesell]

Brian Woodworth wrote:
> The file system with the backups is ext3
> 

I think you have some other problem, then.  Is this a ubuntu-package 
install or did you install it yourself from sourceforge?

-- 
   Les Mikesell
lesmikes...@gmail.com


--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Revamping the Wiki

[Cody Dunne]

I should have said sunday at 12pm Eastern Time (GMT-5).

Cody

Cody Dunne wrote:
> Hello everyone,
> 
> I've been looking over the BackupPC wiki to find somewhere to integrate 
>   my own material, but it's in pretty bad shape. There's no consistent 
> structure or formatting, and I remember from my initial experience with 
> it that everything was very hard to find.
> 
> There is a proposed structure page 
> (http://backuppc.wiki.sourceforge.net/ProposedWikiStructure) but it is 
> fairly old, has no discussion, and it's suggestions are only partially 
> implemented.
> 
> I'd be willing to do a lot of the cleaning myself, though I don't want 
> to step on anyone's toes without talking with you first. Also, my 
> knowledge of BackupPC is fairly limited to my setup (XP/Vista clients & 
> Ubuntu server).
> 
> Who would be interested in a short meeting about this, say this Sunday 
> at 12pm via Skype or IRC? My username for both is edallme. Also, please 
> send any other suggestions you have to me or add them to the 
> ProposedWikiStructure wiki page/discussion.
> 
> Regards,
> Cody Dunne
> 
> 
> --
> Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
> -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
> -Strategies to boost innovation and cut costs with open source participation
> -Receive a $600 discount off the registration fee with the source code: SFAD
> http://p.sf.net/sfu/XcvMzF8H
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
> 

--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] When will backuppc begin pooling?

[Brian Woodworth]

Thank you so much for your very informative response.  When I run the
command: perldoc IO::Dirent, i get "No documentation found for "IO::Dirent""
so it seems it is not installed?

On Thu, Feb 12, 2009 at 3:41 PM, Chris Robertson  wrote:

> Brian Woodworth wrote:
> > Yes, I have complete backups.  My problem appears to be a known bug as
> > stated earlier in the thread.  Craig was kind enough to post a
> > solution, but the problem is I don't know how to go about following
> > his instructions.
> >
> > thanks for the response
> >
>
> First, try...
>
> perldoc IO::Dirent
>
> ...to see if you have the Dirent perl module installed.  If you get
> something like...
>
> No documentation found for "IO::Dirent".
>
> ...your problem probably lies elsewhere. If you get a documentation
> page, hit "q" to exit and run...
>
> locate Lib.pm
>
> ...to find all files with "Lib.pm" in their name on your system
> (hopefully your locatedb is up to date.  If not "updatedb" will probably
> update it).  You should find (at least) two...
>
> /some/path/lib/BackupPC/Lib.pm
> /some/path/lib/BackupPC/CGI/Lib.pm
>
> ...where /some/path is BackupPC's install path.  If you have more than
> two, don't continue.  Ask for further advise.  If you just have two, we
> want to modify the one NOT in the CGI directory*.  The following command
> (when run as root**, or the some other user authorized to modify the
> file) will update "/some/path/lib/BackupPC/Lib.pm" per Craig's
> instructions.  You should probably back up the file before running it...
>
> sed -i -e 's/\$IODirentOk = 1;/$IODirentOk = 0;/'
> /some/path/lib/BackupPC/Lib.pm
>
> ...and you should probably consult with someone else to make sure I know
> what I'm talking about and am not about to break your system
> (inadvertently or otherwise). :o)
>
> Chris
>
> * The command I used won't do anything to the Lib.pm in the CGI
> directory, but sed is a very powerful tool and, as such, should be
> treated with the utmost respect.
> ** Running commands you get from the Internet as root is inadvisable.
> sudo is not really much better.
>
>
> --
> Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco,
> CA
> -OSBC tackles the biggest issue in open source: Open Sourcing the
> Enterprise
> -Strategies to boost innovation and cut costs with open source
> participation
> -Receive a $600 discount off the registration fee with the source code:
> SFAD
> http://p.sf.net/sfu/XcvMzF8H
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>



-- 
Brian Woodworth
bwoodwo...@gmail.com
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] When will backuppc begin pooling?

[Brian Woodworth]

The file system with the backups is ext3

On Thu, Feb 12, 2009 at 3:37 PM, Les Mikesell  wrote:

> Brian Woodworth wrote:
> > Yes, I have complete backups.  My problem appears to be a known bug as
> > stated earlier in the thread.  Craig was kind enough to post a solution,
> > but the problem is I don't know how to go about following his
> instructions.
>
> I believe his fix only applied to systems installed on XFS file systems.
>  Is that what you are using?
>
>
> >  > > It looks like BackupPC_nightly is failing to traverse the pool.
> >  > > This could be due to a bug in IO::Dirent that causes it to fail
> >  > > on certain file systems.  There is a test in 3.1.0 to check if
> >  > > IO::Dirent works, but it checks ".", not $TopDir.  That bug is
> >  > > fixed in CVS.
> >  > >
> >  > > Do you have IO::Dirent installed and is your pool on XFS?
> >  > >
> >  > > If so, change this line in lib/BackupPC/Lib.pm:
> >  > >
> >  > >$IODirentOk = 1;
> >  > >
> >  > > to:
> >  > >
> >  > >$IODirentOk = 0;
>
> Just use a text editor to change that line and restart backuppc.  If you
> have a packaged install and don't know where the lib directory is, the
> command 'locate BackupPC/Lib.pm' should find the file.
>
> --
>   Les Mikesell
>lesmikes...@gmail.com
>
>
>
> --
> Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco,
> CA
> -OSBC tackles the biggest issue in open source: Open Sourcing the
> Enterprise
> -Strategies to boost innovation and cut costs with open source
> participation
> -Receive a $600 discount off the registration fee with the source code:
> SFAD
> http://p.sf.net/sfu/XcvMzF8H
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>



-- 
Brian Woodworth
bwoodwo...@gmail.com
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] When will backuppc begin pooling?

[Les Mikesell]

Brian Woodworth wrote:
> Yes, I have complete backups.  My problem appears to be a known bug as 
> stated earlier in the thread.  Craig was kind enough to post a solution, 
> but the problem is I don't know how to go about following his instructions.

I believe his fix only applied to systems installed on XFS file systems. 
  Is that what you are using?


>  > > It looks like BackupPC_nightly is failing to traverse the pool.
>  > > This could be due to a bug in IO::Dirent that causes it to fail
>  > > on certain file systems.  There is a test in 3.1.0 to check if
>  > > IO::Dirent works, but it checks ".", not $TopDir.  That bug is
>  > > fixed in CVS.
>  > >
>  > > Do you have IO::Dirent installed and is your pool on XFS?
>  > >
>  > > If so, change this line in lib/BackupPC/Lib.pm:
>  > >
>  > >$IODirentOk = 1;
>  > >
>  > > to:
>  > >
>  > >$IODirentOk = 0;

Just use a text editor to change that line and restart backuppc.  If you 
have a packaged install and don't know where the lib directory is, the 
command 'locate BackupPC/Lib.pm' should find the file.

-- 
   Les Mikesell
lesmikes...@gmail.com


--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] When will backuppc begin pooling?

[Chris Robertson]

Brian Woodworth wrote:
> Yes, I have complete backups.  My problem appears to be a known bug as 
> stated earlier in the thread.  Craig was kind enough to post a 
> solution, but the problem is I don't know how to go about following 
> his instructions.
>
> thanks for the response
>

First, try...

perldoc IO::Dirent

...to see if you have the Dirent perl module installed.  If you get 
something like...

No documentation found for "IO::Dirent".

...your problem probably lies elsewhere. If you get a documentation 
page, hit "q" to exit and run...

locate Lib.pm

...to find all files with "Lib.pm" in their name on your system 
(hopefully your locatedb is up to date.  If not "updatedb" will probably 
update it).  You should find (at least) two...

/some/path/lib/BackupPC/Lib.pm
/some/path/lib/BackupPC/CGI/Lib.pm

...where /some/path is BackupPC's install path.  If you have more than 
two, don't continue.  Ask for further advise.  If you just have two, we 
want to modify the one NOT in the CGI directory*.  The following command 
(when run as root**, or the some other user authorized to modify the 
file) will update "/some/path/lib/BackupPC/Lib.pm" per Craig's 
instructions.  You should probably back up the file before running it...

sed -i -e 's/\$IODirentOk = 1;/$IODirentOk = 0;/' 
/some/path/lib/BackupPC/Lib.pm

...and you should probably consult with someone else to make sure I know 
what I'm talking about and am not about to break your system 
(inadvertently or otherwise). :o)

Chris

* The command I used won't do anything to the Lib.pm in the CGI 
directory, but sed is a very powerful tool and, as such, should be 
treated with the utmost respect.
** Running commands you get from the Internet as root is inadvisable.  
sudo is not really much better.

--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] When will backuppc begin pooling?

[Brian Woodworth]

Yes, I have complete backups.  My problem appears to be a known bug as
stated earlier in the thread.  Craig was kind enough to post a solution, but
the problem is I don't know how to go about following his instructions.

thanks for the response

On Thu, Feb 12, 2009 at 2:56 PM, Tino Schwarze wrote:

> Hi Brian,
>
> On Thu, Feb 12, 2009 at 11:06:33AM -0800, Brian Woodworth wrote:
>
> > I would really like to get the pooling to work.  Do i need to install
> > IO::Dirent first?  If so, how do I do that?  I looked around a bit and
> could
> > not really find much about it.  I am running Ubuntu Server 8.10.
>
> Pooling is done by BackupPC_link which is invoked automatically after a
> successful backup. There's nothing you have to do but making backups
> complete. Do you have complete backups?
>
> Tino.
>
> > > >  *   0 pending backup requests from last scheduled wakeup,
> > > >  *   0 pending user backup requests,
> > > >  *   0 pending command requests,
> > > >  *   Pool is 0.00GB comprising 0 files and 0 directories (as of 1/29
> > > 01:00),
> > > >  *   Pool hashing gives 0 repeated files with longest chain 0,
> > > >  *   Nightly cleanup removed 0 files of size 0.00GB (around 1/29
> 01:00),
> > > >  *   Pool file system was recently at 83% (1/29 18:59), today's max
> is
> > > 83% (1/29 17:08) and yesterday's max was 82%.
> > >
> > > It looks like BackupPC_nightly is failing to traverse the pool.
> > > This could be due to a bug in IO::Dirent that causes it to fail
> > > on certain file systems.  There is a test in 3.1.0 to check if
> > > IO::Dirent works, but it checks ".", not $TopDir.  That bug is
> > > fixed in CVS.
> > >
> > > Do you have IO::Dirent installed and is your pool on XFS?
> > >
> > > If so, change this line in lib/BackupPC/Lib.pm:
> > >
> > >$IODirentOk = 1;
> > >
> > > to:
> > >
> > >$IODirentOk = 0;
> > >
> > > Craig
> > >
> >
> >
> >
> > --
> > Brian Woodworth
> > bwoodwo...@gmail.com
>
> >
> --
>
> > ___
> > BackupPC-users mailing list
> > BackupPC-users@lists.sourceforge.net
> > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> > Wiki:http://backuppc.wiki.sourceforge.net
> > Project: http://backuppc.sourceforge.net/
>
>
> --
> "What we nourish flourishes." - "Was wir nähren erblüht."
>
> www.lichtkreis-chemnitz.de
> www.craniosacralzentrum.de
>
>
> --
> Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco,
> CA
> -OSBC tackles the biggest issue in open source: Open Sourcing the
> Enterprise
> -Strategies to boost innovation and cut costs with open source
> participation
> -Receive a $600 discount off the registration fee with the source code:
> SFAD
> http://p.sf.net/sfu/XcvMzF8H
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>



-- 
Brian Woodworth
bwoodwo...@gmail.com
--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] When will backuppc begin pooling?

[Tino Schwarze]

Hi Brian,

On Thu, Feb 12, 2009 at 11:06:33AM -0800, Brian Woodworth wrote:

> I would really like to get the pooling to work.  Do i need to install
> IO::Dirent first?  If so, how do I do that?  I looked around a bit and could
> not really find much about it.  I am running Ubuntu Server 8.10.

Pooling is done by BackupPC_link which is invoked automatically after a
successful backup. There's nothing you have to do but making backups
complete. Do you have complete backups?

Tino.

> > >  *   0 pending backup requests from last scheduled wakeup,
> > >  *   0 pending user backup requests,
> > >  *   0 pending command requests,
> > >  *   Pool is 0.00GB comprising 0 files and 0 directories (as of 1/29
> > 01:00),
> > >  *   Pool hashing gives 0 repeated files with longest chain 0,
> > >  *   Nightly cleanup removed 0 files of size 0.00GB (around 1/29 01:00),
> > >  *   Pool file system was recently at 83% (1/29 18:59), today's max is
> > 83% (1/29 17:08) and yesterday's max was 82%.
> >
> > It looks like BackupPC_nightly is failing to traverse the pool.
> > This could be due to a bug in IO::Dirent that causes it to fail
> > on certain file systems.  There is a test in 3.1.0 to check if
> > IO::Dirent works, but it checks ".", not $TopDir.  That bug is
> > fixed in CVS.
> >
> > Do you have IO::Dirent installed and is your pool on XFS?
> >
> > If so, change this line in lib/BackupPC/Lib.pm:
> >
> >$IODirentOk = 1;
> >
> > to:
> >
> >$IODirentOk = 0;
> >
> > Craig
> >
> 
> 
> 
> -- 
> Brian Woodworth
> bwoodwo...@gmail.com

> --

> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/


-- 
"What we nourish flourishes." - "Was wir nähren erblüht."

www.lichtkreis-chemnitz.de
www.craniosacralzentrum.de

--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

[BackupPC-users] Revamping the Wiki

[Cody Dunne]

Hello everyone,

I've been looking over the BackupPC wiki to find somewhere to integrate 
  my own material, but it's in pretty bad shape. There's no consistent 
structure or formatting, and I remember from my initial experience with 
it that everything was very hard to find.

There is a proposed structure page 
(http://backuppc.wiki.sourceforge.net/ProposedWikiStructure) but it is 
fairly old, has no discussion, and it's suggestions are only partially 
implemented.

I'd be willing to do a lot of the cleaning myself, though I don't want 
to step on anyone's toes without talking with you first. Also, my 
knowledge of BackupPC is fairly limited to my setup (XP/Vista clients & 
Ubuntu server).

Who would be interested in a short meeting about this, say this Sunday 
at 12pm via Skype or IRC? My username for both is edallme. Also, please 
send any other suggestions you have to me or add them to the 
ProposedWikiStructure wiki page/discussion.

Regards,
Cody Dunne


--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] When will backuppc begin pooling?

[Brian Woodworth]

I would really like to get the pooling to work.  Do i need to install
IO::Dirent first?  If so, how do I do that?  I looked around a bit and could
not really find much about it.  I am running Ubuntu Server 8.10.

On Thu, Jan 29, 2009 at 11:27 PM, Craig Barratt <
cbarr...@users.sourceforge.net> wrote:

> Brian writes:
>
> >  *   0 pending backup requests from last scheduled wakeup,
> >  *   0 pending user backup requests,
> >  *   0 pending command requests,
> >  *   Pool is 0.00GB comprising 0 files and 0 directories (as of 1/29
> 01:00),
> >  *   Pool hashing gives 0 repeated files with longest chain 0,
> >  *   Nightly cleanup removed 0 files of size 0.00GB (around 1/29 01:00),
> >  *   Pool file system was recently at 83% (1/29 18:59), today's max is
> 83% (1/29 17:08) and yesterday's max was 82%.
>
> It looks like BackupPC_nightly is failing to traverse the pool.
> This could be due to a bug in IO::Dirent that causes it to fail
> on certain file systems.  There is a test in 3.1.0 to check if
> IO::Dirent works, but it checks ".", not $TopDir.  That bug is
> fixed in CVS.
>
> Do you have IO::Dirent installed and is your pool on XFS?
>
> If so, change this line in lib/BackupPC/Lib.pm:
>
>$IODirentOk = 1;
>
> to:
>
>$IODirentOk = 0;
>
> Craig
>



-- 
Brian Woodworth
bwoodwo...@gmail.com
--
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] meaning of different "Aborting backup" failure messages

[John Rouillard]

On Thu, Feb 12, 2009 at 05:44:33PM +0100, Matthias Meyer wrote:
> Sometimes my backups abort with different failures.
> Anybody know the meaning of/reason for the following failures?
> 1) Aborting backup up after signal ALRM

The backup is taking longer than your $Conf{ClientTimeout}
setting. Once you hit $Conf{ClientTimeout} seconds a sigalarm is sent
to the process, which causes it to exit.

> 2) Backup aborted (Child exited prematurely)

Could be a number of things. IIRC this also shows up when it fails
during the initial startup. If you also see a message similar to
"can't transfer 4 bytes" and you are using the ssh transport mechanism
there is something causing bogus output in the .login or other startup
files for the shell (or ssh config files).

> 3) Aborting backup up after signal INT

Usully I see this when I stop the backup using the web interface.

> 4) Aborting backup up after signal PIPE

I see this as well, not sure what the cause is. Something failed in
the interprocess communication between the processes backuppc spawns.
What failed who knows.


-- 
-- rouilj

John Rouillard
System Administrator
Renesys Corporation
603-244-9084 (cell)
603-643-9300 x 111

--
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

[BackupPC-users] meaning of different "Aborting backup" failure messages

[Matthias Meyer]

Sometimes my backups abort with different failures.
Anybody know the meaning of/reason for the following failures?
1) Aborting backup up after signal ALRM
2) Backup aborted (Child exited prematurely)
3) Aborting backup up after signal INT
4) Aborting backup up after signal PIPE
5) Backup aborted (lost network connection during backup)
   ;-) Oh, this failure message I understand.

Thanks
Matthias
-- 
Don't Panic



--
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Server reboots nightly

[Chris Baker]

I did check the time on the server yesterday. The time in the BIOS was way
off for some reason. I then noticed this morning that the server had not
rebooted. It was the first time in quite a while.


Chris Baker -- cba...@intera.com
systems administrator
INTERA -- 512-425-2006

-Original Message-
From: Mark Maciolek [mailto:m...@sr.unh.edu] 
Sent: Friday, February 06, 2009 3:17 PM
To: General list for user discussion,questions and support
Subject: Re: [BackupPC-users] Server reboots nightly

hi,

Check the BIOS for auto stop/start times or awake on lan settings.

Mark

Chris Baker wrote:
> That was a great answer. The server is rebooting every morning at 
> 7:00. I will see what I can find out from that.
> 
> 
> Chris Baker -- cba...@intera.com
> systems administrator
> INTERA -- 512-425-2006
> 
> -Original Message-
> From: Chris Robertson [mailto:crobert...@gci.net]
> Sent: Friday, February 06, 2009 2:58 PM
> To: General list for user discussion, questions and support
> Subject: Re: [BackupPC-users] Server reboots nightly
> 
> Chris Baker wrote:
>> Which logs should I check? 
> 
> /var/log/messages
> 
>> And what should I look for in these logs?
> 
> Run the command dmesg (first, "man dmesg" so you know what this 
> command
> does) and take a look at the output.  This is the bootup message and 
> should be replicated in /var/log/messages.  Take a look at the entries 
> above for clues as to why your server is restarting.  The last log 
> entry before the dmesg output should be something along the lines of 
> "Kernel log daemon terminating." and should be proceeded by evidence 
> of exiting processes.  If not, you probably have power or hardware 
> problems.  If you do see evidence of a graceful restart, at least you 
> know about when it's happening.  Start looking through /etc/cron.* and 
> /etc/crontab for jobs that run around that time.
> 
>>  I do
>> know where the logs are on the system.
>>   
> 
> Chris
> 
> --
> --
> --
> Create and Deploy Rich Internet Apps outside the browser with
> Adobe(R)AIR(TM) software. With Adobe AIR, Ajax developers can use 
> existing skills and code to build responsive, highly engaging 
> applications that combine the power of local resources and data with the
reach of the web.
> Download the Adobe AIR SDK and Ajax docs to start building 
> applications today-http://p.sf.net/sfu/adobe-com
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
> 
> 
> 
> --
>  Create and Deploy Rich Internet Apps outside the browser with 
> Adobe(R)AIR(TM) software. With Adobe AIR, Ajax developers can use 
> existing skills and code to build responsive, highly engaging 
> applications that combine the power of local resources and data with 
> the reach of the web. Download the Adobe AIR SDK and Ajax docs to 
> start building applications today-http://p.sf.net/sfu/adobe-com
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/

--
Mark Maciolek
Network Administrator
Morse Hall 339
862-3050
m...@sr.unh.edu
https://www.sr.unh.edu


--
Create and Deploy Rich Internet Apps outside the browser with
Adobe(R)AIR(TM) software. With Adobe AIR, Ajax developers can use existing
skills and code to build responsive, highly engaging applications that
combine the power of local resources and data with the reach of the web.
Download the Adobe AIR SDK and Ajax docs to start building applications
today-http://p.sf.net/sfu/adobe-com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/



--
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] 38GB file backup is hanging backuppc (more info and more questions)

[Tony Schreiner]

> the file that is currently being transferred.
>
> http://www.mail-archive.com/backuppc-users@lists.sourceforge.net/msg05836.html
>
> Now because of another comment, I tried to disable the use of RStmp
> and force BackupPC to do the equivalent of the --whole-file where it
> just copies the file across without applying the rsync
> differential/incremental algorithm. I executed a full backup after
> moving the file in the prior backup aside. So I moved
>


I missed the original post, but  I run rsync with the --whole-file  
option, but I still get RStmp files, is that not supposed to happen?


And the writing to the new file in the  "new" subdirectory is  
sometimes very, very slow even though the RStmp file was filled  
reasonably fast.


Tony Schreiner
Boston College

--
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

[BackupPC-users] Looking for BackupPC_compress to install a file manually in a backup

[John Rouillard]

Hi all:

Still trying to get a single master copy of the problematic db4 file
into backuppc's cpool.

I thought I could copy it over manually, put it in the right place in
the partially completed backup tree and start a normal full backup.

I can easily copy the file in 15 minutes or so (at 35MB/s), but I
can't do the compression that the files in the backup tree use. IIRC
BackupPC's compression mechanism isn't just a gzip of the file.

There is a BackupPC_zcat, but there is no BackupPC_compress. Does
anybody have such a beast, or is it impossible to create such a
program becuase info is needed from the transfer protocol (rsync) to
make the copressed version of the file?

-- 
-- rouilj

John Rouillard
System Administrator
Renesys Corporation
603-244-9084 (cell)
603-643-9300 x 111

--
Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM)
software. With Adobe AIR, Ajax developers can use existing skills and code to
build responsive, highly engaging applications that combine the power of local
resources and data with the reach of the web. Download the Adobe AIR SDK and
Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] 38GB file backup is hanging backuppc (more info and more questions)

[Pedro M. S. Oliveira]

Hi!
I had this trouble some time ago while backing up vmware virtual machines (the 
files were extremely large about 120GB) and rsync would behave just like you 
are saying it happens to you. I had other smaller vms about 10 GB and those 
worked perfectly with rsync.
I did some research and from what i've found the clues were going to the rsync 
protocol itself while transferring large files.
I changed the transference mode from rsync to tar and since then I had no 
trouble.
Cheers 
Pedro  

On Wednesday 11 February 2009 22:41:03 John Rouillard wrote:
> Hi all:
> 
> Following up with more info with the hope that somebody has a clue as
> to what is killing this backup.
> 
> On Fri, Feb 06, 2009 at 03:41:40PM +, John Rouillard wrote:
> > I am backing up a 38GB file daily (database dump). There were some
> > changes on the database server, so I started a new full dump. After
> > two days (40+ hours) it had still not completed. This is over a GB
> > network link. I restarted the full dump thinking it had gotten hung.
> > [...]
> > What is the RStmp file? That one grew pretty quickly to it's current
> > size given the start time of the backup (18:08 on feb 5). If I run
> > file (1) against that file it identifies it as
> 
> >From another email, it looks like it is the uncompressed prior copy of
> the file that is currently being transferred.
> 
>   
> http://www.mail-archive.com/backuppc-users@lists.sourceforge.net/msg05836.html
> 
> Now because of another comment, I tried to disable the use of RStmp
> and force BackupPC to do the equivalent of the --whole-file where it
> just copies the file across without applying the rsync
> differential/incremental algorithm. I executed a full backup after
> moving the file in the prior backup aside. So I moved 
> 
>   
> /backup-pc/pc/ldap01.bos1.renesys.com/326/f%2fdata%2fbak/ffedora-ds/fcurrent/fuserRoot/fid2entry.db4
> 
> to 
> 
>   
> /backup-pc/pc/ldap01.bos1.renesys.com/326/f%2fdata%2fbak/ffedora-ds/fcurrent/fuserRoot/fid2entry.db4.orig
> 
> I claim this should make rsync diff against a non-existent file and
> thus just copy the entire file, but I still see in the lsof output for
> the BackupPC process:
> 
>   BackupPC_ 18683 backup8u   REG9,2 36878598144  48203250
>   /backup-pc/pc/ldap01.bos1.renesys.com/new/f%2fdata%2fbak/RStmp
> 
> and there is only 1 file that is that large (36878598144 bytes) under
> that volume and it is the id2entry.db4 file.
> 
> So what did I miss?
> 
> Does BackupPC search more than the prior backup? I verified that run
> 327 (which is the partial copy) doesn't have any copy of:
> 
>   f%2fdata%2fbak/ffedora-ds/fcurrent/fuserRoot/fid2entry.db4
> 
> in it's tree. So where is the RStmp file coming from?
> 
> At this point it's been running about 24 hours and it has transferred
> only 10GB of the 30GB file.
> 
> This is ridiculously slow. If my math is right, I should expect a
> 36GByte file at a 1Mbit/sec rate (which is about what cacti is showing
> as a steady state throughput on the ethernet port) to transfer in:
> 
>   '36*1024*8/(3600*24)'= ~3.413
> 
> so it will take 3 and a half days at this rate. This is with both
> systems having a lot of idle time and < 1% wait state.
> 
> If I run an rsync on the BackupPC server to copy the file from the
> same client, I get something closer to 10MBytes/second
> (80Mbits/sec). Which provides a full copy in a bit over an hour.
> 
> Also one other thing that I noticed, BackupPC in it's 
> $Conf{RsyncArgs}  setting uses:
> 
> 
> '--block-size=2048',
> 
> which is described in the rsync man page as:
> 
>-B, --block-size=BLOCKSIZE
>   This forces the block size used in the rsync algorithm to a
>   fixed value.  It is normally selected based on the size of
>   each file being updated.  See the technical report for
>   details.
> 
> is it possible to increase this or will the Perl rsync library break??
> It would be preferable to not specify it at all allowing the remote
> rsync to set the block size based on the file size.
> 
> I see this in lib/BackupPC/Xfer/RsyncFileIO.pm:
> 
>   sub csumStart
>   {
> my($fio, $f, $needMD4, $defBlkSize, $phase) = @_;
> 
> $defBlkSize ||= $fio->{blockSize};
> 
> which makes it looks like it can handle a different blocksize, but
> this could be totally unrelated.
> 
> I could easily see a 2k block size slowing down the transfer of a
> large file if each block has to be summed.
> 
> Anybody with any ideas?
> 

-- 
--
Pedro M. S. Oliveira
IT Consultant 
Email: pmsolive...@gmail.com  
URL:   http://pedro.linux-geex.com
Cellular: +351 96 5867227
--
--