Re: [BackupPC-users] how to examine progress of backup

2009-01-07 Thread Rob Owens
Les Mikesell wrote:
 Matthias Meyer wrote:
 I use rsyncd to backup both, windows as well as linux clients.
 Is it possible to examine or calculate the progress of an actual running
 backup?
 
 No, gnu tar has a way to get an estimate of the size of an incremental 
 run that amanda uses to help compute what will fit on a tape, but rsync 
 doesn't have an equivalent.
 
 One Idea would be to calculate the duration of the last backups and assume
 the actual backup will have the same performance. But this can be wrong if
 some new (big) files had been added.
 Another Idea is to examine the filespace of the share and calculate the
 estimated duration based on the last transfer rates. But this can be wrong
 if some (big) files are in the exclusion list.

 Any Ideas?
 
 I don't think it is even possible to guess how much rsync will transfer 
 on a changed file without running through the whole comparison.
 
I think if you use the --dry-run option in rsync it may tell you how
much data would have been transferred.

-Rob


The information transmitted is intended only for the person or entity to
which it is addressed and may contain confidential and/or privileged
material. If you are not the addressee, any disclosure, reproduction,
copying, distribution, or other dissemination or use of this transmission in
error please notify the sender immediately and then delete this e-mail.
E-mail transmission cannot be guaranteed to be secure or error free as
information could be intercepted, corrupted lost, destroyed, arrive late or
incomplete, or contain viruses.
The sender therefore does not accept liability for any errors or omissions
in the contents of this message which arise as a result of e-mail
transmission. If verification is required please request a hard copy
version.




--
Check out the new SourceForge.net Marketplace.
It is the best place to buy or sell services for
just about anything Open Source.
http://p.sf.net/sfu/Xq1LFB
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


[BackupPC-users] how to examine progress of backup

2009-01-05 Thread Matthias Meyer
I use rsyncd to backup both, windows as well as linux clients.
Is it possible to examine or calculate the progress of an actual running
backup?
One Idea would be to calculate the duration of the last backups and assume
the actual backup will have the same performance. But this can be wrong if
some new (big) files had been added.
Another Idea is to examine the filespace of the share and calculate the
estimated duration based on the last transfer rates. But this can be wrong
if some (big) files are in the exclusion list.

Any Ideas?
br and have a great new year!
Matthias
-- 
Don't Panic


--
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] how to examine progress of backup

2009-01-05 Thread Les Mikesell
Matthias Meyer wrote:
 I use rsyncd to backup both, windows as well as linux clients.
 Is it possible to examine or calculate the progress of an actual running
 backup?

No, gnu tar has a way to get an estimate of the size of an incremental 
run that amanda uses to help compute what will fit on a tape, but rsync 
doesn't have an equivalent.

 One Idea would be to calculate the duration of the last backups and assume
 the actual backup will have the same performance. But this can be wrong if
 some new (big) files had been added.
 Another Idea is to examine the filespace of the share and calculate the
 estimated duration based on the last transfer rates. But this can be wrong
 if some (big) files are in the exclusion list.
 
 Any Ideas?

I don't think it is even possible to guess how much rsync will transfer 
on a changed file without running through the whole comparison.

-- 
   Les Mikesell
lesmikes...@gmail.com


--
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] how to examine progress of backup

2009-01-05 Thread Adam Goryachev
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Les Mikesell wrote:
 Matthias Meyer wrote:
 I use rsyncd to backup both, windows as well as linux clients.
 Is it possible to examine or calculate the progress of an actual running
 backup?

 No, gnu tar has a way to get an estimate of the size of an incremental
 run that amanda uses to help compute what will fit on a tape, but rsync
 doesn't have an equivalent.

 One Idea would be to calculate the duration of the last backups and assume
 the actual backup will have the same performance. But this can be wrong if
 some new (big) files had been added.
 Another Idea is to examine the filespace of the share and calculate the
 estimated duration based on the last transfer rates. But this can be wrong
 if some (big) files are in the exclusion list.

 Any Ideas?

 I don't think it is even possible to guess how much rsync will transfer
 on a changed file without running through the whole comparison.
rsync does have --progress which I find very useful, this at least
displays how many files need to be looked at, and how many are left to
examine. It is a better indication than nothing, but not exactly a
good time estimate... especially if the last files are very large
and/or with a large amount of changed data/new etc.

Personally, I would like it if this data could be collected by
backuppc and displayed in the log at least. ie, at the beginning of
the log it could store how many files should get looked at, and when
it fails part way, it can display how many files it has done, and how
many are left

Also this could be shown on the status page... In fact, the status
page could even show some additional interpreted data such as
Building file list, and File transfer in progress or better File
1234 of 2344 in progress, a bw rate over the past 60 secs would also
be nice (to know it hasn't stalled when it shows the same file number
for a long period of time).

Of course, if you do this for rsync, then everyone will want the same
features for tar/smb/ftp/etc...

Regards,
Adam
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFJYnOkGyoxogrTyiURAoREAKC3nwPdgrnQ460OzW3by0R80qkPqQCfeW7F
fYGvnLL+kOeacmc4cWsSd5I=
=KI1u
-END PGP SIGNATURE-


--
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] how to examine progress of backup

2009-01-05 Thread Matthias Meyer
Adam Goryachev wrote:

 I don't think it is even possible to guess how much rsync will transfer
 on a changed file without running through the whole comparison.
 rsync does have --progress which I find very useful, this at least
 displays how many files need to be looked at, and how many are left to
 examine. It is a better indication than nothing, but not exactly a
 good time estimate... especially if the last files are very large
 and/or with a large amount of changed data/new etc.
 

I tried the --progress too. But I find no output of it. Because I run rsync
in a daemon mode?

br
Matthias
-- 
Don't Panic


--
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/