Re: [Bacula-users] backuppc pool backup slow

2005-05-17 Thread Kern Sibbald 
Hello,

BackupPC uses *lots* and *lots* of hard links.  The current Bacula 
implementation is *very* slow handling hard links.   You have three choices:
- Live with slow performance for BackupPC files
- Turn off handling of hard links (your BackupPC files will all be restored 
but not properly linked).
- Wait until a future version when I will correct the problem using hash 
coding of hard link names rather than a linear search.

On Tuesday 17 May 2005 14:52, Jeff Ramen wrote:
 Hello,
   I am experiencing slow backup performance, especially when backing up
 my BackupPC pool to tape.

   My system:
 Dual Opteron 2.4Ghz 1GB Ram, 4*300GB SATA (3Ware Controller RAID 5),
 Adaptec U160
 Gentoo Linux (stage 1 install) kernel: linux-2.6.11-gentoo-r6
 BackupPC version 2.1.1, pool resides on LVM2 volume
 Bacula version 1.36.3, MySQL store
 HP Ultrium-1 LTO Tape
 Exabyte VXA2 Autochanger

   To the LTO drive, I have seen as high as 12 Mb/s doing backups of
 other volumes.
   Backups of the backupPC pool are made from a snapshot, which is
 created by a 'RunBeforeJob' script.
   The last backup I ran (55GB of data) initially ran at around
 2-3Mb/sec, which is not great, but as long as the job gets done within
 4-6 hours I can deal.
   What seems peculiar is that when the total bytes reaches 55GB (should
 be everything) the job continues to run, for a long, long time.  The
 bytes does not change but the files examined value changes.  See my
 current job:

 Director connected at: 17-May-05 08:50
 JobId 3 Job BackupPC.2005-05-16_13.17.16 is running.
 Backup Job started: 16-May-05 13:17
 Files=2,326,531 Bytes=55,852,725,733 Bytes/sec=793,734
 Files Examined=2,744,098
 Processing file:
 /mnt/snapshot/backuppc/cpool/8/9/b/89ba699a9f1dde5a324a5f14ef626b77
 SDReadSeqNo=5 fd=7

 So far a whopping 16 HOURS and still going!

 What's going on?  I would like to get my tape backups working correctly
 so I can start sleeping well again...

 - Jeff





 ---
 This SF.Net email is sponsored by Oracle Space Sweepstakes
 Want to be the first software developer in space?
 Enter now for the Oracle Space Sweepstakes!
 http://ads.osdn.com/?ad_id=7412alloc_id=16344op=click
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

-- 
Best regards,

Kern

  (
  /\
  V_V


---
This SF.Net email is sponsored by Oracle Space Sweepstakes
Want to be the first software developer in space?
Enter now for the Oracle Space Sweepstakes!
http://ads.osdn.com/?ad_id=7412alloc_id=16344op=click
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] backuppc pool backup slow

2005-05-17 Thread Arno Lehmann 
Hi.
Jeff Ramen wrote:
I would like to gain some understanding as to what bacula is doing when 
the bytes written
stops changing and files examined keeps increasing.
It's probably examining files. Like during an incremental or 
differential backup. The SD looks at all files on the computer, but 
stores only the ones changed recently.

For example, here the backup of a router / proxy runs quite a while 
after /var/squid and /var/log are saved, but usually no files outside of 
these directory are stored.

Is this a cataloging operation?
No, I think the file count would not change during cataloging... at the 
end of a backup, when you use spooling there is a period of de-spooling 
the file metadata which can take quite long, though.

Backuppc supports some kind of archiving feature, I wonder if anyone has 
used this in conjunction with
bacula...
Erm. Perhaps. What does BackupPCs archiving do?
Arno
Thanks,
Jeff
---
This SF.Net email is sponsored by Oracle Space Sweepstakes
Want to be the first software developer in space?
Enter now for the Oracle Space Sweepstakes!
http://ads.osdn.com/?ad_id=7412alloc_id=16344op=click
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
IT-Service Lehmann[EMAIL PROTECTED]
Arno Lehmann  http://www.its-lehmann.de
---
This SF.Net email is sponsored by Oracle Space Sweepstakes
Want to be the first software developer in space?
Enter now for the Oracle Space Sweepstakes!
http://ads.osdn.com/?ad_id=7412alloc_id=16344op=click
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users