Hi,
On Apr 13, 2006, at 12:34 PM, Martin Simmons wrote:
Did you try using spooling?
Yes, it puts an enormous load on the backup server; I'm not sure why.
I do utilize spooling for incrementals, but I expect them to be
slower (which they are).
Spooling splits the backup into phases of collecting from the
client, writing
to the tape (repeated) and then writing to the database.
It could be worthwhile investigating the spooling slowness to see
if it occurs
in one particular phase (look at the console output for spooling
messages).
Without spooling it might be difficult to detect which phase is
slow because
they are interleaved for each file sent by the client.
At the risk of veering this discussion off-topic, I've seen that
during the spooling to disk phase, my server becomes very slow to
respond, though the CPU usage is still relatively light. I've put
some of the cacti graphs from the server online if anyone feels like
checking them out: http://sbgrid.org/bacula/
Last night our daily incrementals ran as usual, and one can see in
the graphs that CPU usage never exceeded 50%, whereas the load
average peaked at around 5.
The incrementals that ran last night:
13-Apr 00:00 sbgrid-dir: Start Backup JobId 84,
Job=EML2.2006-04-13_00.00.00
12-Apr 23:51 eml2-fd: DIR and FD clocks differ by -630 seconds, FD
automatically adjusting.
13-Apr 00:02 sbgrid-sd: Spooling data ...
13-Apr 00:08 sbgrid-sd: Committing spooled data to Volume "000003L2".
Despooling 27,165,575 bytes ...
13-Apr 00:08 sbgrid-sd: Sending spooled attrs to the Director.
Despooling 389,684 bytes ...
13-Apr 01:00 sbgrid-dir: Start Backup JobId 85, Job=CRYSTAL_HOME.
2006-04-13_01.00.00
13-Apr 00:49 home-fd: DIR and FD clocks differ by -635 seconds, FD
automatically adjusting.
13-Apr 01:00 sbgrid-sd: Spooling data ...
13-Apr 01:20 sbgrid-sd: Committing spooled data to Volume "000005L2".
Despooling 6,617,884,648 bytes ...
13-Apr 01:28 sbgrid-sd: Sending spooled attrs to the Director.
Despooling 1,471,546 bytes ...
13-Apr 02:00 sbgrid-dir: Start Backup JobId 86, Job=FS4_XRAY.
2006-04-13_02.00.00
13-Apr 01:49 xray-fd: DIR and FD clocks differ by -634 seconds, FD
automatically adjusting.
13-Apr 02:00 sbgrid-sd: Spooling data ...
13-Apr 02:42 sbgrid-sd: Committing spooled data to Volume "000005L2".
Despooling 10,782,446,112 bytes ...
13-Apr 02:53 sbgrid-sd: Sending spooled attrs to the Director.
Despooling 572,734 bytes ...
13-Apr 03:00 sbgrid-dir: Start Backup JobId 87,
Job=EML3.2006-04-13_03.00.00
13-Apr 02:49 eml3-fd: DIR and FD clocks differ by -637 seconds, FD
automatically adjusting.
13-Apr 03:00 sbgrid-sd: Spooling data ...
13-Apr 03:09 sbgrid-sd: Committing spooled data to Volume "000005L2".
Despooling 152,612,206 bytes ...
13-Apr 03:09 sbgrid-sd: Sending spooled attrs to the Director.
Despooling 97,522 bytes ...
Finally, here's the output from sar for the relevant time period:
CPU %user %nice %system %iowait %idle
00:10:01 all 0.68 0.00 1.94 3.09 94.29
00:20:01 all 0.02 0.00 18.71 43.13 38.14
00:30:02 all 0.02 0.00 17.55 42.84 39.60
00:40:01 all 0.02 0.00 18.56 45.91 35.51
00:50:01 all 0.02 0.00 8.88 29.91 61.20
01:00:01 all 0.02 0.00 13.44 33.62 52.93
01:10:07 all 0.70 0.00 6.72 14.49 78.08
01:20:02 all 0.48 0.00 4.58 9.90 85.05
01:30:01 all 2.62 0.00 4.84 7.45 85.10
01:40:01 all 0.02 0.00 0.06 0.03 99.89
01:50:01 all 0.02 0.00 0.06 0.02 99.90
02:00:02 all 0.02 0.00 0.06 0.03 99.89
02:10:01 all 0.90 0.00 12.14 15.18 71.78
02:20:01 all 0.09 0.00 0.81 1.61 97.48
02:30:01 all 0.32 0.00 3.02 7.42 89.23
02:40:11 all 0.53 0.00 6.08 21.40 71.98
02:50:02 all 3.00 0.00 6.47 11.03 79.49
03:00:02 all 1.23 0.00 2.20 2.07 94.50
03:10:01 all 0.12 0.00 0.42 0.74 98.73
03:20:01 all 0.03 0.00 0.05 0.02 99.90
03:30:01 all 0.02 0.00 0.06 0.03 99.90
03:40:01 all 0.03 0.00 0.06 0.08 99.83
03:50:01 all 0.03 0.00 0.05 0.02 99.90
04:00:01 all 0.02 0.00 0.06 0.02 99.90
04:10:01 all 0.70 0.16 1.34 37.95 59.86
04:20:01 all 0.04 0.38 3.46 26.72 69.41
04:30:01 all 0.89 0.00 0.13 0.57 98.41
04:40:01 all 0.02 0.00 0.05 0.01 99.92
Many thanks,
Ian
-------------------------------------------------------
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=110944&bid=241720&dat=121642
_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
