[Bacula-users] Offsite Storage

[Damien Hull]

I've asked this question before, but I don't think I got enough information. 
Here's my situation

1.  I have three offices in different physical locations.

2.  Each location has between 200 GB to well over 1 TB of data.

3.  I would like to backup data between offices for offsite storage.

4.  I can't wait weeks for data to be copied between offices

I know some commercial software allows you to "seed" the backup.

1.  Copy data to an external drive

2.  Mail the drive to another office

3.  Copy the data over - Your backup is now "seeded"

4.  Backups are now faster because you don't have to copy everything.

Can bacula handle this?

Thanks!


Damien Hull
IT Manager
Tikigaq Corporation
301 W. Northern Lights Blvd., Suite 660
Anchorage, AK 99503
(907) 365-6249
dh...@tikigaq.com
[TIKIlogo-222x60]

--
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] how to debug a job

[Dimitri Maziuk]

On 01/22/2015 10:07 AM, Josh Fisher wrote:

> There is likely no reason to have SpoolData=yes for disk volumes, and it
> could actually slow things down.

On 01/22/2015 07:32 AM, Clark, Patricia A. wrote:

> Spooling is for the benefit of tape drives and databases.  What is the
> benefit of spooling data for virtual tapes that are really disks?

1. Job interleaving.
2. "If you are running multiple simultaneous jobs, Bacula will continue
spooling other jobs while one is despooling to tape, provided there is
sufficient spool file space." (TFM - "Data Spooling" - "Other points".)

10 clients, (up to) 10 concurrent jobs, vchanger with one "device" and
plenty of pre-labeled 50GB file volumes, 50GB max spool size/job.

> Is one of the jobs running concurrently with the failing job backing up
> the machine SD is running on?

Yesno: it's not backing up any of the usual suspects (the spool disk,
/var/log, var/lib/pgdata, ...)

> Certainly, the spool directory should not be on the same disk drives
> that the database is on.

Right. Spool is on a separate tler drive.

It does look like the spool disk might have been the bottleneck indeed,
and the same client failing over and over again was just a coincidence
-- perhaps it has more data than the others of its kind. I won't know
until more jobs get to run, but so far the manually started full backup
looks promising: 100+ MB/s write speed on the spool. I might switch it
to xfs with barriers off and/or get an SSD for it.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
--
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula-Web 7.0.2 available

[Polcari, Joe (Contractor)]

So when changing the config array from 3 hosts to 2 hosts I get this on 7.01 
and 7.02:
Sorry to the list but the signup on the bug tracking page isn’t working either 
or I would have reported it there instead.

Notice: Undefined index: 2 in 
/var/www/html/bacula-web-7.0.2/application/libs/fileconfig.class.php on line 80
Exception trace

File: /var/www/html/bacula-web-7.0.2/core/bweb.class.php on line 83 in function 
FileConfig::get_Value

File: /var/www/html/bacula-web-7.0.2/test.php on line 28 in function 
Bweb->__construct


Application error

File

/var/www/html/bacula-web-7.0.2/application/libs/fileconfig.class.php

Line

83

Exception code

0

Exception message

Configuration error: the catalog id <2> do not exist

Have you tried to run the test page ?
Check the online documentation on Bacula-Web project 
site
Rebort a bug or suggest a new feature in the Bacula-Web\'s bugtracking 
tool


Notice: Trying to get property of non-object in 
/var/www/html/bacula-web-7.0.2/test.php on line 65

Fatal error: Call to a member function getAttribute() on a non-object in 
/var/www/html/bacula-web-7.0.2/core/db/cdb.class.php on line 63


From: Davide Franco [mailto:bacula-...@dflc.ch]
Sent: Thursday, January 22, 2015 9:49 AM
To: bacula-users@lists.sourceforge.net
Subject: [Bacula-users] Bacula-Web 7.0.2 available


Dear all,

I'm really happy to announce that Bacula-Web version 7.0.2 is available from 
now.

This "major bugfix / maintenance" release fixes 13 bugs (including 3 major 
bugs).
I'd strongly suggest everyone to upgrade to this version as quickly as possible.

The release notes will give you more 
details about what's included in this version.

Thanks again to all contributors for your help and your precious feedbacks.

As usual, all questions and feedbacks are welcome.

Best regards

Davide Franco

Project website
http://www.bacula-web.org
--
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] how to debug a job

[Josh Fisher]

On 1/21/2015 6:37 PM, Dimitri Maziuk wrote:

On 01/21/2015 05:12 PM, Heitor Faria wrote:


Hey Mr. Dimitri: do you have Attribute Spooling on for this job (Job

resource, Spool Attributes=yes)? It usually improves the performance if
backing up lots of files, witch maybe causing this bottleneck.

Yes:
 SpoolData = yes
 SpoolAttributes = yes
 Spool Size = 4980736

(Also Maximum Volume Bytes = 4980736 -- these are disk volumes.
And Maximum Network Buffer Size = 65536)


There is likely no reason to have SpoolData=yes for disk volumes, and it 
could actually slow things down.


Is one of the jobs running concurrently with the failing job backing up 
the machine SD is running on? If so, you must check the job for backing 
up the machine that SD is running on and MAKE CERTAIN that it is not 
attempting to backup the spool directory.


The spool directory is by default in the Bacula work directory. You can 
use the SpoolDirectory directive in the device settings in 
bacula-sd.conf to place the spool data on different disk drives. 
Certainly, the spool directory should not be on the same disk drives 
that the database is on. That can cause a huge amount of read/write head 
movement, even with a caching RAID controller. (unless both are on SSD)





synchronous_commit = on

I might try that but I don't believe postgres is the bottleneck.

Looking at the director side, I have Max concurrent jobs = 10 and it
seems only 5 are running (there's more in the queue): 3 from Jan 19th
and 1 from Jan 21st. Is there any kind of scheduling going on that would
starve the job? -- all 5 seem to be spooling...

I might try sticking in an SSD for the spool drive to make sure that's
not the bottleneck.


"setdebug

This command is used to set the debug level in each daemon. The form of this 
command is:
setdebug level=nn [trace=0/1 client= | dir | director | 
storage= | all]

If trace=1 is set, then tracing will be enabled, and the daemon will be placed in 
trace mode, which means that all debug output as set by the debug level will be 
directed to the file bacula.trace in the current directory of the daemon. Normally, 
tracing is needed only for Win32 clients where the debug output cannot be written to 
a terminal or redirected to a file. When tracing, each debug output message is 
appended to the trace file. You must explicitly delete the file when you are 
done."

Source: http://www.bacula.org/2.4.x-manuals/en/main/Bacula_Console.html

Well, that's more helpful than bacula-fd manpage: at least it mentions
the trace file. So where do the debug messages go with trace=0: syslog?
And what are the levels? -- 'cause I started bacula-fd with "-d 9" and I
got nothing in /var/log/messages.



--
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


--
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Bacula-Web 7.0.2 available

[Davide Franco]

Dear all,

I'm really happy to announce that Bacula-Web version 7.0.2 is available from 
now.

This "major bugfix / maintenance" release fixes 13 bugs (including 3 major 
bugs).
I'd strongly suggest everyone to upgrade to this version as quickly as possible.

The release notes will give you more details about what's included in this 
version.
http://www.bacula-web.org/download.html

Thanks again to all contributors for your help and your precious feedbacks.

As usual, all questions and feedbacks are welcome.

Best regards

Davide Franco

Project website
http://www.bacula-web.org
--
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Restoring Files still an issue

[Richard Durivage]

Hello Edmar,

I am using Bacula 5.2.6 through a Virtualmin installation.

[cid:image006.jpg@01D03628.72F9CE30]



[cid:D96AEEBC-8478-4ED0-AA58-0B0EFF2DDFAC@voip.conwaycorp.net][cid:C848E789-712B-4FF3-B334-257C7FC098EB@voip.conwaycorp.net][cid:E585E237-A942-4C80-8569-FD447522943B@voip.conwaycorp.net]

Richard Durivage
IT Support
Atlantic Business Systems
Office (321) 259-7575 Ext. 241
Cell (321) 506-1913
rduriv...@abs4sharp.com

[Description: Description: Description: Description: 
email_sig2][cid:image001.png@01CCEBDE.7A52B710]
"Leveraging Technology to Improve Office Efficiency!"

From: edmar.meloara...@gmail.com [mailto:edmar.meloara...@gmail.com] On Behalf 
Of Edmar Araújo
Sent: Thursday, January 22, 2015 9:41 AM
To: Richard Durivage
Cc: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Restoring Files still an issue

Hi Richard,

Which version of this using Bacula?

In the restore process try using markdir directory and then to mark the files

If possible make available the log restore the bconsole run

joblog list jobid=Number_Job_ID

Best regards!

2015-01-22 12:22 GMT-02:00 Richard Durivage 
mailto:rduriv...@abs4sharp.com>>:
Hello John,

When I restore the files to the Linux server it works fine. They get restored 
to the /etc/bacula/backups folder and with root privileges I am able to see the 
files.



[cid:D96AEEBC-8478-4ED0-AA58-0B0EFF2DDFAC@voip.conwaycorp.net][cid:C848E789-712B-4FF3-B334-257C7FC098EB@voip.conwaycorp.net][cid:E585E237-A942-4C80-8569-FD447522943B@voip.conwaycorp.net]

Richard Durivage
IT Support
Atlantic Business Systems
Office (321) 259-7575 Ext. 241
Cell (321) 506-1913
rduriv...@abs4sharp.com

[Description: Description: Description: Description: 
email_sig2][cid:image001.png@01CCEBDE.7A52B710]
"Leveraging Technology to Improve Office Efficiency!"

From: John Drescher [mailto:dresche...@gmail.com]
Sent: Thursday, January 22, 2015 9:16 AM
To: Richard Durivage
Cc: 
bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Restoring Files still an issue

I am still at a loss to find out why the restore process is restoring only 
folders and not files.

I have tried as suggested in a previous email to reset permissions on those 
restored folders without success. Even after changing permissions I still do 
not see any files being restored even though the output from the Bacula Server 
says the files have been restored.

Any help would be greatly appreciated.

Thank you

Try restoring the files to your linux bacula server.
John

--
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users



--
Atenciosamente,

Edmar Araújo | Daqui a um minuto é o Futuro.

http://3dmar.com

--
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Restoring Files still an issue

[Edmar Araújo]

Hi Richard,

Which version of this using Bacula?

In the restore process try using *markdir* directory and then to *mark* the
files

If possible make available the log restore the bconsole run

joblog list jobid=*Number_Job_ID*

Best regards!

2015-01-22 12:22 GMT-02:00 Richard Durivage :

>  Hello John,
>
>
>
> When I restore the files to the Linux server it works fine. They get
> restored to the /etc/bacula/backups folder and with root privileges I am
> able to see the files.
>
>
>
>
>
>
>
> [image: cid:D96AEEBC-8478-4ED0-AA58-0B0EFF2DDFAC@voip.conwaycorp.net]
> [image:
> cid:C848E789-712B-4FF3-B334-257C7FC098EB@voip.conwaycorp.net]
> [image:
> cid:E585E237-A942-4C80-8569-FD447522943B@voip.conwaycorp.net]
> 
>
>
>
> *Richard Durivage*
> IT Support
> Atlantic Business Systems
> Office (321) 259-7575 Ext. 241
> Cell (321) 506-1913
> *rduriv...@abs4sharp.com *
>
>
>
> [image: Description: Description: Description: Description: email_sig2][image:
> cid:image001.png@01CCEBDE.7A52B710] 
>
> *"Leveraging Technology to Improve Office Efficiency!"*
>
>
>
> *From:* John Drescher [mailto:dresche...@gmail.com]
> *Sent:* Thursday, January 22, 2015 9:16 AM
> *To:* Richard Durivage
> *Cc:* bacula-users@lists.sourceforge.net
> *Subject:* Re: [Bacula-users] Restoring Files still an issue
>
>
>
>  I am still at a loss to find out why the restore process is restoring
> only folders and not files.
>
>
>
> I have tried as suggested in a previous email to reset permissions on
> those restored folders without success. Even after changing permissions I
> still do not see any files being restored even though the output from the
> Bacula Server says the files have been restored.
>
>
>
> Any help would be greatly appreciated.
>
>
>
> Thank you
>
>
>
> Try restoring the files to your linux bacula server.
>
> John
>
>
> --
> New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
> GigeNET is offering a free month of service with a new server in Ashburn.
> Choose from 2 high performing configs, both with 100TB of bandwidth.
> Higher redundancy.Lower latency.Increased capacity.Completely compliant.
> http://p.sf.net/sfu/gigenet
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>


-- 
Atenciosamente,



*Edmar Araújo | Daqui a um minuto é o Futuro.*http://3dmar.com
--
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Restoring Files still an issue

[Richard Durivage]

Hello John,

When I restore the files to the Linux server it works fine. They get restored 
to the /etc/bacula/backups folder and with root privileges I am able to see the 
files.



[cid:D96AEEBC-8478-4ED0-AA58-0B0EFF2DDFAC@voip.conwaycorp.net][cid:C848E789-712B-4FF3-B334-257C7FC098EB@voip.conwaycorp.net][cid:E585E237-A942-4C80-8569-FD447522943B@voip.conwaycorp.net]

Richard Durivage
IT Support
Atlantic Business Systems
Office (321) 259-7575 Ext. 241
Cell (321) 506-1913
rduriv...@abs4sharp.com

[Description: Description: Description: Description: 
email_sig2][cid:image001.png@01CCEBDE.7A52B710]
"Leveraging Technology to Improve Office Efficiency!"

From: John Drescher [mailto:dresche...@gmail.com]
Sent: Thursday, January 22, 2015 9:16 AM
To: Richard Durivage
Cc: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Restoring Files still an issue

I am still at a loss to find out why the restore process is restoring only 
folders and not files.

I have tried as suggested in a previous email to reset permissions on those 
restored folders without success. Even after changing permissions I still do 
not see any files being restored even though the output from the Bacula Server 
says the files have been restored.

Any help would be greatly appreciated.

Thank you

Try restoring the files to your linux bacula server.
John

--
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Restoring Files still an issue

[John Drescher]

>
> I am still at a loss to find out why the restore process is restoring only
> folders and not files.
>
>
>
> I have tried as suggested in a previous email to reset permissions on
> those restored folders without success. Even after changing permissions I
> still do not see any files being restored even though the output from the
> Bacula Server says the files have been restored.
>
>
>
> Any help would be greatly appreciated.
>
>
>
> Thank you
>
>
Try restoring the files to your linux bacula server.

John
--
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Restoring Files still an issue

[Richard Durivage]

Hello List,

I am still at a loss to find out why the restore process is restoring only 
folders and not files.

I have tried as suggested in a previous email to reset permissions on those 
restored folders without success. Even after changing permissions I still do 
not see any files being restored even though the output from the Bacula Server 
says the files have been restored.

Any help would be greatly appreciated.

Thank you





[cid:D96AEEBC-8478-4ED0-AA58-0B0EFF2DDFAC@voip.conwaycorp.net][cid:C848E789-712B-4FF3-B334-257C7FC098EB@voip.conwaycorp.net][cid:E585E237-A942-4C80-8569-FD447522943B@voip.conwaycorp.net]

Richard Durivage
IT Support
Atlantic Business Systems
Office (321) 259-7575 Ext. 241
Cell (321) 506-1913
rduriv...@abs4sharp.com

[Description: Description: Description: Description: 
email_sig2][cid:image001.png@01CCEBDE.7A52B710]
"Leveraging Technology to Improve Office Efficiency!"

--
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] how to debug a job

[Clark, Patricia A.]

I back up over 300T each month.  For that reason I also stay as current as
is reasonably possible on versions of Bacula.  Having upgraded to version
7, I've found that the 6-day hard coded failure appears to have been
removed which has allowed several of my long-running jobs to complete
successfully.  With each release there are not only new features, but
important fixes.  The client version is less critical.

On that note, I also break large jobs into smaller jobs whenever possible.
 If a FULL backup takes 5 days, it will take at least 10 days to recover.
Although, I don't consider 316 GB to be overly large and it should only
take a few hours - but it depends.  You never mentioned how many files
were indicated in the 33 GB.  I have some backups in the 300-400GB range
that take 3-4 days only because it's 7-9 million little files.

Spool disks are shared and the more jobs in process, the slower all of the
jobs will be.  My spool disk is rather simplistic and I cannot speak to
your tiered storage, but I am betting it's also the final destination.
Run some I/O performance tests when your backups are running and when they
are not.  There may be issues there with the number of jobs.

Spooling is for the benefit of tape drives and databases.  What is the
benefit of spooling data for virtual tapes that are really disks?

Patti Clark
Linux System Administrator
R&D Systems Support Oak Ridge National Laboratory


On 1/21/15, 9:42 PM, "Dimitri Maziuk"  wrote:

>On 01/21/2015 06:41 PM, Bill Arlofski wrote:
>
>> Bacula has a hard-coded 6 day limit on a job's run time.   518401
>>seconds =
>> 6.1157 days, so it appears that is the cause for the watchdog
>>killing the job.
>
>Hard-coded, huh? Nobody's tried backing up that big data I keep hearing
>about?
>
>> Does it ask you for a new volume?
>
>No. Good guess, but the storage is a vchanger and it's working just fine.
>
>I killed the lot and replaced the spool disk in the unlikely case that
>was slowing things down -- unlikely because it's a tler disk and
>shouldn't have this particular failure mode. I restarted the offending
>job, we'll see what happens...
>
>-- 
>Dimitri Maziuk
>Programmer/sysadmin
>BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu
>


--
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] how to debug a job

[Luc Van der Veken]

Are you sure bacula is at fault?
I can think of circumstances where the way the source data are organized is to 
blame.

1) Average file size: 1 GB as a million files of 1 KB will be much slower to 
read than a single 1 GB file.
2) Too many files in one directory can make access very slow.

The effect is multiplied if these two are walking hand in hand...


Look at the way some applications spread their data over many subdirectories to 
get around the second problem (Squid proxy comes to mind, with its cached data 
distributed over 4096 directories organized in 2 levels: 16 at the first level, 
each containing 256 subdirs at the second level, each of those containing up to 
256 files).

Another example: some time ago, I and about 200 others had to upload half a 
dozen files a day, each, to a government FTP server.
After several months during which it was never cleaned up, just getting a 
directory listing of the 'incoming' directory took more than 15 minutes. A 
*large* part of those 15 minutes was not transmission time, but a delay before 
anything started coming in.
Problem: all the usual FTP clients for Windows automatically do an 'ls' after 
every 'cd'. It started happening more and more that the server would time out 
the control channel while the client was still waiting for a response on the 
data channel...


-Original Message-
From: Dimitri Maziuk [mailto:dmaz...@bmrb.wisc.edu] 
Sent: 21 January 2015 23:13
To: bacula-users@lists.sourceforge.net
Subject: [Bacula-users] how to debug a job

(Take 2)

I've a client with ~316GB to back up. Currently the backup's been
running for 5 days and wrote 33GB to the spool file. Previous runs
failed with

> User specified Job spool size reached: JobSpoolSize=49,807,365,050 
> MaxJobSpoolSize=49,807,360,000
> Writing spooled data to Volume. Despooling 49,807,365,050 bytes ...
> Error: Watchdog sending kill after 518401 secs to thread stalled reading File 
> daemon.

Why is it taking 5 days to write 33GB?

Load avg on the client is 0.9%. Iperf clocks the connection at 110MB/s.
Iostat shows zero wait and .25MB/s read on the client's disk. every few
seconds bacula-fd shows up in iotop w/ read speed around 200-300K/s.
This is a healthy standard sata drive capable of 100MB/s, with ext4
filesystem.

It's a linux (centos 6) x64 client v. 5.0 and server v. 5.2.13 from
slaanesh repo.

How do I find out what's taking so long? What's the debug level I should
give to bacula-fd? Where do debug messages go? Anyone knows?

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu

--
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users