[Bacula-users] bacula-fd failing
I'm having issues with bacula-fd failing on our Redhat server. I'm also having
difficulty finding detail on where to configure the client's verbosity,
/var/log/bacula is empty as is the messages log. Not sure what caused this
issue. This installation has been in place for some time and only recently
began failing.
installed
bacula-client.x86_64 2.4.4-12.el5installed
bacula-common.x86_64 2.4.4-12.el5installed
on RHEL5
--bacula-fd.conf--
Director {
Name = krustykrab-dir
Password = witheld
}
#
# Global File daemon configuration specifications
#
FileDaemon { # this is me
Name = servername-fd
FDport = 9102 # where we listen for the director
WorkingDirectory = /var/spool/bacula
Pid Directory = /var/run
Maximum Concurrent Jobs = 20
Any input would be appreciated!
Thanks
Troy Kocher
_
Scanned by IBM Email Security Management Services
powered by MessageLabs.
_
--
CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431iu=/4140/ostg.clktrk
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Trouble getting jobs to run simultaneously
All,
Recently I've made changes to my bacula-dir and bacula-sd to with the intent of
running simultaneous jobs. After the changes my testing seems to indicate I
still don't have it right. I launched my first job 'Image_Backup' manually
with it's default priority, then launched the retail job modifying the priority
to 1, with the hope to force a simultaneous backup. The retail job sat waiting
for the image job to complete. I've attached the relevant sections from my
bacula-dir.conf. If anyone has any helpful thoughts I'd really appreciate it.
Troy
bacula-server-5.2.6
excerpt from bacula-dir.conf:
Pool{
Name = ImageF
Pool Type = Backup
Volume Use Duration = 7d
Volume Retention = 24 months
Catalog Files = yes
Label Format = ImageF-
Recycle = yes
AutoPrune = yes
}
Pool
{
Name = RetailF
Pool Type = Backup
Maximum Volume Jobs = 4
Volume Use Duration = 2d
Volume Retention = 6 months
Catalog Files = yes
Label Format = RetailF-
Recycle = yes
AutoPrune = yes
}
Job {
Name = Image_Backup
Enabled = YES
Type = Backup
Level= Full
Accurate= yes #[Yes|No]
Client = krusty-fd
Fileset = krusty-image
Max Wait Time = 72000
Schedule = WeeklyCycle
Storage = krustykrab-6
Messages = Standard
Pool = ImageF
Write Bootstrap = /data/working/image.bsr
Priority = 50
}
Job {
Name = Retail_Backup
Enabled = Yes
Type = Backup
Level= Full
Accurate= yes
Client = retail-fd
Fileset = retail
Max Wait Time = 72000
Schedule = WeeklyCycle
Storage = krustykrab-5
Messages = Standard
Pool = RetailF
Write Bootstrap = /data/working/retail.bsr
Priority = 60
}
FileSet{
Name = krusty-image
Include {
Options {
Compression = GZIP
signature = SHA1
Sparse = yes
Hardlinks = no
}
@/usr/local/etc/backuplist/krusty_image_backuplist
}}
FileSet{
Name = retail
Include {
Options {
Compression = GZIP
signature = SHA1
Sparse = yes
Hardlinks = no
}
@/usr/local/etc/backuplist/Retail_backuplist
}
Exclude {
File=/usr/home/sessions
}}
Storage {
Name = krustykrab-6
Address = krustykrab
SDPort = 9103
Password = removed
Device = krustykrabpool-6
Media Type = File-6
Maximum Concurrent Jobs = 20
}
Storage {
Name = krustykrab-5
Address = krustykrab
SDPort = 9103
Password = password
Device = krustykrabpool-5
Media Type = File-5
Maximum Concurrent Jobs = 20
}
excerpt from bacula-sd.conf
Device {
Name = krustykrabpool-5
Media Type = File-5
Archive Device = /data/Retail
LabelMedia = yes;
Random Access = Yes;
AutomaticMount = yes;
RemovableMedia = no;
AlwaysOpen = yes;
}
Device {
Name = krustykrabpool-6
Media Type = File-6
Archive Device = /data/Image
LabelMedia = yes;
Random Access = Yes;
AutomaticMount = yes;
RemovableMedia = no;
AlwaysOpen = yes;
}
_
Scanned by IBM Email Security Management Services
powered by MessageLabs.
_
--
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
Remotely access PCs and mobile devices and provide instant support
Improve your efficiency, and focus on delivering more value-add services
Discover what IT Professionals Know. Rescue delivers
http://p.sf.net/sfu/logmein_12329d2d
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bacula-dir incl help
All
I have the following in my bacula-dir.conf:
FileSet{
Name = Microsoft_MTA3
Include {
Options {
Compression = GZIP
signature = MD5
Exclude = yes
IgnoreCase = yes
}
@/usr/local/etc/backuplist/mta3_backuplist
}}
#cat backuplist/mta3_backuplist
File = C:/
WildDir = [A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/Cache
WildDir = [A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/Cache.Trash
WildDir = [A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/ImapMail
..cut..
trying to start and I receive this complaint:
#bacula start
Starting the Bacula Storage daemon
Starting the Bacula File daemon
Starting the Bacula Director daemon
21-Nov 11:34 bacula-dir: ERROR TERMINATION at inc_conf.c:411
Config error: Keyword WildDir not permitted in this resource
: line 2, col 8 of file /usr/local/etc/backuplist/mta3_backuplist
WildDir = [A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/Cache
But when my bacula-dir.conf has the Wild keyword without an include file
director starts.
FileSet{
Name = Microsoft_MTA3
Include {
Options {
Compression = GZIP
signature = MD5
Exclude = yes
IgnoreCase = yes
WildDir = [A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/Cache
WildDir = [A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/Cache.Trash
WildDir = [A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/ImapMail
..cut..
WildDir = [A-Z]:/psdata
}
File = C:/
}}
I suspect I've something simple wrong. Could someone offer some assistance.
Thanks you
Troy
_
Scanned by IBM Email Security Management Services
powered by MessageLabs.
_
--
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-dir incl help
On 21,Nov 2012, at 2:20 PM, Melissari, Ryan wrote:
All
I have the following in my bacula-dir.conf:
FileSet{
Name = Microsoft_MTA3
Include {
Options {
Compression = GZIP
signature = MD5
Exclude = yes
IgnoreCase = yes
}
@/usr/local/etc/backuplist/mta3_backuplist
}}
#cat backuplist/mta3_backuplist
File = C:/
WildDir = [A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/Cache
WildDir = [A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/Cache.Trash
WildDir = [A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/ImapMail
..cut..
trying to start and I receive this complaint:
#bacula start
Starting the Bacula Storage daemon
Starting the Bacula File daemon
Starting the Bacula Director daemon
21-Nov 11:34 bacula-dir: ERROR TERMINATION at inc_conf.c:411
Config error: Keyword WildDir not permitted in this resource
: line 2, col 8 of file
/usr/local/etc/backuplist/mta3_backuplist
WildDir = [A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/Cache
But when my bacula-dir.conf has the Wild keyword without an include
file director starts.
FileSet{
Name = Microsoft_MTA3
Include {
Options {
Compression = GZIP
signature = MD5
Exclude = yes
IgnoreCase = yes
WildDir = [A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/Cache
WildDir = [A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/Cache.Trash
WildDir = [A-Z]:/Documents and Settings/*/Application
Data/*/Profiles/*/*/ImapMail
..cut..
WildDir = [A-Z]:/psdata
}
File = C:/
}}
I suspect I've something simple wrong. Could someone offer some
assistance.
Thanks you
Troy
Troy,
The WildDir flag needs to be in an Options {} resource. In your fileset, you
closed the Options resource before you brought in mta3_backuplist. Move
@/usr/local/etc/backuplist/mta3_backuplist inside your Options {} and it
should work. You will probably also have to take File = C:/ out of
mta3_backuplist and move it outside your Options resource. Another way to do
it would be to add another Option resource inside the mta3_backuplist file
that contains your WildDir excludes.
Ryan,
Thanks for taking time to look at that for me. That was exactly the problem.
All the best!
Troy
_
Scanned by IBM Email Security Management Services
powered by MessageLabs.
_
--
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Multiple bacula-sd dameons on same server?
On 10/5/12 6:10 PM, Phil Stracchino wrote: On 05/10/2012 05:16 PM, Troy Kocher wrote: Oh wise ones.. Demand on my bacula installation is growing and I need to increase the amount of simultaneous inbound data. One option that occurred to me was is it possible to launch multiple daemons on different ports of the same physical server? All the data is written to disk only, no tape. If not any ideas for increasing my inbound capacity here would be really helpful. Currently I have jobs configured to cancel when they can't run in their window, to keep things from getting out of control when the job in line first takes to long. Thanks in advance ! First of all, the elephant-in-the-middle-of-the-room question is How sure are you that inbound data bandwidth, rather than storage I/O, is your bottleneck? As best I can be..? The server is 70TB with about 10TB used. It's RAID6 @ the controller. I'm using FreeBSD's ZFS on a mirrored SSD filesystem and a second 250GB SSD for the ZFS's cache. 2x Xeon 2.1 Quad-core, 32GB RAM. It seems very responsive. I haven't tested I/O any further, not something I've ever spent time on, typically all my FreeBSD installations run great on the GENERIC kernel. When I make a backup of the database on this server, internal disk to disk it runs @ 117,365KB/s. Other servers range from 1,200 KB/s to my first trial desktop client ran @ 12,523KB/s. Occasionally I have a client run ~100KB/s, and I haven't determined why. Most of the clients are interconnected via 1000MB copper Ethernet, although some may be only 100MB, I'll have to investigate further. As I'm thinking thru my potential bottlenecks, the Ethernet backbone has the slowest through-put @ 100MB, perhaps that is the issue? If I have optimized everything I can find, and still need more inbound data bandwidth is it possible to run multiple sd instances, pointing to the same disk array? Thanks for the response! _ Scanned by IBM Email Security Management Services powered by MessageLabs. _ -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Multiple bacula-sd dameons on same server?
Oh wise ones.. Demand on my bacula installation is growing and I need to increase the amount of simultaneous inbound data. One option that occurred to me was is it possible to launch multiple daemons on different ports of the same physical server? All the data is written to disk only, no tape. If not any ideas for increasing my inbound capacity here would be really helpful. Currently I have jobs configured to cancel when they can't run in their window, to keep things from getting out of control when the job in line first takes to long. Thanks in advance ! Troy _ Scanned by IBM Email Security Management Services powered by MessageLabs. _ -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Freebsd snapshots and complaints Will not descend
On 11,Oct 2011, at 1:53 AM, Christian Manal wrote: Am 10.10.2011 21:11, schrieb Troy Kocher: On 10,Oct 2011, at 1:12 PM, Martin Simmons wrote: On Mon, 10 Oct 2011 11:51:14 -0500, Troy Kocher said: 08-Oct 23:57 kfoobarb-sd JobId 2858: Job write elapsed time = 14:45:49, Transfer rate = 2.702 M Bytes/second Are you running an automounter for home directories? That could explain both the Will not descend messages and also why the warnings vary over time. __Martin I'm not running an automounter. And as I mentioned this error is intermittent. I run this job incremental daily without complaint, I get this issue on the differential weekly run. Regarding the time warning, I corrected this once by forcing an ntp on the fd client. I think my ntp must not be running properly over there. Beginning to feel like it's something with the snapshot (/mnt/foobar) not responding as a normal file system under load, and telling bacula-fd access is delayed/denied/?, then bacula understands the delay as device unreachable? Troy Hi, bacula won't recurse filesystems if you don't explicitly tell it to. Look at the onefs option for the fileset resource: http://bacula.org/5.0.x-manuals/en/main/main/Configuring_Director.html#8566 Thanks for the suggestions I investigated onefs on your suggestion, and it gave me a hint as to the a potential fix. On my client snapshot process isn't working properly. The daily unmount is broken and I have multiple days (6) mounts being mounted in the same location /mnt/foobar. I'm going to fix that umount issue and see if my problems go away. Thank you! -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Freebsd snapshots and complaints Will not descend
Listers,
I'm having intermittent issues with a backup job that completes OK but
complains saying Will not descend into various user folders within a jail.
Over the weekend this job ran twice and on the first occasion it complained
about a larger set than on the second occasion. Although many of the same
complaints were generated by both jobs. The file daemon is running on FreeBSD
7.3-RELEASE-p4, bacula-client-5.0.2, and takes snapshots of the jails and
mounts them for the director. The director daemon is running FreeBSD
8.2-RELEASE-p3, bacula-server-5.0.3, and has the following config for this
server:
FileSet{
Name = foobar
Include {
Options {
Compression = GZIP
signature = SHA1
Sparse = yes
Hardlinks = no
}
@/usr/local/etc/backuplist/foobar_backuplist
}}
Pool
{
Name = foobarF
Pool Type = Backup
Storage = kfoobarb
Maximum Volume Jobs = 4
Maximum Volume Bytes = 270g
Volume Use Duration = 2d
Volume Retention = 10 days
Catalog Files = yes
Label Format = foobarF-
Recycle = yes
AutoPrune = yes
}
Job {
Name = Foobar_Backup
Enabled = Yes#[Yes|NO]
Type = Backup #[Backup,Restore,Verify,Admin]
Level= Full
Accurate= yes #[Yes|No]
Client = tao-fd
Fileset = foobar
Schedule = WeeklyCycle
Storage = kfoobarb
Messages = Standard
Pool = foobarF
Write Bootstrap = /data/working/foobar.bsr
Priority = 40
}
#cat /usr/local/etc/foobar_backuplist
File = /mnt/foobar/usr
File = /mnt/foobar/var
File = /mnt/foobar/etc
File = /mnt/foobar/root
Given the intermittent nature of this I tend to think it is more likely
something outside bacula, perhaps the snapshot as daily I have unexplained
complaints from an unrelated rsync process, on the same snapshot:
rsync: writefd_unbuffered failed to write 4 bytes to socket [sender]: Broken
pipe (32)
rsync: read error: Connection reset by peer (54)
rsync error: error in rsync protocol data stream (code 12) at io.c(760)
[sender=3.0.8]
Any comments about the config or troubleshooting thought would be really
appreciated.
Thank you
Troy Kocher
--
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2dcopy1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Fwd: Freebsd snapshots and complaints Will not descend
the snapshot as daily I have unexplained complaints from an unrelated rsync process, on the same snapshot: rsync: writefd_unbuffered failed to write 4 bytes to socket [sender]: Broken pipe (32) rsync: read error: Connection reset by peer (54) rsync error: error in rsync protocol data stream (code 12) at io.c(760) [sender=3.0.8] Any comments about the config or troubleshooting thought would be really appreciated. Thank you Troy Kocher -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fwd: Freebsd snapshots and complaints Will not descend
On 10,Oct 2011, at 12:02 PM, David Romerstein wrote: On Mon, Oct 10, 2011 at 12:51 PM, Troy Kocher tkoc...@mtadistributors.com wrote: 08-Oct 23:48 jailhost-fd JobId 2858: /mnt/foobar/usr/home/ltartmp is a different filesystem. Will not descend from /mnt/foobar/usr into /mnt/foobar/usr/home/ltartmp From http://www.sibbald.com/bacula/html-manual/FileSet_Resource.html: Bacula's default for processing directories is to recursively descend in the directory saving all files and subdirectories. Bacula will not by default cross filesystems (or mount points in Unix parlance). This means that if you specify the root partition (e.g. /), Bacula will save only the root partition and not any of the other mounted filesystems. Similarly on Windows systems, you must explicitly specify each of the drives you want saved (e.g. c:/ and d:/ ...). In addition, at least for Windows systems, you will most likely want to enclose each specification within double quotes particularly if the directory (or file) name contains spaces. The df command on Unix systems will show you which mount points you must specify to save everything. -- D Thanks for the response, I'm aware of how recursively descending works. I use it on many other snapshot/jails and haven't had any issues getting other deeply buried folders I need backed up. It works just as the manual describes. There seems to be something unique about how this particular job/snapshot combination behaves, and that is what I'm trying to troubleshoot. Troy -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fwd: Freebsd snapshots and complaints Will not descend
On 10,Oct 2011, at 1:12 PM, Martin Simmons wrote: On Mon, 10 Oct 2011 11:51:14 -0500, Troy Kocher said: 08-Oct 23:57 kfoobarb-sd JobId 2858: Job write elapsed time = 14:45:49, Transfer rate = 2.702 M Bytes/second Are you running an automounter for home directories? That could explain both the Will not descend messages and also why the warnings vary over time. __Martin I'm not running an automounter. And as I mentioned this error is intermittent. I run this job incremental daily without complaint, I get this issue on the differential weekly run. Regarding the time warning, I corrected this once by forcing an ntp on the fd client. I think my ntp must not be running properly over there. Beginning to feel like it's something with the snapshot (/mnt/foobar) not responding as a normal file system under load, and telling bacula-fd access is delayed/denied/?, then bacula understands the delay as device unreachable? Troy -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-dir starting on ipv6 ONLY, why?
On Sep 21, 2011, at 3:22 PM, Troy Kocher wrote:
Listers,
I've installed a new bacula server recently and am working to get it in
production. It's FreeBSD 8.2-RELEASE, (GENERIC), with a default build of
Bacula 5.0.3 sever client, from the ports tree. The previous server was
5.0.0_1 on Freebsd 7.4. I brought over my pgsql database, my configs, and my
data to the new server. It appears I've done something to cause the
director to run in ipv6 only. Is this by default in 5.0.3? If so how do I
correct it? Have I made an error in the dir config? Please see below for
my details.
foobar# head /usr/local/etc/bacula-dir.conf
Director {# define myself
Name = foobar-dir
Dirport = 9101# where we listen for UA connections
QueryFile = /usr/local/share/bacula/query.sql
WorkingDirectory = /data/working
PidDirectory = /var/run
Maximum Concurrent Jobs = 20
Password = mypassword # Console password
Messages = Daemon
}
foobar# bacula start
Starting the Bacula Storage daemon
Starting the Bacula File daemon
Starting the Bacula Director daemon
foobar# bconsole
Connecting to Director foobar:9101
^C
foobar# sockstat
USER COMMANDPID FD PROTO LOCAL ADDRESS FOREIGN ADDRESS
bacula bacula-dir 36947 3 tcp6 ::1:26407 ::1:5432
bacula bacula-dir 36947 4 tcp6 ::1:65226 ::1:5432
bacula bacula-dir 36947 5 tcp6 ::1:31295 ::1:5432
This is a connection from bacula-dir to your PostgresSQL database. I don't
see bacula-dir listening on 9101 yet…
You also said:
Some additional details here, after about 30s the bacula-dir ipv6 seems to
die and the only thing left listening is my bacula-fd bacula-sd.
That makes me suspect the database connection. I would start bacula-dir in
the foreground with -d SOMEVALUE and see what messages you got.
PostgreSQL is local, interesting that bacula-dir still attempts to find the
database server on ipv6?!
root bacula-fd 36940 3 tcp4 *:9102*:*
bacula bacula-sd 36932 3 tcp4 *:9103*:*
Any assistance would really be appreciated.
Thanks you Dan! the issue was the PostgreSQL database permission and
configuration. It's all corrected and working now.
Thanks
Troy Kocher
--
Dan Langille - http://langille.org
--
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2dcopy1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bacula-dir starting on ipv6 ONLY, why?
Listers,
I've installed a new bacula server recently and am working to get it in
production. It's FreeBSD 8.2-RELEASE, (GENERIC), with a default build of
Bacula 5.0.3 sever client, from the ports tree. The previous server was
5.0.0_1 on Freebsd 7.4. I brought over my pgsql database, my configs, and my
data to the new server. It appears I've done something to cause the director
to run in ipv6 only. Is this by default in 5.0.3? If so how do I correct it?
Have I made an error in the dir config? Please see below for my details.
foobar# head /usr/local/etc/bacula-dir.conf
Director {# define myself
Name = foobar-dir
Dirport = 9101# where we listen for UA connections
QueryFile = /usr/local/share/bacula/query.sql
WorkingDirectory = /data/working
PidDirectory = /var/run
Maximum Concurrent Jobs = 20
Password = mypassword # Console password
Messages = Daemon
}
foobar# bacula start
Starting the Bacula Storage daemon
Starting the Bacula File daemon
Starting the Bacula Director daemon
foobar# bconsole
Connecting to Director foobar:9101
^C
foobar# sockstat
USER COMMANDPID FD PROTO LOCAL ADDRESS FOREIGN ADDRESS
bacula bacula-dir 36947 3 tcp6 ::1:26407 ::1:5432
bacula bacula-dir 36947 4 tcp6 ::1:65226 ::1:5432
bacula bacula-dir 36947 5 tcp6 ::1:31295 ::1:5432
root bacula-fd 36940 3 tcp4 *:9102*:*
bacula bacula-sd 36932 3 tcp4 *:9103*:*
Any assistance would really be appreciated.
Thanks
Troy Kocher
--
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2dcopy1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-dir starting on ipv6 ONLY, why?
Listers,
Some additional details here, after about 30s the bacula-dir ipv6 seems to die
and the only thing left listening is my bacula-fd bacula-sd.
Thanks again...
On 21,Sep 2011, at 2:22 PM, Troy Kocher wrote:
Listers,
I've installed a new bacula server recently and am working to get it in
production. It's FreeBSD 8.2-RELEASE, (GENERIC), with a default build of
Bacula 5.0.3 sever client, from the ports tree. The previous server was
5.0.0_1 on Freebsd 7.4. I brought over my pgsql database, my configs, and my
data to the new server. It appears I've done something to cause the director
to run in ipv6 only. Is this by default in 5.0.3? If so how do I correct it?
Have I made an error in the dir config? Please see below for my details.
foobar# head /usr/local/etc/bacula-dir.conf
Director {# define myself
Name = foobar-dir
Dirport = 9101# where we listen for UA connections
QueryFile = /usr/local/share/bacula/query.sql
WorkingDirectory = /data/working
PidDirectory = /var/run
Maximum Concurrent Jobs = 20
Password = mypassword # Console password
Messages = Daemon
}
foobar# bacula start
Starting the Bacula Storage daemon
Starting the Bacula File daemon
Starting the Bacula Director daemon
foobar# bconsole
Connecting to Director foobar:9101
^C
foobar# sockstat
USER COMMANDPID FD PROTO LOCAL ADDRESS FOREIGN ADDRESS
bacula bacula-dir 36947 3 tcp6 ::1:26407 ::1:5432
bacula bacula-dir 36947 4 tcp6 ::1:65226 ::1:5432
bacula bacula-dir 36947 5 tcp6 ::1:31295 ::1:5432
root bacula-fd 36940 3 tcp4 *:9102*:*
bacula bacula-sd 36932 3 tcp4 *:9103*:*
Any assistance would really be appreciated.
Thanks
Troy Kocher
--
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2dcopy1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
_
Scanned by IBM Email Security Management Services
powered by MessageLabs.
_
--
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2dcopy1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bextract not returning data
Success!! Given the difficulties I was having with bextract, I decided to go back to bscan an try again (3th time) to get the volume into the database and use restore to get the files I needed. It worked!.. I think what was happening before was the nightly jobs were running and pruning the database, before I got round to restoring the data. Anyway thanks to all who responded! This is a great community of folk. Troy On 28,Jun 2011, at 6:22 AM, Martin Simmons wrote: On Mon, 27 Jun 2011 14:07:35 -0500, Troy Kocher said: All, I could really use some ideas.. #bextract -d99 -i databaselist.rest -V DatabaseF-0027 /data/bacula /data/tmp bextract: stored_conf.c:698-0 Inserting director res: foobar-dir bextract: butil.c:282 Using device: /data/bacula for reading. bextract: acquire.c:109-0 MediaType dcr= dev=File bextract: acquire.c:228-0 opened dev pool (/data/bacula) OK bextract: acquire.c:231-0 calling read-vol-label Volume Label: Id: Bacula 1.0 immortal VerNo : 11 VolName : DatabaseF-0027 PrevVolName : VolFile : 0 LabelType : VOL_LABEL LabelSize : 186 PoolName : DatabaseF MediaType : File PoolType : Backup HostName : foobar.mtadistributors.com Date label written: 06-Sep-2010 02:23 bextract: acquire.c:235-0 Got correct volume. 24-Jun 11:16 bextract JobId 0: Ready to read from volume DatabaseF-0027 on device pool (/data/bacula). bextract: attr.c:281-0 -rw-rw 1 pgsqlpgsql 386091824 2011-06-09 08:51:47 /data/tmp/mnt/database/usr/home/pgsql/dumps/mta.dump.sql.gz-4 bextract JobId 0: -rw-rw 1 pgsqlpgsql 386091824 2011-06-09 08:51:47 /data/tmp/mnt/database/usr/home/pgsql/dumps/mta.dump.sql.gz-4 -- I started this on Friday and this morning a zero byte file existed @ '/data/tmp/mnt/database/usr/home/pgsql/dumps/mta.dump.sql.gz-4'. Top showed the one of the processors working on 'bextract' and consuming 100%. Any help would be greatly appreciated! Which version of Bacula? Can you try attaching gdb to the bextract process and doing: thread apply all bt __Martin -- All of the data generated in your IT infrastructure is seriously valuable. Why? It contains a definitive record of application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-d2d-c2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bextract not returning data
All, I could really use some ideas.. #bextract -d99 -i databaselist.rest -V DatabaseF-0027 /data/bacula /data/tmp bextract: stored_conf.c:698-0 Inserting director res: foobar-dir bextract: butil.c:282 Using device: /data/bacula for reading. bextract: acquire.c:109-0 MediaType dcr= dev=File bextract: acquire.c:228-0 opened dev pool (/data/bacula) OK bextract: acquire.c:231-0 calling read-vol-label Volume Label: Id: Bacula 1.0 immortal VerNo : 11 VolName : DatabaseF-0027 PrevVolName : VolFile : 0 LabelType : VOL_LABEL LabelSize : 186 PoolName : DatabaseF MediaType : File PoolType : Backup HostName : foobar.mtadistributors.com Date label written: 06-Sep-2010 02:23 bextract: acquire.c:235-0 Got correct volume. 24-Jun 11:16 bextract JobId 0: Ready to read from volume DatabaseF-0027 on device pool (/data/bacula). bextract: attr.c:281-0 -rw-rw 1 pgsqlpgsql 386091824 2011-06-09 08:51:47 /data/tmp/mnt/database/usr/home/pgsql/dumps/mta.dump.sql.gz-4 bextract JobId 0: -rw-rw 1 pgsqlpgsql 386091824 2011-06-09 08:51:47 /data/tmp/mnt/database/usr/home/pgsql/dumps/mta.dump.sql.gz-4 -- I started this on Friday and this morning a zero byte file existed @ '/data/tmp/mnt/database/usr/home/pgsql/dumps/mta.dump.sql.gz-4'. Top showed the one of the processors working on 'bextract' and consuming 100%. Any help would be greatly appreciated! Thanks Troy -- All of the data generated in your IT infrastructure is seriously valuable. Why? It contains a definitive record of application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-d2d-c2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore of files when they don't list
I decided on bextract. I've found the file I need in the volume, but still having problems... #bextract -d99 -i databaselist.rest -V DatabaseF-0027 /data/bacula /data/tmp bextract: stored_conf.c:698-0 Inserting director res: fatboy-dir bextract: butil.c:282 Using device: /data/bacula for reading. bextract: acquire.c:109-0 MediaType dcr= dev=File bextract: acquire.c:228-0 opened dev pool (/data/bacula) OK bextract: acquire.c:231-0 calling read-vol-label Volume Label: Id: Bacula 1.0 immortal VerNo : 11 VolName : DatabaseF-0027 PrevVolName : VolFile : 0 LabelType : VOL_LABEL LabelSize : 186 PoolName : DatabaseF MediaType : File PoolType : Backup HostName : foobar.mtadistributors.com Date label written: 06-Sep-2010 02:23 bextract: acquire.c:235-0 Got correct volume. 24-Jun 11:16 bextract JobId 0: Ready to read from volume DatabaseF-0027 on device pool (/data/bacula). bextract: attr.c:281-0 -rw-rw 1 pgsqlpgsql 386091824 2011-06-09 08:51:47 /data/tmp/mnt/database/usr/home/pgsql/dumps/mta.dump.sql.gz-4 bextract JobId 0: -rw-rw 1 pgsqlpgsql 386091824 2011-06-09 08:51:47 /data/tmp/mnt/database/usr/home/pgsql/dumps/mta.dump.sql.gz-4 I have one processor going @ 100%, a file touched in the restore location but O bytes being written into the file. Thoughts? Troy On 24,Jun 2011, at 2:28 AM, Graham Keeling wrote: On Thu, Jun 23, 2011 at 02:01:56PM -0700, Steve Ellis wrote: On 6/23/2011 1:31 PM, Troy Kocher wrote: Listers, I'm trying to restore data from medicaid 27, but it appears there are no files. There is a file corresponding with this still on the disk, so I think it's just been purged from the database. Could someone help me thru the restore process when the files are no longer in the database. Thanks! Troy There are really only 3 options here that I can think of: 1) restore the entire job (probably to an temporary location), then prune the bits you don't want. 2) use bscan of the volume to recreate the file list in the db (note that I have only used this when the job itself had been expired from the DB) 3) restore a dump of the catalog that contains the file entries that you wanted that have been expired 4) Use bextract. I'm pretty sure I've done both #1 and #2, #3 I'd be much more reluctant to just try, as I would worry about clobbering more recent catalog data, unless you used a separate catalog db for the restoration. Unless the job is really huge, I'd probably do #1, because bscan is (slightly) dodgy, especially for backups that span volumes (IMHO, note that it is _much_ better than not having bscan at all). Sorry I can't provide more detail, hopefully someone else will be able to help more. -se smime.p7s Description: S/MIME cryptographic signature -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense.. http://p.sf.net/sfu/splunk-d2d-c1___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Restore of files when they don't list
Listers, I'm trying to restore data from medicaid 27, but it appears there are no files. There is a file corresponding with this still on the disk, so I think it's just been purged from the database. Could someone help me thru the restore process when the files are no longer in the database. Thanks! Troy *list pools +++-+-+--+-+ | poolid | name | numvols | maxvols | pooltype | labelformat | +++-+-+--+-+ | 8 | DatabaseF | 5 | 0 | Backup | DatabaseF- | Select the Pool (1-21): 15 +-++---+-++--+--+-+--+---+---+-+ | mediaid | volumename | volstatus | enabled | volbytes | volfiles | volretention | recycle | slot | inchanger | mediatype | lastwritten | +-++---+-++--+--+-+--+---+---+-+ | 5 | DatabaseF-0005 | Used | 1 | 10,523,990,936 |2 | 2,592,000 | 1 |0 | 0 | File | 2011-06-01 02:46:26 | | 21 | DatabaseF-0021 | Used | 1 | 9,789,860,703 |2 | 2,592,000 | 1 |0 | 0 | File | 2011-06-08 02:36:45 | | 27 | DatabaseF-0027 | Used | 1 | 10,410,167,386 |2 | 2,592,000 | 1 |0 | 0 | File | 2011-06-16 00:10:55 | | 33 | DatabaseF-0033 | Append| 1 | 10,509,175,135 |2 | 2,592,000 | 1 |0 | 0 | File | 2011-06-23 02:54:28 | | 37 | DatabaseF-0037 | Used | 1 | 12,293,658,856 |2 | 2,592,000 | 1 |0 | 0 | File | 2011-05-25 02:39:36 | +-++---+-++--+--+-+--+---+---+-+ *list media pool=15 files jobid=27 Jobid 27 used 0 Volume(s): No results to list. No results to list. No results to list. smime.p7s Description: S/MIME cryptographic signature -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Restore issues
Listers, Hope someone can provide some help. I have installed Bacula-Server 5.0.0_1 Bacula-Client 5.0.0 from FreeBSD 7.3RELEASE's ports collection on my backup server named (fatso) fatso-dir, fatso-sd, and fatso-fd. I have another FreeBSD7.2RELEASE box named (database) running postgresql-server-8.4.4_2, with several databases, along with bacula. I use NO tape, but rather back everything up to disk on fatso-sd. I have several clients, FreeBSD Windows. 80% of them preform nightly backups without any problem, with only a few file errors on the window boxes. Therefore I believe my configuration good, although in need of a little tuning. My issue is restoring. Today I noticed one of my email users was missing data. So I tried to dig it out of Bacula. I identified the job I wanted to look in: -rw-r- 1 bacula wheel6462085756 Jul 13 02:21 MailF-0087 -rw-r- 1 bacula wheel1716756031 Jul 19 02:15 MailF-0091 But when I tried to query it. . *restore Automatically selected Catalog: MyCatalog Using Catalog MyCatalog First you select one or more JobIds that contain files to be restored. .. To select the JobIds, you have the following choices: 1: List last 20 Jobs run 2: List Jobs where a given File is saved 3: Enter list of comma separated JobIds to select .. Select item: (1-13): 3 Enter JobId(s), comma separated, to restore: 87 Unable to get Job record for JobId=87: ERR=sql_get.c:316 No Job found for JobId 87 How do I cause bacula to read these volumes and/or rewrite them into database? It concerns me that even though it appears for the dates on volumes in my backup directory, that dailys are working properly, but is the catalog on pgsql getting updated ?? Tips would really be appreciated. Thanks Troy smime.p7s Description: S/MIME cryptographic signature -- This SF.net email is sponsored by Sprint What will you do first with EVO, the first 4G phone? Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
