[Bacula-users] Bacula configuration for non-amazon s3 providers.
Hi,
I am trying to setup Bacula 9.6.3 to run on an ubuntu 18.04 laptop.
The intent is to use Bacula community as my backup program to cloud,
primarily because the data are encrypted before it leaves the laptop,
and Bacula can minimize the cost.
I am using a non-amazon s3 provider: netdepot.com
s3fs works with netdepot.com, with no problems. I copied and pasted
files into and out of the same bucket to which I am trying to connect
Bacula.
Bacula has no problem backing up to, and restoring from a directory, but
when I try to use the cloud storage pointed at netdepot.com, it cannot
make the connection.
This is the message I get:
You have messages.
*messages
23-Apr 17:29 user1-Standard-PC-i440FX-PIIX-1996-dir JobId 3: No prior
Full backup Job record found.
23-Apr 17:29 user1-Standard-PC-i440FX-PIIX-1996-dir JobId 3: No prior or
suitable Full backup found in catalog. Doing FULL backup.
23-Apr 17:29 user1-Standard-PC-i440FX-PIIX-1996-dir JobId 3: Start
Backup JobId 3, Job=BackupClient1-to-Cloud.2020-04-23_17.29.45_04
23-Apr 17:29 user1-Standard-PC-i440FX-PIIX-1996-dir JobId 3: Using
Device "dev.nd1" to write.
23-Apr 17:29 user1-Standard-PC-i440FX-PIIX-1996-fd JobId 3: Fatal error:
job.c:3013 Comm error with SD. bad response to Append Data. ERR=No data
available
*
I am pretty sure that I don't understand how to configure the dir and sd
config files properly.
Here is the relevant part of what I have for the bacula-dir.conf file:
Job {
Name = "BackupClient1-to-Cloud"
JobDefs = "DefaultJob"
Storage = nd1_storage
}
Here is what I have for the sd config file:
Device {
Name = dev.nd1
Device Type = Cloud
Cloud = S3Cloud
Archive Device = /home/user1/dirNFS/bu/bacula_cloudstorage_test
Maximum Part Size = 1000
Media Type = CloudType
LabelMedia = yes;
Random Access = Yes;
AutomaticMount = yes
RemovableMedia = no
AlwaysOpen = no
}
Cloud {
Name = S3Cloud
Driver = "S3"
HostName = "us-central-1-s3.netdepot.com"
BucketName = "test_bucket"
Access Key =
Secret Key =
Protocol = HTTPS
UriStyle = VirtualHost
Truncate Cache = No
Upload = EachPart
Region = "us-central-1"
MaximumUploadBandwidth = 5MB/s
}
Might someone lend a hand?
Al
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-dir 9.4.4 runnig on Centos 6.4 host and bacula-fd 9.4.4 running on Centos 7.8.
Hi folks, I'm running CentOS 7.7 in the Bacula server and have also got one client running CentOS 7.7. Never had any problems with firewalld. Just keep firewalld running, and make sure the appropriate ports are allowed (default 9101, 9102, 9103), plus other ports you need. Using firewalld or iptables is just a matter of personal taste/convenience. Best regards, Peter On 2020-04-23 20:17, dmaziuk via Bacula-users wrote: On 4/23/2020 7:45 AM, Martin Simmons wrote: Check if the Centos 7.8 host is running a firewall (e.g. run iptables -L -v). Centos 7 installs firewalld by default. Disable it (don't remove it) and install iptables-services instead. Dima ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-dir 9.4.4 runnig on Centos 6.4 host and bacula-fd 9.4.4 running on Centos 7.8.
On 4/23/2020 7:45 AM, Martin Simmons wrote: Check if the Centos 7.8 host is running a firewall (e.g. run iptables -L -v). Centos 7 installs firewalld by default. Disable it (don't remove it) and install iptables-services instead. Dima ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Windows backup slow
On 4/22/2020 12:23 PM, Cejka Rudolf wrote: Hello, I have exactly the same problem: Too slow filesystem traversal by Bacula Windows Client. I think that it has to be some problem with Bacula Client cross compilation (low level of compiler optimalization?), some setting or some other little thing, because if I switch the client to Bareos, incremental backup is usually two to three times faster than with Bacula client in my environment. I tried many versions of clients including the oldest clients from times, when projects "splitted", but behavior of all versions has been the same: All Bacula clients were two to three times slower than all Bareos clients for incremental backups in my environment. Very disappointing and I did not find anything yet, what could change that. Are you using the same Maximum Network Buffer size on both? People have reported issues in the past with the default 64k Maximum Network Buffer Size on Windows. Try reducing that to 32k. I have two Windows servers. The first one is doable using Bacula Windows Client, but on the second one, I had to switch to Bareos Windows Client, because Bacula Windows Client did not want to finish under 20 hours, while Bareos Windows Client needs just 8 to 9 hours. And I really do not know, what to do after a year, two or three... backup-dir Version: 9.4.4 (28 May 2019) x86_64-unknown-freebsd11.3 freebsd 11.3-STABLE bacula-fd Version: 9.4.4 (28 May 2019) VSS Linux Cross-compile Win64 bareos-fd Version: 17.2.4 (21 Sep 2017) VSS Linux Cross-compile Win64 (maybe the last working client with Bacula server?) Best regards. Andrew Watkins wrote (2020/04/22): Thanks folks, I have a feeling it's nothing to do with the network, but the speed of bacula searching the filesystem. In 1 minute it only searched 11k (Examined=67,235 & 60seconds later Examined=72,873) Any ideas except get a better server? and the following seems to be showing that there is only 1 process scanning the files? *stat client=winfs-fd Connecting to Client winfs-fd at winfs.dcs.bbk.ac.uk:9102 winfs-fd Version: 9.6.3 (09 March 2020) VSS Linux Cross-compile Win64 Daemon started 22-Apr-20 15:02. Jobs: run=0 running=1. Microsoft Standard Edition (build 9200), 64-bit Priv 0x22f Memory: WorkingSetSize: 23,273,472 QuotaPagedPoolUsage: 259,456 QuotaNonPagedPoolUsage: 19,896 PagefileUsage: 12,668,928 APIs=OPT,ATP,LPV,CFA,CFW, WUL,WMKD,GFAA,GFAW,GFAEA,GFAEW,SFAA,SFAW,BR,BW,SPSP, WC2MB,MB2WC,FFFA,FFFW,FNFA,FNFW,SCDA,SCDW, GCDA,GCDW,GVPNW,GVNFVMPW,LZO,!EFS Heap: heap=23,273,472 smbytes=399,505 max_bytes=425,467 bufs=296 max_bufs=353 Sizes: boffset_t=8 size_t=8 debug=100 trace=1 mode=0,0 bwlimit=0kB/s Running Jobs: JobId 155 Job BackupWINFS.2020-04-22_14.10.06_10 is running. VSS Incremental Backup Job started: 22-Apr-20 15:10 Files=2 Bytes=1,829 AveBytes/sec=2 LastBytes/sec=0 Errors=0 Bwlimit=0 ReadBytes=1,829 Files: Examined=67,235 Backed up=2 Processing file: G:/home/abella05/Desktop SDReadSeqNo=6 fd=1300 SDtls=0 Director connected at: 22-Apr-20 15:23 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-dir 9.4.4 runnig on Centos 6.4 host and bacula-fd 9.4.4 running on Centos 7.8.
Check if the Centos 7.8 host is running a firewall (e.g. run iptables -L -v). __Martin > On Thu, 23 Apr 2020 10:55:24 +, "Shaligram Bhagat, Yateen (Nokia said: > > Hello > > I have bacula-dir 9.4.4 runnig on Centos 6.4 host and bacula-fd 9.4.4 running > on client host with Centos 7.8. > (I assume this should not be an issue) > > On the director when I execute console command "status client=" I get > error > > *status client=CLIENT-fd > Connecting to Client CLIENT-fd at CLIENT:9102 > Failed to connect to Client CLIENT-fd. > > I have ensured that the director name and director password in the client > config file is properly entered in the director's client resource. > > Additional info: > telnet CLIENT 9102 is giving following error: > root@bacula-server log]# telnet CLIENT 9102 > Trying CLIENT... > telnet: connect to address CLIENT : No route to host > but ping, nslookup to CLIENT is going through. > Also on CLIENT bconsole "status dir=" command is going though > > I am not facing this issue when both the bacula-dir and bacula-fd are running > on Centos 6.4 ; each one on a separate host > > Thanks > Yateen Bhagat > > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bacula-dir 9.4.4 runnig on Centos 6.4 host and bacula-fd 9.4.4 running on Centos 7.8.
Hello I have bacula-dir 9.4.4 runnig on Centos 6.4 host and bacula-fd 9.4.4 running on client host with Centos 7.8. (I assume this should not be an issue) On the director when I execute console command "status client=" I get error *status client=CLIENT-fd Connecting to Client CLIENT-fd at CLIENT:9102 Failed to connect to Client CLIENT-fd. I have ensured that the director name and director password in the client config file is properly entered in the director's client resource. Additional info: telnet CLIENT 9102 is giving following error: root@bacula-server log]# telnet CLIENT 9102 Trying CLIENT... telnet: connect to address CLIENT : No route to host but ping, nslookup to CLIENT is going through. Also on CLIENT bconsole "status dir=" command is going though I am not facing this issue when both the bacula-dir and bacula-fd are running on Centos 6.4 ; each one on a separate host Thanks Yateen Bhagat ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
