Re: [Bacula-users] Quantum Scalar i500 slow write speed

ekke85 wrote (2010/08/05): I do not have spooling on and I don't have software compression on. It seems that you have LTO-3 drive(s). If you are not able to constantly backup data atleast at rate 27 MB/s (HP LTO-3) or 40 MB/s (IBM LTO-3), you need the spooling - which is a must. Note that

Re: [Bacula-users] Quantum Scalar i500 slow write speed

ekke85 wrote (2010/08/05): slow. It writes at 22mb/sec. The drives should be able to do a lot more then that. I have to backup 11TB that takes a couple of days to Try tar -cf /dev/null /data-with-11-tb and you will see, if the bottleneck is data source, or something else. How many files do you

[Bacula-users] Restore error with 10 GbE server and 1 GbE client

Hello, is there anybody else, who has experienced similar restore problem as me? If I use bacula server --(10 GbE)-- switch --(1 GbE)-- bacula client, big restores with many small files (for example, 10 million files in 500 GB) end after a while with the following error (small restores under 10

[Bacula-users] Slow tape write, no more than 60-70 MB/s in 5.0.3

Hello, does anybody have any idea, why after upgrade from Bacula 2.4.3 to 5.0.3, tape write speed dropped down from about 70-120 MB/s (LTO-3 tape limits) to just 60-70 MB/s? I think that I have seen somewhere, that something (signatures?) has been moved from clients or director to storage

Re: [Bacula-users] Slow tape write, no more than 60-70 MB/s in 5.0.3

Cejka Rudolf wrote (2011/11/09): Hello, does anybody have any idea, why after upgrade from Bacula 2.4.3 to 5.0.3, tape write speed dropped down from about 70-120 MB/s (LTO-3 tape limits) to just 60-70 MB/s? I think that I have seen somewhere, that something (signatures?) has been moved from

Re: [Bacula-users] Slow tape write, no more than 60-70 MB/s in 5.0.3

Marcio Merlone wrote (2011/11/09): Em 09-11-2011 09:26, Cejka Rudolf escreveu: Cejka Rudolf wrote (2011/11/09): does anybody have any idea, why after upgrade from Bacula 2.4.3 to 5.0.3, tape write speed dropped down from about 70-120 MB/s (LTO-3 tape limits) to just 60-70 MB/s? I

Re: [Bacula-users] Slow tape write, no more than 60-70 MB/s in 5.0.3

Brian Debelius wrote (2011/11/09): Well compiling with -O3 does not seem to have had any increase in throughput for me. :( I'll be moving back to the recommended -O2 after these jobs finish. Yes, it is possible. My problem was that I had no -O at all. -- Rudolf Cejka cejkar at

Re: [Bacula-users] LTO3 tape capacity (variable?)

We've been using LTO3 tapes with bacula for a few years now. Recently I've noticed how variable our tape capacity it, ranging from 200-800 Gb. Is that strictly governed by the compressibility of the actual data being backed up? Hello, the lower bound 200 GB on 400 GB LTO-3 tapes is

Re: [Bacula-users] LTO3 tape capacity (variable?)

Stephen Thompson wrote (2012/09/25): The tape in question have only been used once or twice. Do you mean just one or two drive loads and unloads? The library is a StorageTek whose SLConsole reports no media (or drive) errors, though I will look into those linux-based tools. There are

Re: [Bacula-users] LTO3 tape capacity (variable?)

Alan Brown wrote (2012/09/28): Aren't these considered reasonable settings for LTO3? Maximum block size = 262144 # 256kb Maximum File Size = 2gb Not really. Hi, I have Maximum Block Size = 65536 Maximum File Size = 4gb and without any problem. All tapes have

Re: [Bacula-users] LTO3 tape capacity (variable?)

Alan Brown wrote (2012/10/01): 2Mb is the maximum block size I've found to work on LTO* - it's a bacula limit, not an LTO one. Or it could be a limit of an operating system or of used hw interface. Increasing from 65535 will improve throughput significantly. There have been discussions

[Bacula-users] rc-chio-changer for FreeBSD

Hello, please, could anybody test newer version of rc-chio-changer for FreeBSD (and possibly for OpenBSD/NetBSD) in bacula and send me, with which configuration? It has added listall and transfer commands plus some other smaller modifications. Personally, I do use 120 slot library with 2 tape

Re: [Bacula-users] How to specify drive of Autochanger?

Wolfgang Denk wrote (2012/11/16): I did the same (to test the drives individualy, to make sure these are actually available and working); see the full configuration I posted before here: http://article.gmane.org/gmane.comp.sysutils.backup.bacula.general/72107 Hi, change Device = LTO3-0,

Re: [Bacula-users] How to specify drive of Autochanger?

John Drescher wrote (2012/11/15): However, no matter what I enter at the prompt Enter autochanger drive[0]:, the director will always send a command to access drive index 0. Where do you get this prompt? I have never ever been asked this and I have had an autochanger at work since 2006

Re: [Bacula-users] How to specify drive of Autochanger?

Wolfgang Denk wrote (2012/11/16): Autochanger { Name = Autochanger Device = LTO3-0 Device = LTO3-1 Changer Command = /usr/libexec/bacula/mtx-changer %c %o %S %a %d Changer Device = /dev/tape/by-id/scsi-1BDT_FlexStor_II_00DE64100465_LL0 } Try replacing the

Re: [Bacula-users] LTO5 speed

f.staed...@dafuer.de wrote (2013/01/02): thanks for your quick answer. So the sound of the drive like starting and stopping in about 10 second intervals are normal? Hi, no, it is not normal. Except that you have too small Maximum File Size setting. I have 8 GB, which means atleast one file per

Re: [Bacula-users] LTO-5 Tapes full after between 30-130gb Dell PV-124T

bdoran wrote (2013/01/15): I'm using a Bacula setup in conjunction with a Dell PV-124T which has 16 LTO-5 tapes. The system works correctly except that the tapes become extremely quickly. There is no consistency between the amount written to each tape though it is generally in the range of

Re: [Bacula-users] Time for Accurate Backup

Masopust, Christian wrote (2013/02/12): As there are lots of files within the filesets to be backuped (appr. 600) I would kindly ask you about your experiences with accurate backups. Hello, you can try it yourself - configure it and do estimate. I tried it with client with 15 000 000 files

Re: [Bacula-users] bacula seems not to get mtx-changer output

Marco Carcano- Statusnobilis SA wrote (2013/04/16): /usr/libexec/bacula/mtx-changer /dev/sg3 listall 0 /dev/nst0 Do you have write permissions on /dev/sg3? 3991 Bad autochanger command: /usr/libexec/bacula/mtx-changer /dev/sg3 loaded 1 /dev/nst0 0 3991 result=: ERR=Child died from signal 9:

Re: [Bacula-users] Multiple Catalog Configuration

Mingus Dew wrote (2013/06/03): Does anyone have an example they can share of using mutliple catalogs? I have a particular set of NAS backups that has over 500,000,000 file records and pretty much need to use a separate catalog to hopefully overcome 3 days of table locking while inserting

Re: [Bacula-users] DesSpooling Attr

Iban Cabrillo wrote (2013/11/27): Data spooling: 0 active jobs, 0 bytes; 1 total jobs, 1,845,487,814 max bytes/job. Attr spooling: 1 active jobs, 18,289,433 bytes; 0 total jobs, 18,289,433 max bytes. Data spooling about 10 minutes, Attr Spooling more than 30 minutes and growing This

Re: [Bacula-users] LTO speed optimisation

Bryn Hughes wrote (2014/11/05): Finally there are some OS-level settings for the 'st' driver (I'm assuming you are on Linux). With my LTO3 drives I need to add this to the kernel command line: Hi, Solaris 11. On 2014-11-05 03:48 AM, Roberts, Ben wrote: Hi all, I'd like to try and make

Re: [Bacula-users] LTO-6 - tape cleaning frequency

On Nov 10, 2014, at 10:15 AM, Dan Langille d...@langille.org wrote: How often does your LTO-6 tape drive need to be cleaned? Hi, I bought five cleaning tapes ten years ago. Four are on sale :o) HP LTO-3: Almost never, 7 years of operation HP LTO-5: Almost never, 2 years of operation

Re: [Bacula-users] Failed on backup volume 2 suddenly

Keith T wrote (2014/11/21): BTW, any advise/references of tuning DB dir inserting faster? Thanks in advance! MySQL: MyISAM delay_key_write = ALL and either do not do unexpected power offs (not so hard today), or when the disaster happens, run repair table ... for all tables in bacula dabatase

Re: [Bacula-users] spool disk filesystem, checksums

Daniel Pocock wrote (2014/12/04): On 04/12/14 18:35, Kern Sibbald wrote: On 12/03/2014 08:49 PM, Daniel Pocock wrote: Does Bacula checksum content on the spool disk before sending it to tape? To be more explicit, if there is a single bit error on the spool disk, will it be noticed

Re: [Bacula-users] spool disk filesystem, checksums

Daniel Pocock wrote (2014/12/05): Now it is in the bug tracker: http://bugs.bacula.org/view.php?id=2111 ... Data corruption occurs on disks sometimes, e.g. the write to disk didn't record data correctly on the platter and any attempt to read it returns the corrupted data. This may just be 1 bit

Re: [Bacula-users] Bacula 7 on FreeBSD, suddenly can't do anything

dweimer wrote (2015/01/27): ... Interesting. What did you do right before suddenly actually? Nothing, or something and somewhere? :o) It had me scratching my head for a while, because it was still half working. My nagios and bacula daemons couldn't find any *.local names anymore, but I

Re: [Bacula-users] Bacula 7 on FreeBSD, suddenly can't do anything

dweimer wrote (2015/01/26): I did find a work around, but not sure where the problem is for sure, going to post on FreeBSD list as well. the fix, convert all my hostnames in configuration files from fully qualified DNS to IP addresses. I just did this on a hunch, but apparently something

Re: [Bacula-users] STK SL-3000 experiences

tonyalbers wrote (2015/03/05): Thanks Davide, that's excellent news. If anyone else has got anything to add, please do. Hello, almost nothing. I have five-modules SL-150 with one LTO-5 and one LTO-6 over SAS and under FreeBSD and without any problem. Just I have bought it when it was very

Re: [Bacula-users] Is Bacula and a LTO drive right for me?

Florian Rist wrote (2015/05/17): I don't have the hardware yet. My plan is to get a small cheap server, some low cost CPU (some i3 Core), 6 TB HD (for spooling), a SAS controller and a LTO 5 or 6 drive (probably from Tandberg). I'll need to change tapes manually, any library solution seams

Re: [Bacula-users] Is Bacula and a LTO drive right for me?

Florian Rist wrote (2015/05/18): The question is probably, what happens if a tape change is forgotten. Say I have scheduled backup job for the night and the tape is not change in the evening. Will this mess up everything or will the job automatically be run as soon as the needed tape

Re: [Bacula-users] Is Bacula and a LTO drive right for me?

Bryn Hughes wrote (2015/05/19): Yes, there is definitely a minimum throughput for LTO drives. If you aren't writing from local storage then you almost certainly won't be able to meet it for anything at all modern. LTO-3 was the last generation that could be fed by a gigabit ethernet link

Re: [Bacula-users] Is Bacula and a LTO drive right for me?

Florian Rist wrote (2015/05/18): Thanks for the numbers and pointing me to the spool/unspool problem. This can be fixed by using two hard drives, right? In RAID-0? Let's hope so :o) However, I would rather use better instead of fixed. Another solution would be to allow just one parallel job,

Re: [Bacula-users] Is Bacula and a LTO drive right for me?

Dimitri Maziuk wrote (2015/05/20): Quoting quantum lto-6 sales blurb (http://www.quantum.com/products/tapedrives/ltoultrium/lto-6/index.aspx) Fast backup and restore performance ?at speeds up to 400MB/s (1.4TB/hr)* * Assumes 2.5:1 compression for LTO-6, 2:1 for other LTO Assuming no

[Bacula-users] Bacula with cryptodev on FreeBSD does not work (#0002141)

Hello, this can hopefully save some time to somebody: 0002141: Bacula with cryptodev on FreeBSD does not work Description: For all three daemons - stored, dird and filed: Bacula calls init_crypto() { ... OpenSSL_add_all_algorithms() ...}, which silently opens file descriptor to /dev/crypto

Re: [Bacula-users] LTO Cartridge Memory Specification?

Wolfgang Denk wrote (2015/10/22): > My LTO library can read and display this data; most of it is > self-esplaining, except for a data field "TAF" which probably > contains error or wear information - for most tapes this is empty, > but for a few (old, long used) ones I see entries like "3, 4, 6"

Re: [Bacula-users] Typical tape write performance

Paul Elliott wrote (2015/12/02): > I would be interested to hear what block sizes other LTO5/6 users are > using? LTO-5/SAS on FreeBSD: I still use Maximum Block Size = 65536, because 333 MB/s transfer rate is sufficient for me. I have tried this small script --- #!/bin/sh B=131072 C=32768

Re: [Bacula-users] Typical tape write performance

Dan Langille wrote (2015/12/02): > I had not considered that. In my case, I backup to local HDD (ZFS array) > for long term storage. Right after those jobs finish, I copy to tape. > Sounds like I need to implement spooling now. Fortunately, my full > backups are only about 400GB. I think I can

Re: [Bacula-users] chmod 770 (was Re: Bacula Release 7.4.0)

Dan Langille wrote (2016/02/06): > > Please, why there is > > > > installdirs: > > ... > > chmod 770 $(DESTDIR)$(sysconfdir) > > ... > > > > in Makefile.in? I had sysconfdir set to /usr/local/etc in FreeBSD > > and /etc in Linux, so everywhere I have put new bacula, > > I

Re: [Bacula-users] chmod 770 (was Re: Bacula Release 7.4.0)

Dan Langille wrote (2016/02/08): > Please open a PR (https://bugs.freebsd.org/bugzilla/ > ) and we will work on that. Yes, but mentioned situation in FreeBSD is non-default and rather theoretical. Everybody should be satisfied with default

Re: [Bacula-users] Bacula Release 7.4.0

Kern Sibbald wrote (2016/01/18): > Yesterday, we released Bacula version 7.4.0. Hello, thank you very much ;o) So I have decided that I should finally upgrade my 5.2.12-based backup site to something newer. So I have upgraded server, then 20+ client nodes... And then I have found, that some

Re: [Bacula-users] Windows client 7.0.5 broken?

ou very much. > On 02/26/2016 08:49 AM, Cejka Rudolf wrote: > > Hello, > >after Windows client upgrade from public 5.2.10 to developers' > > gift 7.0.5, I have noticed that incremental jobs started to be too > > big and too slow. Before upgrade with 5.2.10: >

[Bacula-users] Windows client 7.0.5 broken?

Hello, after Windows client upgrade from public 5.2.10 to developers' gift 7.0.5, I have noticed that incremental jobs started to be too big and too slow. Before upgrade with 5.2.10: Elapsed time: 4 hours 28 mins 43 secs FD Files Written: 180,897 FD Bytes Written:

Re: [Bacula-users] Faster reading of Volumes from disk

Dan Langille wrote (2016/02/17): > Writing 334GB to tape takes about 13 minutes. Hello, it means about 334*1024/(13*60) = 438.48 MB/s. Do you really have so fast tape write? -- Rudolf Cejka http://www.fit.vutbr.cz/~cejkar Brno University of Technology, Faculty of Information Technology

Re: [Bacula-users] Trouble setting up Bacula on FreeBSD

Simon Templar wrote (2016/03/01): > Perhaps I should have included this information in the first email, > but I???ve tried several combinations of parameters in the > bacula-sd.conf, and it failed each time. Here are the parts I???ve changed: And perhaps include latest output of btape -c...

Re: [Bacula-users] Copy disk to tape is 4x slower than tar

Dan Langille wrote (2016/03/13): > > As well as increasing max file size you need to boost the tape buffer size > > from the 64kB default. I use 2MB > > This is a hardware setting? Hello, it is software settings: * Increasing max file size is "Maximum File Size". I use 16 GB for LTO-5 and

Re: [Bacula-users] Copy disk to tape is 4x slower than tar

Alan Brown wrote (2016/03/17): > Caveat: BDXL is up to 120GB per disc (quad layer) and It _may_ be worth > investigating this format for backups, but bacula doesn't play nicely > with optical media. > > HVD development (6TB per disc) was abandoned in 2008. Ritek demonstrated > 250GB BDXL

Re: [Bacula-users] Trouble setting up Bacula on FreeBSD

Simon Templar wrote (2016/02/29): > I've set up bacula 7.2 on my FreeBSD server using Postgres as the > backend database. Which FreeBSD version? According to the mt status it seems to be sufficiently fresh. > Device { > ... >Hardware End of Medium = no # Noted as FreeBSD specific

Re: [Bacula-users] SCSI Errors in LTO External Drive

Francisco Javier Funes Nieto wrote (2016/11/07): > Bacula Server 7.4.4 in FreeBSD 10.3 with SCSI 29320ALP and LTO 3 External > SCSI Drive ... > > Doing a btape fill, same thing with btape test, in dmesg: > > (sa0:ahd0:0:3:0): CAM status: SCSI Status Error > (sa0:ahd0:0:3:0): SCSI status: Check

Re: [Bacula-users] Configuring autochanger with SAS LTO-5 drives

Alan Brown wrote (2017/06/08): > LTO5 drives contain at least 1GB of ram which is used to buffer what's > coming from the computer and feed the internal compression/encryption > engines, then buffer the output of those sections to the actual tape itself. Hello, please, which ones? I just found

Re: [Bacula-users] Configuring autochanger with SAS LTO-5 drives

Cejka Rudolf wrote (2017/06/05): > Cejka Rudolf wrote (2017/06/02): > > Ivan Adzhubey wrote (2017/06/01): > > > b) What is the effect of MaximumFileSize option and what would be its > > > optimal > > > value for my IBM LTO-5 SAS drives

Re: [Bacula-users] Configuring autochanger with SAS LTO-5 drives

Ivan Adzhubey wrote (2017/06/01): > b) What is the effect of MaximumFileSize option and what would be its optimal > value for my IBM LTO-5 SAS drives? I have used 8GB value found in one of the > list posts, while the documentation suggests 2GB for LTO-4. But even set at > 8GB this would create

Re: [Bacula-users] Configuring autochanger with SAS LTO-5 drives

Cejka Rudolf wrote (2017/06/02): > Ivan Adzhubey wrote (2017/06/01): > > b) What is the effect of MaximumFileSize option and what would be its > > optimal > > value for my IBM LTO-5 SAS drives? I have used 8GB value found in one of > > the > > list posts, whi

Re: [Bacula-users] Bacula LTO-5

Steven Hammond wrote (2017/05/31): > 1. Is it safe (Bacula 7.XX) to set the block size to something other > than 64K? You have to try it, but it should be safe in Linux. Write data with bigger blocks and read them back with source comparison. btape should do the job too. > 2. Does increasing

Re: [Bacula-users] Bacula LTO-5

Richard Fox wrote (2017/06/01): > Otherwise, this advice is a little contradictory to the documentation which > states "On most modern tape drives, you will not need to specify this > directive.". Given that Linux with LTO-X tape drive is probably a majority system here (not counting

Re: [Bacula-users] Bacula LTO-5

Cejka Rudolf wrote (2017/06/01): > It is too low for LTO-5. It is at the lower limit before tape > shoe shining, problably with some tape stops already here. > The real limit is 47 MB/s for HP and 40 MB/s for IBM, but no > guarantee it is correct. Small clarification about this: Sp

Re: [Bacula-users] Problems getting a tape library to work under FreeBSD

Kenneth Garges wrote (2018/02/01): > I tried chio but gave up on it because anything I did gave an > "Inappropriate ioctl for device" error. Now that a reboot seems to > have gotten mtx working I found that chio works too. Ok, mtx works just once after reboot. Some delay helps, or not? And chio,

Re: [Bacula-users] Problems getting a tape library to work under FreeBSD

Kenneth Garges wrote (2018/01/30): > I???m having trouble getting a tape library to work. Hello, try chio status -v or mtx status. Both should return status of your autochanger including tape labels. If they both do return an error, do you have correct permissons on /dev/ch*? I have the following

Re: [Bacula-users] Bytes/block=64,512 for an LT04

Dan Langille wrote (2017/12/21): > Hello, > > I'm using Bacula 7.4.7 on FreeBSD 11 > > What Bytes/block are you using for your LTO4 tapes? Oops, I waited for the others and now I see that I'm waiting too much :o) I still do use Maximum Block Size = 65536 and I never had the problem. The big

Re: [Bacula-users] Windows backup slow

Hello, I have exactly the same problem: Too slow filesystem traversal by Bacula Windows Client. I think that it has to be some problem with Bacula Client cross compilation (low level of compiler optimalization?), some setting or some other little thing, because if I switch the client to Bareos,

Re: [Bacula-users] Windows backup slow

Josh Fisher wrote (2020/04/23): > On 4/22/2020 12:23 PM, Cejka Rudolf wrote: > > Hello, > >I have exactly the same problem: Too slow filesystem traversal by > > Bacula Windows Client. I think that it has to be some problem with > > Bacula Client cross compila

Re: [Bacula-users] Slow Spooling / Despooling - Solved

Dr. Thorsten Brandau wrote (2023/05/26): > Understanding the parameter helps. Thanks to UDO I could dramatically > increase the despooling speed. > > MaximumFileSize MUST be increased at last with tapes like an LTO. So I have > set > > MaximumFileSize = 54GB > > An went from 100-120 MB/s to 260

Re: [Bacula-users] Tape Libraries

IT Manager via Bacula-users wrote (2023/06/26): > I'm looking at replacing 4 different backup systems with a single solution > that can backup > Windows (server and desktop), Linux and Unix. Bacula is currently very high > up the list but > there's one make or break requirement, which is tape

Re: [Bacula-users] Windows backup slow

Hello, just small FYI, after switching from 9.x.x to 11.x.x it seems that speed problem has been fixed. Cejka Rudolf wrote (2020/04/30): > Josh Fisher wrote (2020/04/23): > > On 4/22/2020 12:23 PM, Cejka Rudolf wrote: > > > Hello, > > >I have exactly the same p

Re: [Bacula-users] LTO tape performances, again...

Hello, you need all of these: In job director section: - Spool Data = yes, attribute spooling is automatically enabled too In device storage section: - Maximum File Size = 32 GB, for LTO-6 and older you can think about 16 GB - Sufficient Maximum Job Spool Size or Maximum Spool Size, so

Re: [Bacula-users] Overland-Tandberg TD-LTO9xSA LTO9HH SAS External Tape Drive Kit

Rob Gerber wrote (2024/02/29): > For a changer, which I think you will not have with your system, it mainly > needs to work with the mtx command (I think same command is available on > bsd?). Hello, native is chio. There are some examples in examples/autochangers in sources, where I do use