Re: [Bacula-users] PostgreSQL: WAL and log management
On Fri, 23 Nov 2018 15:54:38 -0600 Dimitri Maziuk via Bacula-users wrote: > If it still hasn't gone down, check your > postgresql.conf for > > #wal_level = replica# minimal, > replica, or logical # (change requires restart) > > If the above is what you have, you could change it to > wal_level = minimal > and restart. Trying this results in (journalclt excerpt): Nov 24 01:11:05 pc postgresql-script[6374]: 2018-11-24 01:11:05.565 EET [6383]FATAL: WAL streaming (max_wal_senders > 0) requires wal_level "replica" or "logical" Nov 24 01:11:05 pc postgresql-script[6374]: pg_ctl: could not start server Nov 24 01:11:05 pc postgresql-script[6374]: Examine the log output. Nov 24 01:11:05 pc systemd[1]: postgresql.service: Control process exited, code=exited status=1 Nov 24 01:11:05 pc systemd[1]: Failed to start PostgreSQL database server. So I commented it back and restarted. > FWIW I just checked another of out postgresql-10 > hosts, this one does a lot of truncates and loaded > on a 10^6+ rows DB, it has #max_wal_size = 1GB > and ~999.5MB in pg_wal when idle. Thanks for the additional info. Right now in pg_wal I have 769MB with 47x16MB files from 19.Nov and 1x16MB from this exact moment. FWIW on this system there isn't any pgsql activity as the only database is that of bacula (and it is still empty as I was waiting for your reply). I read that: https://www.postgresql.org/docs/10/runtime-config-wal.html#GUC-MAX-WAL-SIZE After re-running a few times the scripts for export/import from/to mysql/psql the situation is: # du -hs ~/data/pg_wal/ 769M/var/lib/pgsql/data/pg_wal/ with 11x16MB from this moment and the others from 19.Nov. So obviously some WAL rotation does occur oldest files are replaced by new ones which keeps the overall WAL data the same. I guess this answers my main concern about WAL data (not) filling up the partition. Thank you. -- George ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PostgreSQL: WAL and log management
On 11/20/2018 06:32 PM, George Anchev via Bacula-users wrote: > $ du -hs pg_wal/ > 769Mpg_wal/ > $ psql -U postgres -d postgres -c checkpoint > CHECKPOINT > $ du -hs pg_wal/ > 769Mpg_wal/ If it still hasn't gone down, check your postgresql.conf for #wal_level = replica# minimal, replica, or logical # (change requires restart) If the above is what you have, you could change it to wal_level = minimal and restart. FWIW I just checked another of out postgresql-10 hosts, this one does a lot of truncates and loaded on a 10^6+ rows DB, it has #max_wal_size = 1GB and ~999.5MB in pg_wal when idle. -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu signature.asc Description: OpenPGP digital signature ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Mac FD and permissions
See https://kb.acronis.com/content/61832 (found from https://forum.acronis.com/forum/acronis-true-image-2018-forum/acronis-true-image-2018-fails-backup-macbook-pro-macos-mojave-10141) for a possible solution. I'm not sure what you will have to add to the Full Disk Access list though. __Martin > On Fri, 23 Nov 2018 10:45:13 +0100, Andrea Venturoli said: > > Hello. > > I've installaed bacula-fd 7.4.7 on a Mac (10.13 or 10.14, I don't > remember exactly and I cannot check right now). > > Everything works as expected, except for some permission problems: > during a backup I get: > > > ... > > 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory > > "/Users/admin/Library/Application Support/CallHistoryTransactions": > > ERR=Operation not permitted > > 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory > > "/Users/admin/Library/Application Support/com.apple.TCC": ERR=Operation not > > permitted > > 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory > > "/Users/admin/Library/Application Support/AddressBook": ERR=Operation not > > permitted > > 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory > > "/Users/admin/Library/Application Support/CallHistoryDB": ERR=Operation not > > permitted > > 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory > > "/Users/admin/Library/IdentityServices": ERR=Operation not permitted > > 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory > > "/Users/admin/Library/Calendars": ERR=Operation not permitted > > 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory > > "/Users/admin/Library/Messages": ERR=Operation not permitted > > 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory > > "/Users/admin/Library/Mail": ERR=Operation not permitted > > 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory > > "/Users/admin/Library/Safari": ERR=Operation not permitted > > 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory > > "/Users/admin/Library/Suggestions": ERR=Operation not permitted > > 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory > > "/Users/admin/Library/Containers/com.apple.mail": ERR=Operation not > > permitted > > 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory > > "/Users/admin/Library/Metadata/CoreSpotlight": ERR=Operation not permitted > > 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory > > "/Users/admin/Library/Cookies": ERR=Operation not permitted > > 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory > > "/Users/admin/Library/Caches/CloudKit/com.apple.Safari": ERR=Operation not > > permitted > > 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory > > "/Users/admin/Library/Caches/com.apple.Safari": ERR=Operation not permitted > > 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory > > "/Users/admin/Library/Caches/com.apple.Safari.SafeBrowsing": ERR=Operation > > not permitted > > 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory > > "/Users/timemachine/Library/Safari": ERR=Operation not permitted > > ... > > "ps axu|grep bacula" shows the FD is running as root. > What else must I do in order to allow it to backup everything? > > Forgive me, but I'm not so proficient on Macs and I never installed > Bacula on them before. > > bye & Thanks > av. > > > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] "Sending spooled attrs to the Director" taking over 13 hours
I've started in a new job and am having a problem with bacula where the " Sending spooled attrs to the Director" stage is taking over 13 hours at which point i canceled the job as I didn't understand what was going on. Bacula is version 7.0.5 running on debian 7. The client is a xen host with 12 virtual machines, so there are 12 jobs running on the client. Each job runs a before run script to create a snapshot of the vm. Other jobs on the bacula server to other clients currently run without any problem. The backups to this client were running without any problem when I first arrived on the job 3 weeks ago. One thing that could have caused it is when i canceled some jobs through bconsole that were running from this client. They had been on hold for several days awaiting new media and I canceled them as I had to do a restore. The only other thing of note is that the time is currently out on the client, its almost 12 minutes behind. Here is the end of the job output. Everything is the same as a successful previous job except for the time for sending spooled attribs and my then canceling it. 2018-11-21 22:56:15 hal9000-sd JobId 36667: Despooling elapsed time = 00:01:05, Transfer rate = 133.5 M Bytes/second 2018-11-21 22:56:17 hal9000-sd JobId 36667: Elapsed time=00:48:54, Transfer rate=32.22 M Bytes/second 2018-11-21 22:56:17 hal9000-sd JobId 36667: Alert: smartctl 5.41 2011-06-09 r3365 [x86_64-linux-3.2.0-4-amd64] (local build) 2018-11-21 22:56:17 hal9000-sd JobId 36667: Alert: Copyright (C) 2002-11 by Bruce Allen, http://smartmontools.sourceforge.net 2018-11-21 22:56:17 hal9000-sd JobId 36667: Alert: 2018-11-21 22:56:18 hal9000-sd JobId 36667: Alert: TapeAlert: OK 2018-11-21 22:56:18 hal9000-sd JobId 36667: Alert: 2018-11-21 22:56:18 hal9000-sd JobId 36667: Alert: Error Counter logging not supported 2018-11-21 22:56:18 hal9000-sd JobId 36667: Sending spooled attrs to the Director. Despooling 67,680,530 bytes ... 2018-11-22 13:15:04 hal9000-dir JobId 36667: Bacula hal9000-dir 7.0.5 (28Jul14): Build OS: x86_64-unknown-linux-gnu debian 7.6 JobId: 36667 Job: gattaca.2018-11-21_22.00.00_18 Backup Level: Full (upgraded from Incremental) Client: "mothra-fd" 5.2.6 (21Feb12) x86_64-pc-linux-gnu,debian,jessie/sid FileSet: "gattaca" 2018-01-19 10:08:29 Pool: "DomU-DMZ" (From Job resource) Catalog: "MyCatalog" (From Client resource) Storage: "LTO-5" (From Job resource) Scheduled time: 21-Nov-2018 22:00:00 Start time: 21-Nov-2018 22:03:22 End time: 22-Nov-2018 13:15:04 Elapsed time: 15 hours 11 mins 42 secs Priority: 10 FD Files Written: 0 SD Files Written: 191,431 FD Bytes Written: 0 (0 B) SD Bytes Written: 94,547,732,152 (94.54 GB) Rate: 0.0 KB/s Software Compression: None VSS: no Encryption: no Accurate: no Volume name(s): AID365 Volume Session Id: 18 Volume Session Time: 1542820549 Last Volume Bytes: 94,599,663,616 (94.59 GB) Non-fatal FD errors: 0 SD Errors: 0 FD termination status: Canceled SD termination status: OK Termination: Backup Canceled ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Mac FD and permissions
Hello. I've installaed bacula-fd 7.4.7 on a Mac (10.13 or 10.14, I don't remember exactly and I cannot check right now). Everything works as expected, except for some permission problems: during a backup I get: > ... 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory "/Users/admin/Library/Application Support/CallHistoryTransactions": ERR=Operation not permitted 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory "/Users/admin/Library/Application Support/com.apple.TCC": ERR=Operation not permitted 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory "/Users/admin/Library/Application Support/AddressBook": ERR=Operation not permitted 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory "/Users/admin/Library/Application Support/CallHistoryDB": ERR=Operation not permitted 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory "/Users/admin/Library/IdentityServices": ERR=Operation not permitted 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory "/Users/admin/Library/Calendars": ERR=Operation not permitted 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory "/Users/admin/Library/Messages": ERR=Operation not permitted 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory "/Users/admin/Library/Mail": ERR=Operation not permitted 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory "/Users/admin/Library/Safari": ERR=Operation not permitted 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory "/Users/admin/Library/Suggestions": ERR=Operation not permitted 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory "/Users/admin/Library/Containers/com.apple.mail": ERR=Operation not permitted 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory "/Users/admin/Library/Metadata/CoreSpotlight": ERR=Operation not permitted 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory "/Users/admin/Library/Cookies": ERR=Operation not permitted 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory "/Users/admin/Library/Caches/CloudKit/com.apple.Safari": ERR=Operation not permitted 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory "/Users/admin/Library/Caches/com.apple.Safari": ERR=Operation not permitted 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory "/Users/admin/Library/Caches/com.apple.Safari.SafeBrowsing": ERR=Operation not permitted 22-Nov 23:19 IMac-fd JobId 11647: Could not open directory "/Users/timemachine/Library/Safari": ERR=Operation not permitted > ... "ps axu|grep bacula" shows the FD is running as root. What else must I do in order to allow it to backup everything? Forgive me, but I'm not so proficient on Macs and I never installed Bacula on them before. bye & Thanks av. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
