Re: [Bacula-users] Bacula 9.4 S3 plugin
Hi Kern Sorry , i didn't see the download url provided on bacula site for the libs3, it compiles without errors now , but i have a problem when try to list volumes on s3 storage the bacula-sd process dies returning a "Segmentation Violation" as shown below , i 'm using CentOS 7 but i also tried on Debian 9 installed the binary packages from Bacula Community oficial repo but got the same thing . I'm posting the output of bacula-sd running until die . Any suggestion ? Best Regards Dante Colò root@debian9VM01:/opt/bacula/bin# ./bacula-sd -d100 -dt -v -f 09-Jan-2019 13:30:33 bacula-sd: address_conf.c:274-0 Initaddr 0.0.0.0:9103 09-Jan-2019 13:30:33 am-pdc-sd: jcr.c:131-0 read_last_jobs seek to 192 09-Jan-2019 13:30:33 am-pdc-sd: jcr.c:138-0 Read num_items=0 09-Jan-2019 13:30:33 am-pdc-sd: plugins.c:97-0 load_plugins 09-Jan-2019 13:30:33 am-pdc-sd: plugins.c:133-0 Rejected plugin: want=-sd.so name=bacula-sd-cloud-driver-9.4.1.so len=31 09-Jan-2019 13:30:33 am-pdc-sd: plugins.c:133-0 Rejected plugin: want=-sd.so name=bpipe-fd.so len=11 09-Jan-2019 13:30:33 am-pdc-sd: plugins.c:133-0 Rejected plugin: want=-sd.so name=bacula-sd-aligned-driver-9.4.1.so len=33 09-Jan-2019 13:30:33 am-pdc-sd: plugins.c:121-0 Failed to find any plugins in /opt/bacula/plugins 09-Jan-2019 13:30:33 am-pdc-sd: stored.c:608-0 calling init_dev volume_local_1 09-Jan-2019 13:30:33 am-pdc-sd: init_dev.c:152-0 Num drivers=15 09-Jan-2019 13:30:33 am-pdc-sd: init_dev.c:165-0 loadable=0 type=1 loaded=1 name=file handle=0 09-Jan-2019 13:30:33 am-pdc-sd: init_dev.c:391-0 init_dev: tape=0 dev_name=/backup/bacula/data 09-Jan-2019 13:30:33 am-pdc-sd: stored.c:610-0 SD init done volume_local_1 09-Jan-2019 13:30:33 am-pdc-sd: acquire.c:663-0 Attach 0xc001df8 to dev "volume_local_1" (/backup/bacula/data) 09-Jan-2019 13:30:33 am-pdc-sd: stored.c:608-0 calling init_dev wasabi_s3_1 09-Jan-2019 13:30:33 am-pdc-sd: init_dev.c:152-0 Num drivers=15 09-Jan-2019 13:30:33 am-pdc-sd: init_dev.c:165-0 loadable=1 type=14 loaded=0 name=cloud handle=0 09-Jan-2019 13:30:33 am-pdc-sd: init_dev.c:430-0 loadable=1 type=14 loaded=0 name=cloud handle=0 09-Jan-2019 13:30:33 am-pdc-sd: init_dev.c:435-0 Open SD driver at /opt/bacula/plugins/bacula-sd-cloud-driver-9.4.1.so 09-Jan-2019 13:30:33 am-pdc-sd: bnet_server.c:86-0 Addresses 0.0.0.0:9103 09-Jan-2019 13:30:33 am-pdc-sd: init_dev.c:438-0 Driver=cloud handle=7ff00c001f90 09-Jan-2019 13:30:33 am-pdc-sd: init_dev.c:440-0 Lookup "BaculaSDdriver" in driver=cloud 09-Jan-2019 13:30:33 am-pdc-sd: init_dev.c:442-0 Driver=cloud entry point=7ff012d4ddd0 09-Jan-2019 13:30:33 am-pdc-sd: init_dev.c:391-0 init_dev: tape=0 dev_name=/backup/bacula/cloud 09-Jan-2019 13:30:33 am-pdc-sd: stored.c:610-0 SD init done wasabi_s3_1 09-Jan-2019 13:30:33 am-pdc-sd: acquire.c:663-0 Attach 0xc003e28 to dev "wasabi_s3_1" (/backup/bacula/cloud) 09-Jan-2019 13:30:53 am-pdc-sd: bsock.c:851-0 socket=6 who=client host=172.17.198.11 port=47292 09-Jan-2019 13:30:53 am-pdc-sd: dircmd.c:188-0 Got a DIR connection at 09-Jan-2019 13:30:53 09-Jan-2019 13:30:53 am-pdc-sd: cram-md5.c:69-0 send: auth cram-md5 challenge <2043907137.1547047853@am-pdc-sd> ssl=0 09-Jan-2019 13:30:53 am-pdc-sd: cram-md5.c:133-0 cram-get received: auth cram-md5 <1199549957.1547047853@am-pdc-dir> ssl=0 09-Jan-2019 13:30:53 am-pdc-sd: cram-md5.c:157-0 sending resp to challenge: 9U+ADnlRBG5TBWd4T8YocA 09-Jan-2019 13:30:53 am-pdc-sd: dircmd.c:214-0 Message channel init completed. 09-Jan-2019 13:30:53 am-pdc-sd: dircmd.c:1167-0 Found device wasabi_s3_1 09-Jan-2019 13:30:53 am-pdc-sd: dircmd.c:1211-0 Found device wasabi_s3_1 09-Jan-2019 13:30:53 am-pdc-sd: acquire.c:663-0 Attach 0xc004148 to dev "wasabi_s3_1" (/backup/bacula/cloud) *Bacula interrupted by signal 11: Segmentation violation* Kaboom! bacula-sd, am-pdc-sd got signal 11 - Segmentation violation at 09-Jan-2019 13:30:53. Attempting traceback. Kaboom! exepath=/opt/bacula/bin/ Calling: /opt/bacula/bin/btraceback /opt/bacula/bin/bacula-sd 1244 /var/bacula/working On 31/12/18 17:47, Kern Sibbald wrote: Hello, Sven's libs3 is surely perfectly OK, but if you want the one that Bacula uses, please read the 9.4.1 release notes, as you might want to download the Bacula version which is in the downloads directory on bacula.org. Link provided in the release notes. Best regards, Kern On 12/28/18 7:07 PM, Dante F. B. Colò wrote: Hi Sven Thanks for your reply, In my case m using CentOS 7 , i tried compiled Bacula with libs3 available on epel repository which is even older than this branch you mencioned but it fails to build , i''l try with the version available on your repo. Thank you ! On 27/12/18 18:18, Sven Hartge wrote: On 27.12.18 20:50, Dante F. B. Colò wrote: I'm trying to setup a s3 cloud storage on Bacula Storage Daemon, is there any extra dependencies necessary on the system to build Bacula with the S3 plugin
Re: [Bacula-users] Bacula 9.4 S3 plugin
Hi Sven Thanks for your reply, In my case m using CentOS 7 , i tried compiled Bacula with libs3 available on epel repository which is even older than this branch you mencioned but it fails to build , i''l try with the version available on your repo. Thank you ! On 27/12/18 18:18, Sven Hartge wrote: On 27.12.18 20:50, Dante F. B. Colò wrote: I'm trying to setup a s3 cloud storage on Bacula Storage Daemon, is there any extra dependencies necessary on the system to build Bacula with the S3 plugin ? I already compiled and installed but the bacula-sd process dies when Bacula tries to connect and list a cloud volume from bconsole. I dug into this extensivley while trying (note my wording here) to enable this feature for Debian. First, you need Bacula 9.4.1, because 9.4.0 was missing a crucial bit in the configure script, skipping detection of libs3. Then, as it turns out, you need a very specific version of libs3 for this, namely the GIT version 06a4683 from 2016-12-14. Any older or newer and Bacula won't even compile. To get this ancient version to compile with todays compilers, you need to add two patches, I've isolated them here https://salsa.debian.org/hartge-guest/libs3/tree/master/debian/patches. You need the fix-buffer-sizes.patch and support-newer-curl.patch. Beware: I just tested successful compilation of Bacula with this version of the library, I didn't test if it works at all and if it works, it does so correctly. There is a thread in bacula-devel going over the whole ordeal, if you are interested, I suggest reading it as well. Grüße, Sven. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula 9.4 S3 plugin
Hello everybody I'm trying to setup a s3 cloud storage on Bacula Storage Daemon, is there any extra dependencies necessary on the system to build Bacula with the S3 plugin ? I already compiled and installed but the bacula-sd process dies when Bacula tries to connect and list a cloud volume from bconsole. Best Regards Dante Colò ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore an entire directory from some day
Hi Wanderlei I already did it , but i'll take a look to your script. Thank you From: "Wanderlei Huttel" <wanderleihut...@gmail.com> To: "Martin Simmons" <mar...@lispworks.com> Cc: "Dante F. B. Colò" <dante.c...@stwbrasil.com>, bacula-users@lists.sourceforge.net Sent: Friday, October 21, 2016 7:33:12 AM Subject: Re: [Bacula-users] Restore an entire directory from some day Sorry, I guess you will need to adapt the script, because my script is to restore multiples version of a single file. Best regards Wanderlei Hüttel http://www.huttel.com.br 2016-10-21 7:31 GMT-02:00 Wanderlei Huttel < wanderleihut...@gmail.com > : Hello Dante If you want do restore a multiples jobs from a client in different folders you can use an script that I've done sometime ago. The site is in portuguese, but you can test the script. http://www.huttel.com.br/2016/03/script-para-restaurar-varias-versoes-de-um-arquivo-de-uma-unica-vez/ Best regards Wanderlei Hüttel http://www.huttel.com.br 2016-10-21 6:23 GMT-02:00 Martin Simmons < mar...@lispworks.com > : BQ_BEGIN You can use "Select backup for a client before a specified time" or "Enter a list of files to restore before a specified time" in the bconsole restore command to restore from the Full+Incr jobs all at once. __Martin >>>>> On Fri, 21 Oct 2016 00:46:27 -0200 (BRST), Dante F. B. Colò said: > > Hi Bryn > > Thank you for your reply , i was doing Diff Backups before , i switched back > incremental to save some disk space, what actually i was thinking is > something like find and restore a directory from multiple jobs at once , in > this case a full job and all others incremental to some date. > > > > From: "Bryn Hughes" < li...@nashira.ca > > To: bacula-users@lists.sourceforge.net > Sent: Thursday, October 20, 2016 7:02:23 PM > Subject: Re: [Bacula-users] Restore an entire directory from some day > > On 2016-10-20 01:36 PM, Dante F. B. Colò wrote: > > > > Hello Folks > > I already have been using Bacula for years, in the case of incremental > backups maybe i`m doing do it wrong but when i need for example restore a > folder from someday i restore it from the last full job before that date i > need and all subsequents incrementals backup until the day , is there a > better way to do this ? > > > > > That's what an Incremental is; a backup set containing whatever was not in > the last Incremental. > > A Differential on the other hand contains everything since the last Full. A > typical strategy would be to run a weekly Differential and then daily > Incrementals; that way you need the Full, the Differential and then just the > Incrementals since the last Differential. > > Bryn > > -- > > Check out the vibrant tech community on one of the world's most > engaging tech sites, SlashDot.org! http://sdm.link/slashdot > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > -- Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users BQ_END -- The Command Line: Reinvented for Modern Developers Did the resurgence of CLI tooling catch you by surprise? Reconnect with the command line and become more productive. Learn the new .NET and ASP.NET CLI. Get your free copy! http://sdm.link/telerik___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore an entire directory from some day
Hello martin I found it , thank you . - Original Message - From: "Martin Simmons" <mar...@lispworks.com> To: "Dante F. B. Colò" <dante.c...@stwbrasil.com> Cc: li...@nashira.ca, bacula-users@lists.sourceforge.net Sent: Friday, October 21, 2016 6:23:39 AM Subject: Re: [Bacula-users] Restore an entire directory from some day You can use "Select backup for a client before a specified time" or "Enter a list of files to restore before a specified time" in the bconsole restore command to restore from the Full+Incr jobs all at once. __Martin >>>>> On Fri, 21 Oct 2016 00:46:27 -0200 (BRST), Dante F. B. Colò said: > > Hi Bryn > > Thank you for your reply , i was doing Diff Backups before , i switched back > incremental to save some disk space, what actually i was thinking is > something like find and restore a directory from multiple jobs at once , in > this case a full job and all others incremental to some date. > > > > From: "Bryn Hughes" <li...@nashira.ca> > To: bacula-users@lists.sourceforge.net > Sent: Thursday, October 20, 2016 7:02:23 PM > Subject: Re: [Bacula-users] Restore an entire directory from some day > > On 2016-10-20 01:36 PM, Dante F. B. Colò wrote: > > > > Hello Folks > > I already have been using Bacula for years, in the case of incremental > backups maybe i`m doing do it wrong but when i need for example restore a > folder from someday i restore it from the last full job before that date i > need and all subsequents incrementals backup until the day , is there a > better way to do this ? > > > > > That's what an Incremental is; a backup set containing whatever was not in > the last Incremental. > > A Differential on the other hand contains everything since the last Full. A > typical strategy would be to run a weekly Differential and then daily > Incrementals; that way you need the Full, the Differential and then just the > Incrementals since the last Differential. > > Bryn > > -- > > Check out the vibrant tech community on one of the world's most > engaging tech sites, SlashDot.org! http://sdm.link/slashdot > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > -- The Command Line: Reinvented for Modern Developers Did the resurgence of CLI tooling catch you by surprise? Reconnect with the command line and become more productive. Learn the new .NET and ASP.NET CLI. Get your free copy! http://sdm.link/telerik ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore an entire directory from some day
Hi Bryn Thank you for your reply , i was doing Diff Backups before , i switched back incremental to save some disk space, what actually i was thinking is something like find and restore a directory from multiple jobs at once , in this case a full job and all others incremental to some date. From: "Bryn Hughes" <li...@nashira.ca> To: bacula-users@lists.sourceforge.net Sent: Thursday, October 20, 2016 7:02:23 PM Subject: Re: [Bacula-users] Restore an entire directory from some day On 2016-10-20 01:36 PM, Dante F. B. Colò wrote: Hello Folks I already have been using Bacula for years, in the case of incremental backups maybe i`m doing do it wrong but when i need for example restore a folder from someday i restore it from the last full job before that date i need and all subsequents incrementals backup until the day , is there a better way to do this ? That's what an Incremental is; a backup set containing whatever was not in the last Incremental. A Differential on the other hand contains everything since the last Full. A typical strategy would be to run a weekly Differential and then daily Incrementals; that way you need the Full, the Differential and then just the Incrementals since the last Differential. Bryn -- Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Restore an entire directory from some day
Hello Folks I already have been using Bacula for years, in the case of incremental backups maybe i`m doing do it wrong but when i need for example restore a folder from someday i restore it from the last full job before that date i need and all subsequents incrementals backup until the day , is there a better way to do this ? -- Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
