Re: [Bacula-users] Copy Job to Another Catalog
Hello Heitor, 2018-07-18 19:42 GMT+02:00 Heitor Faria : > Dear Users, > > I'm planning to deploy a Copy Job for Geographical Redundancy Disaster > Recovery (Site A, Site B). > Failover site (B) has a secondary Bacula Director, Catalog and Storage > Daemon. > So far, so good. :) > Do you think it is possible to perform Copy jobs from Site A to Site B, > using the failover Catalog as the metadata repository? > No. :) You have to make a standard failover of a single Bacula env when you'll prepare a DR plan and not force to make a "migration" from one Bacula env (site A) into a second Bacula env (site B). What I implement in this case are: - failover site has an offline installation of Dir + Cat (both services stopped) - SD is running as online service as it will receive replication data (volumes) - implement a cyclic "rsync" of configuration files (any file replication method will work) - implement a standby database on site B (i.e. https://wiki.postgresql.org/wiki/Hot_Standby) - run a standard copy jobs from site A into a site B (all information about jobs at site A and B are saved into a single catalog which is replicated) the failover procedure goes as follow (could be scripted or performed manually) - the plan assumes that site A is no longer accessible and burned in hell :) - switch standby catalog to a standard one (will require a database configuration change and restart) - run all required Bacula services which were offline on site B - delete all volumes from site A which are no longer available from catalog (using bconsole) then all your job copies becomes masters - your site B is now your main and should include all jobs replicated until disaster Above procedure was implemented in real world and tested. works like a charm. best regards -- Radosław Korzeniewski rados...@korzeniewski.net -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Copy Job to Another Catalog
>> Dan, Hello Jari, Dan, >> >> I'm planning to deploy a Copy Job for Geographical Redundancy Disaster >> Recovery >> (Site A, Site B). >> Failover site (B) has a secondary Bacula Director, Catalog and Storage >> Daemon. >> Do you think it is possible to perform Copy jobs from Site A to Site B, >> using >> the failover Catalog as the metadata repository? >> >> > Hello > > As far as I know a Copy job is not possible to be running on two storage > daemons. That is what I learned when I had a need for it. > That was once the case, it is no longer. I copy jobs between two bacula-sd now. >>> It changed in 7.0.0: >>> http://www.bacula.org/9.0.x-manuals/en/main/New_Features_in_7_0_0.html#SECTION00611000 >>> >>> >>> The documentation is incorrect: >>> http://www.bacula.org/9.0.x-manuals/en/main/Migration_Copy.html#SECTION00283 >>> >>> >>> "Migration is only implemented for a single Storage daemon. You cannot read >>> on >>> one Storage daemon and write on another." > > Good to know, that it is now possible. Current arrangement works, but future > will be possibly different! Yes - copy between different Storage Daemon's Devices works but it looks like there is no way to directly also copy the backup metadata to another Catalog, which was the OP. I know bscan can be used, I have customers that do it from mailed removable media, but it is just not computing effort wise to scan all the copy volumes after backup. > br. jarif Regards, -- Heitor Medrado de Faria | CEO Bacula América Latina, Brasil & USA | Visto EB-1 | LPIC-III | EMC 05-001 | ITIL-F • Não seja tarifado pelo tamanho dos seus backups, conheça o Bacula Enterprise http://www.bacula.com.br/enterprise/ • Ministro treinamento e implementação in-company do Bacula Community http://www.bacula.com.br/in-company/ • Compre o novo livro do Bacula http://www.bacula.com.br/livro • Brazil +55 (61) 98268-4220 | USA +1 (323) 300-5387 | www.bacula.com.br Indico as capacitações complementares: Shell básico e Programação em Shell com Julio Neves | Zabbix com Adail Host. -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Copy Job to Another Catalog
> Kern Sibbald kirjoitti 21.7.2018 kello 8.02: > > Dan, > > Oops. It looks like I made a major improvement but the documentation never > made it back into the manual. I will correct that one -- thanks for pointing > it out Dan. I wonder how many more of these new features have not been put > back into the main body of the manual. Perhaps now is the time to correct > it. In fact I have been planning to make a big effort on the manual. > > Best regards, > Kern > > On 07/21/2018 12:50 AM, Dan Langille wrote: >>> On Jul 20, 2018, at 6:26 PM, Dan Langille >>> wrote: >>> >>> Signed PGP part >>> On Jul 19, 2018, at 1:41 PM, Jari Fredriksson wrote: Signed PGP part > Heitor Faria > kirjoitti 18.7.2018 kello 20.42: > > Dear Users, > > I'm planning to deploy a Copy Job for Geographical Redundancy Disaster > Recovery (Site A, Site B). > Failover site (B) has a secondary Bacula Director, Catalog and Storage > Daemon. > Do you think it is possible to perform Copy jobs from Site A to Site B, > using the failover Catalog as the metadata repository? > > Hello As far as I know a Copy job is not possible to be running on two storage daemons. That is what I learned when I had a need for it. >>> That was once the case, it is no longer. I copy jobs between two bacula-sd >>> now. >>> >>> >> It changed in 7.0.0: >> http://www.bacula.org/9.0.x-manuals/en/main/New_Features_in_7_0_0.html#SECTION00611000 >> >> >> The documentation is incorrect: >> http://www.bacula.org/9.0.x-manuals/en/main/Migration_Copy.html#SECTION00283 >> >> >> "Migration is only implemented for a single Storage daemon. You cannot read >> on one Storage daemon and write on another." >> Good to know, that it is now possible. Current arrangement works, but future will be possibly different! br. jarif signature.asc Description: Message signed with OpenPGP -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Copy Job to Another Catalog
Dan, Oops. It looks like I made a major improvement but the documentation never made it back into the manual. I will correct that one -- thanks for pointing it out Dan. I wonder how many more of these new features have not been put back into the main body of the manual. Perhaps now is the time to correct it. In fact I have been planning to make a big effort on the manual. Best regards, Kern On 07/21/2018 12:50 AM, Dan Langille wrote: On Jul 20, 2018, at 6:26 PM, Dan Langille wrote: Signed PGP part On Jul 19, 2018, at 1:41 PM, Jari Fredriksson wrote: Signed PGP part Heitor Faria kirjoitti 18.7.2018 kello 20.42: Dear Users, I'm planning to deploy a Copy Job for Geographical Redundancy Disaster Recovery (Site A, Site B). Failover site (B) has a secondary Bacula Director, Catalog and Storage Daemon. Do you think it is possible to perform Copy jobs from Site A to Site B, using the failover Catalog as the metadata repository? Hello As far as I know a Copy job is not possible to be running on two storage daemons. That is what I learned when I had a need for it. That was once the case, it is no longer. I copy jobs between two bacula-sd now. It changed in 7.0.0: http://www.bacula.org/9.0.x-manuals/en/main/New_Features_in_7_0_0.html#SECTION00611000 The documentation is incorrect: http://www.bacula.org/9.0.x-manuals/en/main/Migration_Copy.html#SECTION00283 "Migration is only implemented for a single Storage daemon. You cannot read on one Storage daemon and write on another." -- Dan Langille - BSDCan / PGCon d...@langille.org -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Copy Job to Another Catalog
> On Jul 20, 2018, at 6:26 PM, Dan Langille wrote: > > Signed PGP part >> On Jul 19, 2018, at 1:41 PM, Jari Fredriksson wrote: >> >> Signed PGP part >> >> >>> Heitor Faria kirjoitti 18.7.2018 kello 20.42: >>> >>> Dear Users, >>> >>> I'm planning to deploy a Copy Job for Geographical Redundancy Disaster >>> Recovery (Site A, Site B). >>> Failover site (B) has a secondary Bacula Director, Catalog and Storage >>> Daemon. >>> Do you think it is possible to perform Copy jobs from Site A to Site B, >>> using the failover Catalog as the metadata repository? >>> >> >> Hello >> >> As far as I know a Copy job is not possible to be running on two storage >> daemons. That is what I learned when I had a need for it. > > That was once the case, it is no longer. I copy jobs between two bacula-sd > now. > It changed in 7.0.0: http://www.bacula.org/9.0.x-manuals/en/main/New_Features_in_7_0_0.html#SECTION00611000 The documentation is incorrect: http://www.bacula.org/9.0.x-manuals/en/main/Migration_Copy.html#SECTION00283 "Migration is only implemented for a single Storage daemon. You cannot read on one Storage daemon and write on another." -- Dan Langille - BSDCan / PGCon d...@langille.org signature.asc Description: Message signed with OpenPGP -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Copy Job to Another Catalog
> On Jul 19, 2018, at 1:41 PM, Jari Fredriksson wrote: > > Signed PGP part > > >> Heitor Faria kirjoitti 18.7.2018 kello 20.42: >> >> Dear Users, >> >> I'm planning to deploy a Copy Job for Geographical Redundancy Disaster >> Recovery (Site A, Site B). >> Failover site (B) has a secondary Bacula Director, Catalog and Storage >> Daemon. >> Do you think it is possible to perform Copy jobs from Site A to Site B, >> using the failover Catalog as the metadata repository? >> > > Hello > > As far as I know a Copy job is not possible to be running on two storage > daemons. That is what I learned when I had a need for it. That was once the case, it is no longer. I copy jobs between two bacula-sd now. signature.asc Description: Message signed with OpenPGP -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Copy Job to Another Catalog
> Heitor Faria kirjoitti 18.7.2018 kello 20.42: > > Dear Users, > > I'm planning to deploy a Copy Job for Geographical Redundancy Disaster > Recovery (Site A, Site B). > Failover site (B) has a secondary Bacula Director, Catalog and Storage Daemon. > Do you think it is possible to perform Copy jobs from Site A to Site B, using > the failover Catalog as the metadata repository? > Hello As far as I know a Copy job is not possible to be running on two storage daemons. That is what I learned when I had a need for it. I implemented a solution using two pools with different folders for the files, and the ”remote” folder being an nfs mount to a remote site. Then I created a After Job Script creating symlinks to both folders referring to media files in the other folder. I had only one Director, so using two Dirs needs some another work around. For example you could bscan somehow in the remote site the media into the local dir. All this is absolutely not ideal for your purpose, but I guess something like this is needed with Bacula for this. Maybe Bacula Systems will develop something this enterprisey in the futuree, only time will tell. br. jarif signature.asc Description: Message signed with OpenPGP -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Copy Job to Another Catalog
> Dear Users, Hello Me, > I'm planning to deploy a Copy Job for Geographical Redundancy Disaster > Recovery > (Site A, Site B). > Failover site (B) has a secondary Bacula Director, Catalog and Storage Daemon. > Do you think it is possible to perform Copy jobs from Site A to Site B, using > the failover Catalog as the metadata repository? >From my research, only the Client resource supports the Catalog Directive. Then I tried a fake local backup Client resource with a remote Catalog directive (MyCatalog2) for this Copy Job. This does not work, however, because of the Copy Job looking for Jobs on the remote catalog, instead of searching in the local. Perhaps, a NextCatalog feature would be a nice new feature for the Copy Jobs. > Regards, > -- Regards, -- Heitor Medrado de Faria | CEO Bacula América Latina, Brasil & USA | Visto EB-1 | LPIC-III | EMC 05-001 | ITIL-F • Não seja tarifado pelo tamanho dos seus backups, conheça o Bacula Enterprise http://www.bacula.com.br/enterprise/ • Ministro treinamento e implementação in-company do Bacula Community http://www.bacula.com.br/in-company/ • Compre o novo livro do Bacula http://www.bacula.com.br/livro • Brazil +55 (61) 98268-4220 | USA +1 (323) 300-5387 | www.bacula.com.br Indico as capacitações complementares: Shell básico e Programação em Shell com Julio Neves | Zabbix com Adail Host. -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Copy Job to Another Catalog
Dear Users, I'm planning to deploy a Copy Job for Geographical Redundancy Disaster Recovery (Site A, Site B). Failover site (B) has a secondary Bacula Director, Catalog and Storage Daemon. Do you think it is possible to perform Copy jobs from Site A to Site B, using the failover Catalog as the metadata repository? Regards, -- Heitor Medrado de Faria | CEO Bacula América Latina, Brasil & USA | Visto EB-1 | LPIC-III | EMC 05-001 | ITIL-F • Não seja tarifado pelo tamanho dos seus backups, conheça o Bacula Enterprise http://www.bacula.com.br/enterprise/ • Ministro treinamento e implementação in-company do Bacula Community http://www.bacula.com.br/in-company/ • Compre o novo livro do Bacula http://www.bacula.com.br/livro • Brazil +55 (61) 98268-4220 | USA +1 (323) 300-5387 | www.bacula.com.br Indico as capacitações complementares: Shell básico e Programação em Shell com Julio Neves | Zabbix com Adail Host. -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
