Re: [Bacula-users] Simultaneousky backup to local HDD and Amazon S3
Zitat von John Drescher dresche...@gmail.com: On Fri, Oct 5, 2012 at 8:35 AM, lst_ho...@kwsoft.de wrote: Zitat von John Drescher dresche...@gmail.com: On Thu, Oct 4, 2012 at 11:18 PM, Pubudu Perera suharsha...@gmail.com wrote: Thank John! So, that means there's no way to does the job simultaneously ? You could run 2 concurrent jobs (one to each storage) but that would cause 2 times the load on your client. John But not with Windows Clients and VSS enabled. With this only one job at a time is started and subsequent jobs have to wait until the first finish :-( For that you may (depending on your setup) be able to work around the bug/issue by dividing your fileset up to the part that needs VSS and all the rest and then run 4 jobs instead of 2. John Hmm, looks like a single VSS job block all others regardless if they use VSS or not. So one have to create a (small) VSS job and isolate them from all others :-( Thanks for the hint Andreas -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Simultaneousky backup to local HDD and Amazon S3
Zitat von lst_ho...@kwsoft.de: Zitat von John Drescher dresche...@gmail.com: On Fri, Oct 5, 2012 at 8:35 AM, lst_ho...@kwsoft.de wrote: Zitat von John Drescher dresche...@gmail.com: On Thu, Oct 4, 2012 at 11:18 PM, Pubudu Perera suharsha...@gmail.com wrote: Thank John! So, that means there's no way to does the job simultaneously ? You could run 2 concurrent jobs (one to each storage) but that would cause 2 times the load on your client. John But not with Windows Clients and VSS enabled. With this only one job at a time is started and subsequent jobs have to wait until the first finish :-( For that you may (depending on your setup) be able to work around the bug/issue by dividing your fileset up to the part that needs VSS and all the rest and then run 4 jobs instead of 2. John Hmm, looks like a single VSS job block all others regardless if they use VSS or not. So one have to create a (small) VSS job and isolate them from all others :-( Even worse it looks like parallel backups jobs with data encryption are crashing the FD at least on Windows. Windows Event Log: Fehlgeschlagene Anwendung bacula-fd.exe, Version 0.0.0.0, fehlgeschlagenes Modul libeay32.dll, Version 0.0.0.0, Fehleradresse 0xbbd7. Andreas -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Simultaneousky backup to local HDD and Amazon S3
Op 20121005 om 05:18 schreef Pubudu Perera: On Fri, Oct 5, 2012 at 7:05 AM, John Drescher wrote: On Thu, Oct 4, 2012 at 8:59 PM, Pubudu Perera wrote: Hello everyone, I'm a newbie to Bacula and want to verify whether my requirement can get done using bacula. I want to know whether it's possible to simultaneously make backups to local HDD and Amazon S3 from the same source in Bacula. Can someone please help me with this? I would backup to the local drive then mirror that with rsync to S3 via s3fs fuse. So, that means there's no way to does the job simultaneously ? How I understond the original question: How to make Bacula to write a backup to 2 different devices at the same time? The sollution should handle the difference in transfer speed. I agree with John Drescher * Have an inner smile * Confirm seeing the question with a response * Provide a suggestion that has the same end result * Allow people the read in the discussion order Things I want to add: * The rsync to the second device could be an AfterJobCommand * Repeat in caps REPLY BELOW THE TEXT Cheers Geert Stappers -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Simultaneousky backup to local HDD and Amazon S3
On Thu, Oct 4, 2012 at 11:18 PM, Pubudu Perera suharsha...@gmail.com wrote: Thank John! So, that means there's no way to does the job simultaneously ? You could run 2 concurrent jobs (one to each storage) but that would cause 2 times the load on your client. John -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Simultaneousky backup to local HDD and Amazon S3
Zitat von John Drescher dresche...@gmail.com: On Thu, Oct 4, 2012 at 11:18 PM, Pubudu Perera suharsha...@gmail.com wrote: Thank John! So, that means there's no way to does the job simultaneously ? You could run 2 concurrent jobs (one to each storage) but that would cause 2 times the load on your client. John But not with Windows Clients and VSS enabled. With this only one job at a time is started and subsequent jobs have to wait until the first finish :-( Andreas -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Simultaneousky backup to local HDD and Amazon S3
Oh OK. Thanks a lot for the valuable tip! On Fri, Oct 5, 2012 at 5:37 PM, John Drescher dresche...@gmail.com wrote: On Thu, Oct 4, 2012 at 11:18 PM, Pubudu Perera suharsha...@gmail.com wrote: Thank John! So, that means there's no way to does the job simultaneously ? You could run 2 concurrent jobs (one to each storage) but that would cause 2 times the load on your client. John -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Simultaneousky backup to local HDD and Amazon S3
On Fri, Oct 5, 2012 at 8:35 AM, lst_ho...@kwsoft.de wrote: Zitat von John Drescher dresche...@gmail.com: On Thu, Oct 4, 2012 at 11:18 PM, Pubudu Perera suharsha...@gmail.com wrote: Thank John! So, that means there's no way to does the job simultaneously ? You could run 2 concurrent jobs (one to each storage) but that would cause 2 times the load on your client. John But not with Windows Clients and VSS enabled. With this only one job at a time is started and subsequent jobs have to wait until the first finish :-( For that you may (depending on your setup) be able to work around the bug/issue by dividing your fileset up to the part that needs VSS and all the rest and then run 4 jobs instead of 2. John -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Simultaneousky backup to local HDD and Amazon S3
On 5 October 2012 02:35, John Drescher dresche...@gmail.com wrote: On Thu, Oct 4, 2012 at 8:59 PM, Pubudu Perera suharsha...@gmail.com wrote: Hello everyone, I'm a newbie to Bacula and want to verify whether my requirement can get done using bacula. I want to know whether it's possible to simultaneously make backups to local HDD and Amazon S3 from the same source in Bacula. Can someone please help me with this? Thanks in advance. I would backup to the local drive then mirror that with rsync to S3 via s3fs fuse. John -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users From my experience using s3cmd is much more reliable than s3fs. There's a sync command in s3cmd that acts like rsync, it's probably more efficient with bandwidth as well. You could run s3cmd in a post job script and set the job to error if the s3cmd sync command fails. Ed -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Simultaneousky backup to local HDD and Amazon S3
Yes, I have heard that there are issues with s3fs's reliability. I think i'll need to start looking at s3cmd as well. Thanks for your valuable time Ed! Pubudu. On Sat, Oct 6, 2012 at 4:24 AM, Edward edjun...@gmail.com wrote: On 5 October 2012 02:35, John Drescher dresche...@gmail.com wrote: On Thu, Oct 4, 2012 at 8:59 PM, Pubudu Perera suharsha...@gmail.com wrote: Hello everyone, I'm a newbie to Bacula and want to verify whether my requirement can get done using bacula. I want to know whether it's possible to simultaneously make backups to local HDD and Amazon S3 from the same source in Bacula. Can someone please help me with this? Thanks in advance. I would backup to the local drive then mirror that with rsync to S3 via s3fs fuse. John -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users From my experience using s3cmd is much more reliable than s3fs. There's a sync command in s3cmd that acts like rsync, it's probably more efficient with bandwidth as well. You could run s3cmd in a post job script and set the job to error if the s3cmd sync command fails. Ed -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Simultaneousky backup to local HDD and Amazon S3
Hello everyone, I'm a newbie to Bacula and want to verify whether my requirement can get done using bacula. I want to know whether it's possible to simultaneously make backups to local HDD and Amazon S3 from the same source in Bacula. Can someone please help me with this? Thanks in advance. -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Simultaneousky backup to local HDD and Amazon S3
On Thu, Oct 4, 2012 at 8:59 PM, Pubudu Perera suharsha...@gmail.com wrote: Hello everyone, I'm a newbie to Bacula and want to verify whether my requirement can get done using bacula. I want to know whether it's possible to simultaneously make backups to local HDD and Amazon S3 from the same source in Bacula. Can someone please help me with this? Thanks in advance. I would backup to the local drive then mirror that with rsync to S3 via s3fs fuse. John -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Simultaneousky backup to local HDD and Amazon S3
Thank John! So, that means there's no way to does the job simultaneously ? On Fri, Oct 5, 2012 at 7:05 AM, John Drescher dresche...@gmail.com wrote: On Thu, Oct 4, 2012 at 8:59 PM, Pubudu Perera suharsha...@gmail.com wrote: Hello everyone, I'm a newbie to Bacula and want to verify whether my requirement can get done using bacula. I want to know whether it's possible to simultaneously make backups to local HDD and Amazon S3 from the same source in Bacula. Can someone please help me with this? Thanks in advance. I would backup to the local drive then mirror that with rsync to S3 via s3fs fuse. John -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
