Re: [Bacula-users] maximum concurrent jobs for disk device
On Thursday 07 September 2006 12:47, Kern Sibbald wrote: > On Thursday 07 September 2006 10:53, Silver Salonen wrote: > > On Thursday 07 September 2006 11:42, Kern Sibbald wrote: > > > On Thursday 07 September 2006 10:32, Silver Salonen wrote: > > > > On Thursday 07 September 2006 10:49, Kern Sibbald wrote: > > > > > Hello, > > > > > > > > > > On Thursday 07 September 2006 09:08, Silver Salonen wrote: > > > > > > Hi. > > > > > > > > > > > > I have multiple bacula-clients backing up to different directories > on > > a > > > > > disk. > > > > > > Concurrent jobs are working for different bacula-clients as each one > > of > > > > them > > > > > > has a separate device resource with one job per volume. > > > > > > > > > > > > The problem is that every client can run only one job at a time. I'm > > > > backing > > > > > > up across internet several filesets per client. One of them > (userdata) > > > may > > > > > be > > > > > > around 20 GB, but another (log) may be only 20 MB. Now, when > userdata > > > > runs, > > > > > > it reserves it's device for several days as upload is only 100 KB/s > so > > > > that > > > > > > other jobs can't use it as they have the same storage assigned - > > Bacula > > > > > > notifies me with "waiting to reserve a device". > > > > > > > > > > > > I read "Concurrent Disk Jobs" from the manual. Do I get it > correctly, > > > that > > > > > If > > > > > > I want several jobs to write concurrently into the same directory, I > > > > should > > > > > > have a separate device (pointing to the same directory) for every > job > > of > > > a > > > > > > client? > > > > > > > > > > The key to understanding this is to realize that a file Device is > > > virtually > > > > > identical to a tape device. You can have only one Volume "mounted" at > a > > > > time > > > > > on any Device. > > > > > > > > > > So, if you have multiple jobs that want to write to the same Volume on > > any > > > > > given Device, there is no problem, you just need to get *all* (the 5 > > > > > different) concurrent directives set. If you want to have multiple > jobs > > > > > writing to the same Device but using different Volumes, then as in the > > > case > > > > > of a tape drive, subsequent jobs will wait. You can always add more > > > > > Devices, in which case, you can have different volumes mounted on each > > > > device > > > > > at the same time. > > > > > > > > > > > > > > > > > Silver > > > > > > > > Yup, then I guess I understood this correctly - that I have to have > > separate > > > > device for every job, and separate storage also, right? > > > > > > No. Please re-read what I wrote. That is not what I said. Perhaps the > list > > > can help you on this. > > > > My case is that I want multiple jobs to write into the same directory > (device) using different volumes. > > > For jobs to be able to write into the same directory > > concurrently, > [on different Volumes],< added by kes > > each one of them has to have separate device, right? > > Yes. > > > > > > > Maybe it would save some configuration head-ache if it was possible to > > > specify device (as an addition to storage directive) in job's > configuration? > > > > > > The Storage resource already has a directive to specify a Device. > > > > As it's not possible to specify device's direction in job's resource, I have > > to create a separate storage resource for every device and specify that > > storage in job's resource, isn't it so? > > Yes. > > Note, a Device name by itself is insufficient in the Director -- thus the > reason for a Storage resource definition, that contains the Device name. That's why I suggested that possible device directive in job's resource would save copy-pasting storage resources. Silver - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] maximum concurrent jobs for disk device
On Thursday 07 September 2006 10:53, Silver Salonen wrote: > On Thursday 07 September 2006 11:42, Kern Sibbald wrote: > > On Thursday 07 September 2006 10:32, Silver Salonen wrote: > > > On Thursday 07 September 2006 10:49, Kern Sibbald wrote: > > > > Hello, > > > > > > > > On Thursday 07 September 2006 09:08, Silver Salonen wrote: > > > > > Hi. > > > > > > > > > > I have multiple bacula-clients backing up to different directories on > a > > > > disk. > > > > > Concurrent jobs are working for different bacula-clients as each one > of > > > them > > > > > has a separate device resource with one job per volume. > > > > > > > > > > The problem is that every client can run only one job at a time. I'm > > > backing > > > > > up across internet several filesets per client. One of them (userdata) > > may > > > > be > > > > > around 20 GB, but another (log) may be only 20 MB. Now, when userdata > > > runs, > > > > > it reserves it's device for several days as upload is only 100 KB/s so > > > that > > > > > other jobs can't use it as they have the same storage assigned - > Bacula > > > > > notifies me with "waiting to reserve a device". > > > > > > > > > > I read "Concurrent Disk Jobs" from the manual. Do I get it correctly, > > that > > > > If > > > > > I want several jobs to write concurrently into the same directory, I > > > should > > > > > have a separate device (pointing to the same directory) for every job > of > > a > > > > > client? > > > > > > > > The key to understanding this is to realize that a file Device is > > virtually > > > > identical to a tape device. You can have only one Volume "mounted" at a > > > time > > > > on any Device. > > > > > > > > So, if you have multiple jobs that want to write to the same Volume on > any > > > > given Device, there is no problem, you just need to get *all* (the 5 > > > > different) concurrent directives set. If you want to have multiple jobs > > > > writing to the same Device but using different Volumes, then as in the > > case > > > > of a tape drive, subsequent jobs will wait. You can always add more > > > > Devices, in which case, you can have different volumes mounted on each > > > device > > > > at the same time. > > > > > > > > > > > > > > Silver > > > > > > Yup, then I guess I understood this correctly - that I have to have > separate > > > device for every job, and separate storage also, right? > > > > No. Please re-read what I wrote. That is not what I said. Perhaps the list > > can help you on this. > > My case is that I want multiple jobs to write into the same directory (device) using different volumes. > For jobs to be able to write into the same directory > concurrently, [on different Volumes],< added by kes > each one of them has to have separate device, right? Yes. > > > > Maybe it would save some configuration head-ache if it was possible to > > specify device (as an addition to storage directive) in job's configuration? > > > > The Storage resource already has a directive to specify a Device. > > As it's not possible to specify device's direction in job's resource, I have > to create a separate storage resource for every device and specify that > storage in job's resource, isn't it so? Yes. Note, a Device name by itself is insufficient in the Director -- thus the reason for a Storage resource definition, that contains the Device name. - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] maximum concurrent jobs for disk device
On Thursday 07 September 2006 11:42, Kern Sibbald wrote: > On Thursday 07 September 2006 10:32, Silver Salonen wrote: > > On Thursday 07 September 2006 10:49, Kern Sibbald wrote: > > > Hello, > > > > > > On Thursday 07 September 2006 09:08, Silver Salonen wrote: > > > > Hi. > > > > > > > > I have multiple bacula-clients backing up to different directories on a > > > disk. > > > > Concurrent jobs are working for different bacula-clients as each one of > > them > > > > has a separate device resource with one job per volume. > > > > > > > > The problem is that every client can run only one job at a time. I'm > > backing > > > > up across internet several filesets per client. One of them (userdata) > may > > > be > > > > around 20 GB, but another (log) may be only 20 MB. Now, when userdata > > runs, > > > > it reserves it's device for several days as upload is only 100 KB/s so > > that > > > > other jobs can't use it as they have the same storage assigned - Bacula > > > > notifies me with "waiting to reserve a device". > > > > > > > > I read "Concurrent Disk Jobs" from the manual. Do I get it correctly, > that > > > If > > > > I want several jobs to write concurrently into the same directory, I > > should > > > > have a separate device (pointing to the same directory) for every job of > a > > > > client? > > > > > > The key to understanding this is to realize that a file Device is > virtually > > > identical to a tape device. You can have only one Volume "mounted" at a > > time > > > on any Device. > > > > > > So, if you have multiple jobs that want to write to the same Volume on any > > > given Device, there is no problem, you just need to get *all* (the 5 > > > different) concurrent directives set. If you want to have multiple jobs > > > writing to the same Device but using different Volumes, then as in the > case > > > of a tape drive, subsequent jobs will wait. You can always add more > > > Devices, in which case, you can have different volumes mounted on each > > device > > > at the same time. > > > > > > > > > > > Silver > > > > Yup, then I guess I understood this correctly - that I have to have separate > > device for every job, and separate storage also, right? > > No. Please re-read what I wrote. That is not what I said. Perhaps the list > can help you on this. My case is that I want multiple jobs to write into the same directory (device) using different volumes. For jobs to be able to write into the same directory concurrently, each one of them has to have separate device, right? > > Maybe it would save some configuration head-ache if it was possible to > specify > > device (as an addition to storage directive) in job's configuration? > > The Storage resource already has a directive to specify a Device. As it's not possible to specify device's direction in job's resource, I have to create a separate storage resource for every device and specify that storage in job's resource, isn't it so? Silver - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] maximum concurrent jobs for disk device
On Thursday 07 September 2006 10:32, Silver Salonen wrote: > On Thursday 07 September 2006 10:49, Kern Sibbald wrote: > > Hello, > > > > On Thursday 07 September 2006 09:08, Silver Salonen wrote: > > > Hi. > > > > > > I have multiple bacula-clients backing up to different directories on a > > disk. > > > Concurrent jobs are working for different bacula-clients as each one of > them > > > has a separate device resource with one job per volume. > > > > > > The problem is that every client can run only one job at a time. I'm > backing > > > up across internet several filesets per client. One of them (userdata) may > > be > > > around 20 GB, but another (log) may be only 20 MB. Now, when userdata > runs, > > > it reserves it's device for several days as upload is only 100 KB/s so > that > > > other jobs can't use it as they have the same storage assigned - Bacula > > > notifies me with "waiting to reserve a device". > > > > > > I read "Concurrent Disk Jobs" from the manual. Do I get it correctly, that > > If > > > I want several jobs to write concurrently into the same directory, I > should > > > have a separate device (pointing to the same directory) for every job of a > > > client? > > > > The key to understanding this is to realize that a file Device is virtually > > identical to a tape device. You can have only one Volume "mounted" at a > time > > on any Device. > > > > So, if you have multiple jobs that want to write to the same Volume on any > > given Device, there is no problem, you just need to get *all* (the 5 > > different) concurrent directives set. If you want to have multiple jobs > > writing to the same Device but using different Volumes, then as in the case > > of a tape drive, subsequent jobs will wait. You can always add more > > Devices, in which case, you can have different volumes mounted on each > device > > at the same time. > > > > > > > > Silver > > Yup, then I guess I understood this correctly - that I have to have separate > device for every job, and separate storage also, right? No. Please re-read what I wrote. That is not what I said. Perhaps the list can help you on this. > > Maybe it would save some configuration head-ache if it was possible to specify > device (as an addition to storage directive) in job's configuration? The Storage resource already has a directive to specify a Device. > > Silver > > - > Using Tomcat but need to do more? Need to support web services, security? > Get stuff done quickly with pre-integrated technology to make your job easier > Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] maximum concurrent jobs for disk device
On Thursday 07 September 2006 10:49, Kern Sibbald wrote: > Hello, > > On Thursday 07 September 2006 09:08, Silver Salonen wrote: > > Hi. > > > > I have multiple bacula-clients backing up to different directories on a > disk. > > Concurrent jobs are working for different bacula-clients as each one of them > > has a separate device resource with one job per volume. > > > > The problem is that every client can run only one job at a time. I'm backing > > up across internet several filesets per client. One of them (userdata) may > be > > around 20 GB, but another (log) may be only 20 MB. Now, when userdata runs, > > it reserves it's device for several days as upload is only 100 KB/s so that > > other jobs can't use it as they have the same storage assigned - Bacula > > notifies me with "waiting to reserve a device". > > > > I read "Concurrent Disk Jobs" from the manual. Do I get it correctly, that > If > > I want several jobs to write concurrently into the same directory, I should > > have a separate device (pointing to the same directory) for every job of a > > client? > > The key to understanding this is to realize that a file Device is virtually > identical to a tape device. You can have only one Volume "mounted" at a time > on any Device. > > So, if you have multiple jobs that want to write to the same Volume on any > given Device, there is no problem, you just need to get *all* (the 5 > different) concurrent directives set. If you want to have multiple jobs > writing to the same Device but using different Volumes, then as in the case > of a tape drive, subsequent jobs will wait. You can always add more > Devices, in which case, you can have different volumes mounted on each device > at the same time. > > > > > Silver Yup, then I guess I understood this correctly - that I have to have separate device for every job, and separate storage also, right? Maybe it would save some configuration head-ache if it was possible to specify device (as an addition to storage directive) in job's configuration? Silver - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] maximum concurrent jobs for disk device
Hello, On Thursday 07 September 2006 09:08, Silver Salonen wrote: > Hi. > > I have multiple bacula-clients backing up to different directories on a disk. > Concurrent jobs are working for different bacula-clients as each one of them > has a separate device resource with one job per volume. > > The problem is that every client can run only one job at a time. I'm backing > up across internet several filesets per client. One of them (userdata) may be > around 20 GB, but another (log) may be only 20 MB. Now, when userdata runs, > it reserves it's device for several days as upload is only 100 KB/s so that > other jobs can't use it as they have the same storage assigned - Bacula > notifies me with "waiting to reserve a device". > > I read "Concurrent Disk Jobs" from the manual. Do I get it correctly, that If > I want several jobs to write concurrently into the same directory, I should > have a separate device (pointing to the same directory) for every job of a > client? The key to understanding this is to realize that a file Device is virtually identical to a tape device. You can have only one Volume "mounted" at a time on any Device. So, if you have multiple jobs that want to write to the same Volume on any given Device, there is no problem, you just need to get *all* (the 5 different) concurrent directives set. If you want to have multiple jobs writing to the same Device but using different Volumes, then as in the case of a tape drive, subsequent jobs will wait. You can always add more Devices, in which case, you can have different volumes mounted on each device at the same time. > > Silver > > - > Using Tomcat but need to do more? Need to support web services, security? > Get stuff done quickly with pre-integrated technology to make your job easier > Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
