Re: [Bacula-users] Cloud Storage Alternatives to AWS

2022-01-04 Thread Anders Gustafsson 
FWIW, that is what we do as well.

-- 
Med vänlig hälsning

Anders Gustafsson, ingenjör
anders.gustafs...@pedago.fi  |  Support +358 18 12060  |  Direkt +358 9 315 45 
121  |  Mobil +358 40506 7099

Pedago interaktiv ab, Nygatan 7 B , AX-22100 MARIEHAMN, ÅLAND, FINLAND



>>> Chris Wilkinson  04.01.2022 17:00 >>>
I have SD pointing to a local mount point mounted by rclone mount... so
gdrive just appears as a directory, same as any disk.


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Cloud Storage Alternatives to AWS

2022-01-04 Thread Heitor Faria 
Hello Chris, 

> I have SD pointing to a local mount point mounted by rclone mount... so gdrive
> just appears as a directory, same as any disk. So I'm not sure what you mean 
> by
> Cloud resource?

Nevermind. I thought you are using the Bacula S3 Cloud Driver. 
Mounted object storages are really slow. That's why you have the Driver etc. 

> Best
> Chris

Rgds. 
-- 

MSc Heitor Faria (Miami/USA) 
Bacula LATAM CIO 

mobile1: + 1 909 655-8971 
mobile2: + 55 61 98268-4220 
[ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] 
[ http://www.bacula.com.br/ ] 

América Latina 
[ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | 
bacula.com.br ] 
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Cloud Storage Alternatives to AWS

2022-01-04 Thread Chris Wilkinson 
I have SD pointing to a local mount point mounted by rclone mount... so
gdrive just appears as a directory, same as any disk. So I'm not sure what
you mean by Cloud resource?

Best
Chris


On Tue, 4 Jan 2022, 1:35 p.m. Heitor Faria,  wrote:

> Hello Chris,
>
> I got 'rclone mount..’ working to mount GDrive as a local mount. A 1GB
> test backup took 2h:41m (109kb/s), so not a great result. The server
> running SD/FD/DIR is on a 1Gbe connection to a 300/50 FTTP line so Google
> seems to be the bandwidth limiter here.
>
> However I did not find a Bacula directive ‘MaximumConcurrentUploads’.
>
> It is supposed to be in the bacula-sd.conf Cloud resource, mas it is
> possible that it was not ported to CBacula yet.
> However, I think it is also possible to change that value in the awscli
> configuration file.
>
> Best
> -Chris-
>
> Rgds.
> --
>
> MSc Heitor Faria (Miami/USA)
> Bacula LATAM CIO
> mobile1: + 1 909 655-8971
> mobile2: + 55 61 98268-4220
> [image: linkedin icon]
> 
> [image: logo] 
> América Latina
> bacula.lat | bacula.com.br 
>
>
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Cloud Storage Alternatives to AWS

2022-01-04 Thread Heitor Faria 
Hello Chris, 

> I got 'rclone mount..’ working to mount GDrive as a local mount. A 1GB test
> backup took 2h:41m (109kb/s), so not a great result. The server running
> SD/FD/DIR is on a 1Gbe connection to a 300/50 FTTP line so Google seems to be
> the bandwidth limiter here.

> However I did not find a Bacula directive ‘MaximumConcurrentUploads’.

It is supposed to be in the bacula-sd.conf Cloud resource, mas it is possible 
that it was not ported to CBacula yet. 
However, I think it is also possible to change that value in the awscli 
configuration file. 

> Best
> -Chris-

Rgds. 
-- 

MSc Heitor Faria (Miami/USA) 
Bacula LATAM CIO 

mobile1: + 1 909 655-8971 
mobile2: + 55 61 98268-4220 
[ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] 
[ http://www.bacula.com.br/ ] 

América Latina 
[ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | 
bacula.com.br ] 
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Cloud Storage Alternatives to AWS

2022-01-02 Thread Chris Wilkinson 
I got 'rclone mount..’ working to mount GDrive as a local mount. A 1GB test 
backup took 2h:41m (109kb/s), so not a great result. The server running 
SD/FD/DIR is on a 1Gbe connection to a 300/50 FTTP line so Google seems to be 
the bandwidth limiter here. 

However I did not find a Bacula directive ‘MaximumConcurrentUploads’.

Best
-Chris-




> On 28 Dec 2021, at 22:56, Heitor Faria  wrote:
> 
> Hello Chris,
> I've seen several users have implemented AWS for backup storage. Whilst 
> looking at other options, I came across Expandrive 
> (https://www.expandrive.com/server/ ). 
> This appears to be a wrapper around multiple cloud storage suppliers such as 
> Dropbox, Google Drive and others that can't be used directly as mounted 
> drives.
> 
> I wanted to ask the list if anyone has implemented this and what their 
> experience has been.
> 
> On the face of it, it seems attractive at approx $15/m for 5Tb backend 
> storage plus the Expandrive $25/y single user subscription and allowing to 
> retire a bank of local drives. Granted this would not work for someone on 
> standard broadband but fibre should be fine.
> 
> Regards
> Chris Wilkinson
> This is not a new technique. The Linux fuse library has been able to mount S3 
> buckets for a long time right now. Rclone can also do the same stuff you are 
> proposing (GDrive, Dropbox) for free.
> They all should work with Bacula, but I don't think they are an optimal 
> solution for an array of reasons.
> I deployed a few environments with the Bacula S3 Cloud Driver 
> (https://www.bacula.lat/enterprise-bacula-s3-swift-ceph-and-cloud-storage-driver-quick-guide/?lang=en)
>  and Wasabi, which does not charge per egress data and charges only 5.99 USD 
> per TB/m. The driver is available with the www.bacula.org 
>  installation packages.
> For some reason, however, I could only achieve about 2 MB/s maximum upload 
> transfer rate per part. Then I had to use a greater number of 
> MaximumConcurrentUploads (and Downloads) - e.g. 20. 
> Eventually I was able to reach speeds close to 40 MB/s, that were suitable 
> for the workload.
> 
> Rgds.
> -- 
> 
> MSc Heitor Faria (Miami/USA)
> Bacula LATAM CIO
> mobile1: + 1 909 655-8971
> mobile2: + 55 61 98268-4220
>  
>  
> América Latina
> bacula.lat  | bacula.com.br 
> 

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Cloud Storage Alternatives to AWS

2021-12-29 Thread Chris Wilkinson 
Thanks for that suggestion to look at Rclone. I'll give it a whirl with
Google Drive since I already have an account and see how it goes.

Regards
Chris Wilkinson

On Tue, 28 Dec 2021, 10:56 pm Heitor Faria,  wrote:

> Hello Chris,
>
> I've seen several users have implemented AWS for backup storage. Whilst
> looking at other options, I came across Expandrive (
> https://www.expandrive.com/server/). This appears to be a wrapper around
> multiple cloud storage suppliers such as Dropbox, Google Drive and others
> that can't be used directly as mounted drives.
>
> I wanted to ask the list if anyone has implemented this and what their
> experience has been.
>
> On the face of it, it seems attractive at approx $15/m for 5Tb backend
> storage plus the Expandrive $25/y single user subscription and allowing to
> retire a bank of local drives. Granted this would not work for someone on
> standard broadband but fibre should be fine.
>
> Regards
> Chris Wilkinson
>
> This is not a new technique. The Linux fuse library has been able to mount
> S3 buckets for a long time right now. Rclone can also do the same stuff you
> are proposing (GDrive, Dropbox) for free.
> They all should work with Bacula, but I don't think they are an optimal
> solution for an array of reasons.
> I deployed a few environments with the Bacula S3 Cloud Driver (
> https://www.bacula.lat/enterprise-bacula-s3-swift-ceph-and-cloud-storage-driver-quick-guide/?lang=en)
> and Wasabi, which does not charge per egress data and charges only 5.99 USD
> per TB/m. The driver is available with the www.bacula.org installation
> packages.
> For some reason, however, I could only achieve about 2 MB/s maximum upload
> transfer rate per part. Then I had to use a greater number of
> MaximumConcurrentUploads (and Downloads) - e.g. 20.
> Eventually I was able to reach speeds close to 40 MB/s, that were suitable
> for the workload.
>
> Rgds.
> --
>
> MSc Heitor Faria (Miami/USA)
> Bacula LATAM CIO
> mobile1: + 1 909 655-8971
> mobile2: + 55 61 98268-4220
> [image: linkedin icon]
> 
> [image: logo] 
> América Latina
> bacula.lat | bacula.com.br 
>
>
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Cloud Storage Alternatives to AWS

2021-12-28 Thread Heitor Faria 
Hello Chris, 

> I've seen several users have implemented AWS for backup storage. Whilst 
> looking
> at other options, I came across Expandrive ( [
> https://www.expandrive.com/server/ | https://www.expandrive.com/server/ ] ).
> This appears to be a wrapper around multiple cloud storage suppliers such as
> Dropbox, Google Drive and others that can't be used directly as mounted 
> drives.

> I wanted to ask the list if anyone has implemented this and what their
> experience has been.

> On the face of it, it seems attractive at approx $15/m for 5Tb backend storage
> plus the Expandrive $25/y single user subscription and allowing to retire a
> bank of local drives. Granted this would not work for someone on standard
> broadband but fibre should be fine.

> Regards
> Chris Wilkinson

This is not a new technique. The Linux fuse library has been able to mount S3 
buckets for a long time right now. Rclone can also do the same stuff you are 
proposing (GDrive, Dropbox) for free. 
They all should work with Bacula, but I don't think they are an optimal 
solution for an array of reasons. 
I deployed a few environments with the Bacula S3 Cloud Driver 
(https://www.bacula.lat/enterprise-bacula-s3-swift-ceph-and-cloud-storage-driver-quick-guide/?lang=en)
 and Wasabi, which does not charge per egress data and charges only 5.99 USD 
per TB/m. The driver is available with the [ http://www.bacula.org/ | 
www.bacula.org ] installation packages. 
For some reason, however, I could only achieve about 2 MB/s maximum upload 
transfer rate per part. Then I had to use a greater number of 
MaximumConcurrentUploads (and Downloads) - e.g. 20. 
Eventually I was able to reach speeds close to 40 MB/s, that were suitable for 
the workload. 

Rgds. 
-- 

MSc Heitor Faria (Miami/USA) 
Bacula LATAM CIO 

mobile1: + 1 909 655-8971 
mobile2: + 55 61 98268-4220 
[ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] 
[ http://www.bacula.com.br/ ] 

América Latina 
[ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | 
bacula.com.br ] 
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Cloud Storage Alternatives to AWS

2021-12-28 Thread Chris Wilkinson 
I've seen several users have implemented AWS for backup storage. Whilst
looking at other options, I came across Expandrive (
https://www.expandrive.com/server/). This appears to be a wrapper around
multiple cloud storage suppliers such as Dropbox, Google Drive and others
that can't be used directly as mounted drives.

I wanted to ask the list if anyone has implemented this and what their
experience has been.

On the face of it, it seems attractive at approx $15/m for 5Tb backend
storage plus the Expandrive $25/y single user subscription and allowing to
retire a bank of local drives. Granted this would not work for someone on
standard broadband but fibre should be fine.

Regards
Chris Wilkinson
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users