Re: Who here uses vibe-s3 from code.dlang.org?

2017-08-17 Thread yawniek via Digitalmars-d

On Monday, 14 August 2017 at 19:07:07 UTC, aberba wrote:

On Sunday, 13 August 2017 at 21:38:37 UTC, yawniek wrote:

On Tuesday, 8 August 2017 at 08:49:33 UTC, Andre Pany wrote:

[...]


the original goal of vibe-s3 was to allow streaming uploads of 
large files so that no memory/disk needs to be used.
shelling out (calling aws console client) is definitly not an 
option.


What exactly is missing or not working in its current state?


from what i know file upload/download and multipart is working 
fine but setting options/headers is currently done via submitting 
the headers.

thus all the interfaces are a bit crude.
for the rest see the github issues.
please report any problems in the github, also you can submit how 
you would EXPECT the API to work


Re: Who here uses vibe-s3 from code.dlang.org?

2017-08-14 Thread aberba via Digitalmars-d

On Sunday, 13 August 2017 at 21:38:37 UTC, yawniek wrote:

On Tuesday, 8 August 2017 at 08:49:33 UTC, Andre Pany wrote:

[...]


the original goal of vibe-s3 was to allow streaming uploads of 
large files so that no memory/disk needs to be used.
shelling out (calling aws console client) is definitly not an 
option.


What exactly is missing or not working in its current state?


Re: Who here uses vibe-s3 from code.dlang.org?

2017-08-13 Thread yawniek via Digitalmars-d

On Tuesday, 8 August 2017 at 08:49:33 UTC, Andre Pany wrote:

On Monday, 7 August 2017 at 22:46:57 UTC, aberba wrote:
vibe-s3 (https://code.dlang.org/packages/vibe-s3) is an Amazon 
s3 object storage API for D.


Has anyone here used or tested it? What was your experiences? 
It has the tagline "this library is highly alpha and mostly 
untested. use at your own risk".


I created a generator which uses the JS Api definitions
https://github.com/aws/aws-sdk-js/tree/master/apis to create D 
structs and classes. Instead of calling the rest interfaces the 
generated code is calling the AWS console client, which is 
available for most operation systems.


Unfortunatelly I do not have the property on this library and 
therefore I am not allowed to release it. But I can say it was 
an matter of some hours to implement it and you have 
immediatelly access to all AWS services.


Kind regards
André


the original goal of vibe-s3 was to allow streaming uploads of 
large files so that no memory/disk needs to be used.
shelling out (calling aws console client) is definitly not an 
option.





Re: Who here uses vibe-s3 from code.dlang.org?

2017-08-11 Thread Andres Clari via Digitalmars-d

On Friday, 11 August 2017 at 13:11:36 UTC, aberba wrote:


After comparing Google's object storage platform with Amazon, I 
found Google's to be much simpler and straight forward plus it 
uses a json  based api which is much simple to parse and 
understand.


Maybe, but some people have to or prefer to use Amazon services, 
ideally we'd have libraries for both ecosystems. No ones software 
is an island, we have to talk other programs and services.


Re: Who here uses vibe-s3 from code.dlang.org?

2017-08-11 Thread aberba via Digitalmars-d

On Thursday, 10 August 2017 at 15:49:35 UTC, Andres Clari wrote:

On Monday, 7 August 2017 at 22:46:57 UTC, aberba wrote:
vibe-s3 (https://code.dlang.org/packages/vibe-s3) is an Amazon 
s3 object storage API for D.


Has anyone here used or tested it? What was your experiences? 
It has the tagline "this library is highly alpha and mostly 
untested. use at your own risk".


Last time I tested it around Nov, 2016, it was very buggy. I'm 
using an in-house deimos wrapper for "libs3".


I would be awesome to have some native library for S3, and 
other AWS stuff, but I'm very thrown back by having it depend 
on vibe.d. Nothing against it, but say you just want to make a 
simple upload utility specialized, having to depend on vibe.d 
for that really is something unacceptable.


Ideally we'd wanna have a library for the whole Amazon auth 
stuff wrapped, and libraries for the specific services you want 
to use, being as standalone as possible.


After comparing Google's object storage platform with Amazon, I 
found Google's to be much simpler and straight forward plus it 
uses a json  based api which is much simple to parse and 
understand.


Re: Who here uses vibe-s3 from code.dlang.org?

2017-08-10 Thread Andres Clari via Digitalmars-d

On Monday, 7 August 2017 at 22:46:57 UTC, aberba wrote:
vibe-s3 (https://code.dlang.org/packages/vibe-s3) is an Amazon 
s3 object storage API for D.


Has anyone here used or tested it? What was your experiences? 
It has the tagline "this library is highly alpha and mostly 
untested. use at your own risk".


Last time I tested it around Nov, 2016, it was very buggy. I'm 
using an in-house deimos wrapper for "libs3".


I would be awesome to have some native library for S3, and other 
AWS stuff, but I'm very thrown back by having it depend on 
vibe.d. Nothing against it, but say you just want to make a 
simple upload utility specialized, having to depend on vibe.d for 
that really is something unacceptable.


Ideally we'd wanna have a library for the whole Amazon auth stuff 
wrapped, and libraries for the specific services you want to use, 
being as standalone as possible.




Re: Who here uses vibe-s3 from code.dlang.org?

2017-08-08 Thread aberba via Digitalmars-d

On Tuesday, 8 August 2017 at 08:49:33 UTC, Andre Pany wrote:

On Monday, 7 August 2017 at 22:46:57 UTC, aberba wrote:

[...]


I created a generator which uses the JS Api definitions
https://github.com/aws/aws-sdk-js/tree/master/apis to create D 
structs and classes. Instead of calling the rest interfaces the 
generated code is calling the AWS console client, which is 
available for most operation systems.


Unfortunatelly I do not have the property on this library and 
therefore I am not allowed to release it. But I can say it was 
an matter of some hours to implement it and you have 
immediatelly access to all AWS services.


Kind regards
André


Aw :(


Re: Who here uses vibe-s3 from code.dlang.org?

2017-08-08 Thread Andre Pany via Digitalmars-d

On Monday, 7 August 2017 at 22:46:57 UTC, aberba wrote:
vibe-s3 (https://code.dlang.org/packages/vibe-s3) is an Amazon 
s3 object storage API for D.


Has anyone here used or tested it? What was your experiences? 
It has the tagline "this library is highly alpha and mostly 
untested. use at your own risk".


I created a generator which uses the JS Api definitions
https://github.com/aws/aws-sdk-js/tree/master/apis to create D 
structs and classes. Instead of calling the rest interfaces the 
generated code is calling the AWS console client, which is 
available for most operation systems.


Unfortunatelly I do not have the property on this library and 
therefore I am not allowed to release it. But I can say it was an 
matter of some hours to implement it and you have immediatelly 
access to all AWS services.


Kind regards
André



Re: Who here uses vibe-s3 from code.dlang.org?

2017-08-08 Thread extrawurst via Digitalmars-d

On Monday, 7 August 2017 at 22:46:57 UTC, aberba wrote:
vibe-s3 (https://code.dlang.org/packages/vibe-s3) is an Amazon 
s3 object storage API for D.


Has anyone here used or tested it? What was your experiences? 
It has the tagline "this library is highly alpha and mostly 
untested. use at your own risk".


I did not use S3 from vibe.d but I used the original code base 
and i am using DynamoDB in there: 
https://github.com/vibe-aws/vibe-aws


Would be great to merge s3 support back to this aws lib.

Cheers,
Stephan


Re: Who here uses vibe-s3 from code.dlang.org?

2017-08-08 Thread Sebastiaan Koppe via Digitalmars-d

On Monday, 7 August 2017 at 22:46:57 UTC, aberba wrote:
vibe-s3 (https://code.dlang.org/packages/vibe-s3) is an Amazon 
s3 object storage API for D.


Has anyone here used or tested it? What was your experiences? 
It has the tagline "this library is highly alpha and mostly 
untested. use at your own risk".


I plan on using it in the near future*. Code looks good.

* (to mount cloud storage Wasabi[1] with dfuse[2])

[1] https://wasabi.com/
[2] https://github.com/facebook/dfuse