Re: putBlob fails to send proper content when using payload(InputStream)

2018-04-13 Thread Andrew Gaul
On Fri, Apr 13, 2018 at 09:29:19PM -, john.calc...@gmail.com wrote: > Just tried out s3proxy - it's exactly what we're looking for. I tried setting > it up to use aws-v4 authorization against a filesystem backend like this: > > $ cat s3proxy.conf > s3proxy.authorization=aws-v4 > s3proxy.endpo

Re: putBlob fails to send proper content when using payload(InputStream)

2018-04-13 Thread john . calcote
> > I notice you filed a related bug against s3ninja recently -- you may > > want to try S3Proxy[1] instead which has a more complete implementation > > and actually uses jclouds as its backend. Hi Andrew, Just tried out s3proxy - it's exactly what we're looking for. I tried setting it up to use

Re: putBlob fails to send proper content when using payload(InputStream)

2018-04-12 Thread John Calcote
Thanks Andrew. Very helpful information. I'll definitely look at s3proxy. John On Fri, Apr 13, 2018, 12:06 AM Andrew Gaul wrote: > On Thu, Apr 12, 2018 at 01:41:38PM -, john.calc...@gmail.com wrote: > > Additional information on this issue: I've discovered by virtue of a > wireshark session

Re: putBlob fails to send proper content when using payload(InputStream)

2018-04-12 Thread Andrew Gaul
On Thu, Apr 12, 2018 at 01:41:38PM -, john.calc...@gmail.com wrote: > Additional information on this issue: I've discovered by virtue of a > wireshark session that jclouds client is NOT sending chunked > transfer-encoding, but rather aws-chunked content-encoding. Can anyone tell > me why thi

Re: putBlob fails to send proper content when using payload(InputStream)

2018-04-12 Thread john . calcote
Additional information on this issue: I've discovered by virtue of a wireshark session that jclouds client is NOT sending chunked transfer-encoding, but rather aws-chunked content-encoding. Can anyone tell me why this is necessary, since A) it accomplishes the same thing that chunked transfer-en

Re: putBlob fails to send proper content when using payload(InputStream)

2018-04-11 Thread john . calcote
On 2018/04/11 20:28:55, john.calc...@gmail.com wrote: > I just found out that if I use "s3" provider type rather than "aws-s3" > provider it works. I've set a breakpoint in the read(byte[], ...) method of > my ByteBufferBackedInputStream and I can see that the difference appears to > be that

Re: putBlob fails to send proper content when using payload(InputStream)

2018-04-11 Thread john . calcote
I just found out that if I use "s3" provider type rather than "aws-s3" provider it works. I've set a breakpoint in the read(byte[], ...) method of my ByteBufferBackedInputStream and I can see that the difference appears to be that the "s3" provider is using a straight upload, while the "aws-s3"

putBlob fails to send proper content when using payload(InputStream)

2018-04-11 Thread john . calcote
I've got a sample program here that shows uploading a payload via an InputStream (ByteBufferBackedInputStream below - I've also tried it with a FileInputStream). I can't use a ByteSource because it doesn't support sourcing from direct access memory buffers. ``` public class App { public st