Re: [ceph-users] Ceph S3 Tests

[Robin H. Johnson]

On Tue, Feb 16, 2016 at 04:16:49PM -0600, Justin Restivo wrote:
> I verified that this issue is on Amazons side -- I watched it populate to
> 101 and failed to let me produce buckets past that. I just submitted a new
> ticket as I should have had a bucket limit of 500. Thank you for your
> response!
If the fixes are working properly, it shouldn't ever get to even 100
buckets.

Ideally the bucket cleanup should run after EVERY function. If you look
at the website patch, there's some new decorator code I wrote to make
the website tests easier, and we can port those to the rest of the
checks.

-- 
Robin Hugh Johnson
Gentoo Linux: Developer, Infrastructure Lead, Foundation Trustee
E-Mail : robb...@gentoo.org
GnuPG FP   : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph S3 Tests

[Justin Restivo]

Hi there,

I verified that this issue is on Amazons side -- I watched it populate to
101 and failed to let me produce buckets past that. I just submitted a new
ticket as I should have had a bucket limit of 500. Thank you for your
response!

Regards,
Justin

On Tue, Feb 16, 2016 at 4:04 PM, Robin H. Johnson 
wrote:

> On Tue, Feb 16, 2016 at 10:08:38AM -0600, Justin Restivo wrote:
> > Hi all,
> >
> > I am attempting to run the Ceph S3 tests and am really struggling. Any
> help
> > at all would be appreciated.
> >
> > I have my credentials pointing at my AWS environment, which has a 500
> > bucket limit. When I run the tests, I get tons of ERRORS, SKIPS, &
> FAILS. I
> > surely can't be the only one to have experienced this! What am I missing?
> >
> > S3ResponseError: S3ResponseError: 400 Bad Request
> > TooManyBuckets
> How recent in your copy of s3-tests?
>
> There was a bug in the testsuite cleanup that I fixed a few months ago,
> wherein it wasn't cleaning up all the buckets after each test, only the
> first one. Which it could hit the AWS bucket limit within the run.
>
> Commit de65c582 was merged Dec 18 (958a7185).
>
> I haven't run any passes against AWS in the last month, but prior to
> that, I was running the tests a lot when I developed the website code
> (pending merge still, s3-tests PR#92).
>
> --
> Robin Hugh Johnson
> Gentoo Linux: Developer, Infrastructure Lead, Foundation Trustee
> E-Mail : robb...@gentoo.org
> GnuPG FP   : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph S3 Tests

[Robin H. Johnson]

On Tue, Feb 16, 2016 at 10:08:38AM -0600, Justin Restivo wrote:
> Hi all,
> 
> I am attempting to run the Ceph S3 tests and am really struggling. Any help
> at all would be appreciated.
> 
> I have my credentials pointing at my AWS environment, which has a 500
> bucket limit. When I run the tests, I get tons of ERRORS, SKIPS, & FAILS. I
> surely can't be the only one to have experienced this! What am I missing?
> 
> S3ResponseError: S3ResponseError: 400 Bad Request
> TooManyBuckets
How recent in your copy of s3-tests?

There was a bug in the testsuite cleanup that I fixed a few months ago,
wherein it wasn't cleaning up all the buckets after each test, only the
first one. Which it could hit the AWS bucket limit within the run.

Commit de65c582 was merged Dec 18 (958a7185).

I haven't run any passes against AWS in the last month, but prior to
that, I was running the tests a lot when I developed the website code
(pending merge still, s3-tests PR#92).

-- 
Robin Hugh Johnson
Gentoo Linux: Developer, Infrastructure Lead, Foundation Trustee
E-Mail : robb...@gentoo.org
GnuPG FP   : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Ceph S3 Tests

[Justin Restivo]

Hi all,

I am attempting to run the Ceph S3 tests and am really struggling. Any help
at all would be appreciated.

I have my credentials pointing at my AWS environment, which has a 500
bucket limit. When I run the tests, I get tons of ERRORS, SKIPS, & FAILS. I
surely can't be the only one to have experienced this! What am I missing?

S3ResponseError: S3ResponseError: 400 Bad Request
TooManyBuckets

Other than that, can anyone recommend some reading on Boto/Python
interaction with S3? Example scripts, documentation, ect?

Thanks,

Justin
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com