Re: [ceph-users] What do you use to benchmark your rgw?

Hi Mathew, We approached the problem by first running swift-bench for performance tuning and configuration. Since it was the easiest to get up and running and test the gateway. Then we wrote a python script using python boto and python futures to model our usecase and test s3. We found the most

Re: [ceph-users] What do you use to benchmark your rgw?

On 03/28/2018 11:11 AM, Mark Nelson wrote: > Personally I usually use a modified version of Mark Seger's getput > tool here: > > https://github.com/markhpc/getput/tree/wip-fix-timing > > The difference between this version and upstream is primarily to make > getput more accurate/useful when using

Re: [ceph-users] What do you use to benchmark your rgw?

2018-03-28 16:21 GMT+02:00 David Byte : > I use cosbench (the last rc works well enough). I can get multiple GB/s > from my 6 node cluster with 2 RGWs. > > > To add info to this, it's not unexpectedly low for us, we know the S3+https layer added latencies, and it is EC pools on

Re: [ceph-users] What do you use to benchmark your rgw?

Personally I usually use a modified version of Mark Seger's getput tool here: https://github.com/markhpc/getput/tree/wip-fix-timing The difference between this version and upstream is primarily to make getput more accurate/useful when using something like CBT for orchestration instead of the

Re: [ceph-users] What do you use to benchmark your rgw?

I use cosbench (the last rc works well enough). I can get multiple GB/s from my 6 node cluster with 2 RGWs. David Byte Sr. Technical Strategist IHV Alliances and Embedded SUSE Sent from my iPhone. Typos are Apple's fault. On Mar 28, 2018, at 5:26 AM, Janne Johansson

Re: [ceph-users] What do you use to benchmark your rgw?

s3cmd and cli version of cyberduck to test it end-to-end using parallelism if possible. Getting some 100MB/s at most, from 500km distance over https against 5*radosgw behind HAProxy. 2018-03-28 11:17 GMT+02:00 Matthew Vernon : > Hi, > > What are people here using to

[ceph-users] What do you use to benchmark your rgw?

Hi, What are people here using to benchmark their S3 service (i.e. the rgw)? rados bench is great for some things, but doesn't tell me about what performance I can get from my rgws. It seems that there used to be rest-bench, but that isn't in Jewel AFAICT; I had a bit of a look at cosbench but