Re: [ceph-users] Dealing with radosgw and large OSD LevelDBs: compact, start over, something else?

2015-12-21 Thread Ben Hines
I'd be curious to compare benchmarks. What size objects are you putting? 10gig end to end from client to RGW server to OSDs? I wouldn't be surprised if mine is pretty slow though in comparison, since we still don't have SSD journals. So I have not paid much attention to upload speed. Our omap

Re: [ceph-users] Dealing with radosgw and large OSD LevelDBs: compact, start over, something else?

2015-12-21 Thread Florian Haas
On Mon, Dec 21, 2015 at 4:15 PM, Haomai Wang wrote: > > > On Mon, Dec 21, 2015 at 10:55 PM, Florian Haas wrote: >> >> On Mon, Dec 21, 2015 at 3:35 PM, Haomai Wang wrote: >> > >> > >> > On Fri, Dec 18, 2015 at 1:16 AM, Florian Haas

Re: [ceph-users] Dealing with radosgw and large OSD LevelDBs: compact, start over, something else?

2015-12-21 Thread Florian Haas
On Mon, Dec 21, 2015 at 9:15 PM, Ben Hines wrote: > I'd be curious to compare benchmarks. What size objects are you putting? As stated earlier, I ran rest-bench with 70KB objects which is a good approximation of the average object size in the underperforming system. > 10gig

Re: [ceph-users] Dealing with radosgw and large OSD LevelDBs: compact, start over, something else?

2015-12-21 Thread Florian Haas
On Thu, Dec 17, 2015 at 6:16 PM, Florian Haas wrote: > Hey everyone, > > I recently got my hands on a cluster that has been underperforming in > terms of radosgw throughput, averaging about 60 PUTs/s with 70K > objects where a freshly-installed cluster with near-identical >

Re: [ceph-users] Dealing with radosgw and large OSD LevelDBs: compact, start over, something else?

2015-12-21 Thread Haomai Wang
resend On Mon, Dec 21, 2015 at 10:35 PM, Haomai Wang wrote: > > > On Fri, Dec 18, 2015 at 1:16 AM, Florian Haas wrote: > >> Hey everyone, >> >> I recently got my hands on a cluster that has been underperforming in >> terms of radosgw throughput, averaging

Re: [ceph-users] Dealing with radosgw and large OSD LevelDBs: compact, start over, something else?

2015-12-21 Thread Haomai Wang
On Tue, Dec 22, 2015 at 3:33 AM, Florian Haas wrote: > On Mon, Dec 21, 2015 at 4:15 PM, Haomai Wang wrote: > > > > > > On Mon, Dec 21, 2015 at 10:55 PM, Florian Haas > wrote: > >> > >> On Mon, Dec 21, 2015 at 3:35 PM, Haomai Wang

Re: [ceph-users] Dealing with radosgw and large OSD LevelDBs: compact, start over, something else?

2015-12-21 Thread Haomai Wang
On Tue, Dec 22, 2015 at 3:27 PM, Florian Haas wrote: > On Tue, Dec 22, 2015 at 3:10 AM, Haomai Wang wrote: > >> >> >> Hey everyone, > >> >> >> > >> >> >> I recently got my hands on a cluster that has been underperforming > >> >> >> in > >> >> >> terms

Re: [ceph-users] Dealing with radosgw and large OSD LevelDBs: compact, start over, something else?

2015-12-21 Thread Florian Haas
On Tue, Dec 22, 2015 at 3:10 AM, Haomai Wang wrote: >> >> >> Hey everyone, >> >> >> >> >> >> I recently got my hands on a cluster that has been underperforming >> >> >> in >> >> >> terms of radosgw throughput, averaging about 60 PUTs/s with 70K >> >> >> objects where a

Re: [ceph-users] Dealing with radosgw and large OSD LevelDBs: compact, start over, something else?

2015-12-21 Thread Florian Haas
On Mon, Dec 21, 2015 at 3:35 PM, Haomai Wang wrote: > > > On Fri, Dec 18, 2015 at 1:16 AM, Florian Haas wrote: >> >> Hey everyone, >> >> I recently got my hands on a cluster that has been underperforming in >> terms of radosgw throughput, averaging about 60

Re: [ceph-users] Dealing with radosgw and large OSD LevelDBs: compact, start over, something else?

2015-12-21 Thread Haomai Wang
On Mon, Dec 21, 2015 at 10:55 PM, Florian Haas wrote: > On Mon, Dec 21, 2015 at 3:35 PM, Haomai Wang wrote: > > > > > > On Fri, Dec 18, 2015 at 1:16 AM, Florian Haas > wrote: > >> > >> Hey everyone, > >> > >> I recently got my hands on