Re: [ceph-users] RBD: How many snapshots is too many?

2017-09-21 Thread Gregory Farnum
On Mon, Sep 18, 2017 at 4:11 AM Florian Haas wrote: > On 09/16/2017 01:36 AM, Gregory Farnum wrote: > > On Mon, Sep 11, 2017 at 1:10 PM Florian Haas > > wrote: > > > > On Mon, Sep 11, 2017 at 8:27 PM, Mclean, Patrick > >

Re: [ceph-users] RBD: How many snapshots is too many?

2017-09-15 Thread Gregory Farnum
On Mon, Sep 11, 2017 at 1:10 PM Florian Haas wrote: > On Mon, Sep 11, 2017 at 8:27 PM, Mclean, Patrick > wrote: > > > > On 2017-09-08 06:06 PM, Gregory Farnum wrote: > > > On Fri, Sep 8, 2017 at 5:47 PM, Mclean, Patrick < > patrick.mcl...@sony.com>

Re: [ceph-users] RBD: How many snapshots is too many?

2017-09-11 Thread Florian Haas
On Mon, Sep 11, 2017 at 8:27 PM, Mclean, Patrick wrote: > > On 2017-09-08 06:06 PM, Gregory Farnum wrote: > > On Fri, Sep 8, 2017 at 5:47 PM, Mclean, Patrick > > wrote: > > > >> On a related note, we are very curious why the snapshot id is > >>

Re: [ceph-users] RBD: How many snapshots is too many?

2017-09-11 Thread Mclean, Patrick
On 2017-09-08 06:06 PM, Gregory Farnum wrote: > On Fri, Sep 8, 2017 at 5:47 PM, Mclean, Patrick > wrote: > >> On a related note, we are very curious why the snapshot id is >> incremented when a snapshot is deleted, this creates lots >> phantom entries in the deleted

Re: [ceph-users] RBD: How many snapshots is too many?

2017-09-08 Thread Gregory Farnum
On Fri, Sep 8, 2017 at 5:47 PM, Mclean, Patrick wrote: > On a related note, we are very curious why the snapshot id is > incremented when a snapshot is deleted, this creates lots > phantom entries in the deleted snapshots set. Interleaved > deletions and creations will

Re: [ceph-users] RBD: How many snapshots is too many?

2017-09-08 Thread Mclean, Patrick
On 2017-09-08 01:36 PM, Gregory Farnum wrote: > On Thu, Sep 7, 2017 at 1:46 PM, Mclean, Patrick > wrote: >> On 2017-09-05 02:41 PM, Gregory Farnum wrote: >>> On Tue, Sep 5, 2017 at 1:44 PM, Florian Haas > wrote: >>> >> Hi everyone, >> >> with the

Re: [ceph-users] RBD: How many snapshots is too many?

2017-09-08 Thread Mclean, Patrick
On 2017-09-08 01:59 PM, Gregory Farnum wrote: > On Fri, Sep 8, 2017 at 1:45 AM, Florian Haas wrote: >>> In our use case, we are severly hampered by the size of removed_snaps >>> (50k+) in the OSDMap to the point were ~80% of ALL cpu time is spent in >>> PGPool::update and its

Re: [ceph-users] RBD: How many snapshots is too many?

2017-09-08 Thread Gregory Farnum
On Fri, Sep 8, 2017 at 1:45 AM, Florian Haas wrote: >> In our use case, we are severly hampered by the size of removed_snaps >> (50k+) in the OSDMap to the point were ~80% of ALL cpu time is spent in >> PGPool::update and its interval calculation code. We have a cluster of >>

Re: [ceph-users] RBD: How many snapshots is too many?

2017-09-08 Thread Gregory Farnum
On Thu, Sep 7, 2017 at 1:46 PM, Mclean, Patrick wrote: > On 2017-09-05 02:41 PM, Gregory Farnum wrote: >> On Tue, Sep 5, 2017 at 1:44 PM, Florian Haas > wrote: >> >> Hi everyone, >> >> with the Luminous release out the door > and the Labor Day

Re: [ceph-users] RBD: How many snapshots is too many?

2017-09-08 Thread Florian Haas
> In our use case, we are severly hampered by the size of removed_snaps > (50k+) in the OSDMap to the point were ~80% of ALL cpu time is spent in > PGPool::update and its interval calculation code. We have a cluster of > around 100k RBDs with each RBD having upto 25 snapshots and only a small >

Re: [ceph-users] RBD: How many snapshots is too many?

2017-09-07 Thread Mclean, Patrick
On 2017-09-05 02:41 PM, Gregory Farnum wrote: > On Tue, Sep 5, 2017 at 1:44 PM, Florian Haas > wrote: > >> Hi everyone, >> >> with the Luminous release out the door and the Labor Day weekend >> over, I hope I can kick off a discussion on another issue that has >> irked me a

Re: [ceph-users] RBD: How many snapshots is too many?

2017-09-06 Thread Florian Haas
Hi Greg, thanks for your insight! I do have a few follow-up questions. On 09/05/2017 11:39 PM, Gregory Farnum wrote: >> It seems to me that there still isn't a good recommendation along the >> lines of "try not to have more than X snapshots per RBD image" or "try >> not to have more than Y

Re: [ceph-users] RBD: How many snapshots is too many?

2017-09-05 Thread Gregory Farnum
On Tue, Sep 5, 2017 at 1:44 PM, Florian Haas wrote: > Hi everyone, > > with the Luminous release out the door and the Labor Day weekend over, > I hope I can kick off a discussion on another issue that has irked me > a bit for quite a while. There doesn't seem to be a good

[ceph-users] RBD: How many snapshots is too many?

2017-09-05 Thread Florian Haas
Hi everyone, with the Luminous release out the door and the Labor Day weekend over, I hope I can kick off a discussion on another issue that has irked me a bit for quite a while. There doesn't seem to be a good documented answer to this: what are Ceph's real limits when it comes to RBD snapshots?