Re: [ceph-users] Linear space complexity or memory leak in `Radosgw-admin bucket check --fix`

[Orit Wasserman]

Hi Hans,

On Wed, Jul 26, 2017 at 10:24 AM, Ben Hines  wrote:
> Which version of Ceph?
>
> On Tue, Jul 25, 2017 at 4:19 AM, Hans van den Bogert 
> wrote:
>>
>> Hi All,
>>
>> I don't seem to be able to fix a bucket, a bucket which has become
>> inconsistent due to the use of the `inconsistent-index` flag 8).
>>
>> My ceph-admin VM has 4GB of RAM, but that doesn't seem to be enough to do
>> a `radosgw-admin bucket check --fix` which holds 6M items, as the
>> radosgw-admin process is killed eventually by the Out-Of-Memory-Manager. Is
>> this high RAM usage to be expected, or should I file a bug?
>>

At the current implementation we send all entries needing fixing to
the OSD in one go.
In case of a large bucket this it can cause high memory usage or even
http://tracker.ceph.com/issues/20772.
I am working on fix it.

Regards,
Orit

>> Regards,
>>
>> Hans
>>
>>
>>
>> ___
>> ceph-users mailing list
>> ceph-users@lists.ceph.com
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
>
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Linear space complexity or memory leak in `Radosgw-admin bucket check --fix`

[Ben Hines]

Which version of Ceph?

On Tue, Jul 25, 2017 at 4:19 AM, Hans van den Bogert 
wrote:

> Hi All,
>
> I don't seem to be able to fix a bucket, a bucket which has become
> inconsistent due to the use of the `inconsistent-index` flag 8).
>
> My ceph-admin VM has 4GB of RAM, but that doesn't seem to be enough to do
> a `radosgw-admin bucket check --fix` which holds 6M items, as the
> radosgw-admin process is killed eventually by the Out-Of-Memory-Manager. Is
> this high RAM usage to be expected, or should I file a bug?
>
> Regards,
>
> Hans
>
>
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Linear space complexity or memory leak in `Radosgw-admin bucket check --fix`

[Hans van den Bogert]

Hi All,

I don't seem to be able to fix a bucket, a bucket which has become
inconsistent due to the use of the `inconsistent-index` flag 8).

My ceph-admin VM has 4GB of RAM, but that doesn't seem to be enough to do a
`radosgw-admin bucket check --fix` which holds 6M items, as the
radosgw-admin process is killed eventually by the Out-Of-Memory-Manager. Is
this high RAM usage to be expected, or should I file a bug?

Regards,

Hans
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com