Re: dynlist vs memberof performance issues

2023-01-11 Thread Paul B. Henson
On Tue, Jan 10, 2023 at 01:41:58PM +0100, Ondřej Kuzník wrote: > The latest manpage update should make it clearer how dynamic *lists* > differ from dynamic *groups*. And yes, no need to change config for > groups. Cool, thank you both for the clarification. > If you can give the current 2.5/2.6

Re: dynlist vs memberof performance issues

2023-01-10 Thread Ondřej Kuzník
On Mon, Jan 09, 2023 at 11:39:47AM -0800, Paul B. Henson wrote: > We're currently using dynlist to add the memberOf attribute to users. > One thing that was nice about the new dynlist implementation in 2.5 was > that it allows searching on the dynamic memberOf attribute which we > couldn't do in

Re: dynlist vs memberof performance issues

2023-01-10 Thread Shawn McKinney
> On Jan 9, 2023, at 1:39 PM, Paul B. Henson wrote: > > On Mon, Jan 09, 2023 at 09:26:44AM -0600, Shawn McKinney wrote: > >> Yes (both) > > Sweet :). We've had some performance issues with the new dynlist > implementation since we upgraded to 2.5, I look forward to trying this > out. > >

Re: dynlist vs memberof performance issues

2023-01-09 Thread Paul B. Henson
On Mon, Jan 09, 2023 at 09:26:44AM -0600, Shawn McKinney wrote: > Yes (both) Sweet :). We've had some performance issues with the new dynlist implementation since we upgraded to 2.5, I look forward to trying this out. We're currently using dynlist to add the memberOf attribute to users. One

Re: dynlist vs memberof performance issues

2023-01-09 Thread Shawn McKinney
> On Jan 7, 2023, at 8:44 PM, Paul B. Henson wrote: > > On Tue, Jan 03, 2023 at 11:44:30AM -0600, Shawn McKinney wrote: > >> Some work on the dynlist code of late to boost performance. >> >> So, it might be worthwhile to give it a try. MR576[1] in the next release. > > Is this going to hit

Re: dynlist vs memberof performance issues

2023-01-07 Thread Paul B. Henson
On Tue, Jan 03, 2023 at 11:44:30AM -0600, Shawn McKinney wrote: > Some work on the dynlist code of late to boost performance. > > So, it might be worthwhile to give it a try. MR576[1] in the next release. Is this going to hit the 2.5 LTS train or just 2.6? Thanks...

Re: dynlist vs memberof performance issues

2023-01-03 Thread Shawn McKinney
> On Jul 25, 2022, at 2:51 PM, David Coutadeur > wrote: > > I have worked with Soisik on this particular topic. > As you mentionned, in many cases we can just query directly the group. > In our particular scenario, the software only allows one request for getting > the mails of the users

Re: dynlist vs memberof performance issues

2022-07-26 Thread Paul B. Henson
On 7/26/2022 1:56 AM, Wilkinson, Hugo (IT Dept) wrote: If you have the ability to do so and your kernel is v5+, out-of-hours experiment with disabling system swap entirely (vm.swapiness=0 and 'swapoff -a' )  and then simulate a run of requests you'd expect to encounter the page errors with and

Re: dynlist vs memberof performance issues

2022-07-26 Thread Wilkinson, Hugo (IT Dept)
: Re: dynlist vs memberof performance issues On 7/25/2022 10:38 AM, Shawn McKinney wrote: > As you (and others) have pointed out, there's a significant > performance penalty for searching attributes generated by dylist. I'm still seeing performance issues with queries that simply return me

Re: dynlist vs memberof performance issues

2022-07-26 Thread Mark Cairney
Hi both, Just to let you know that with my dataset I see a consistently slow (10-20 secs) lookup of a user's memberOf group membership using dynamic dynlist overlays on 2.5 and 2.6 compared with the old "memberof" overlay. My dynlist config is as below: dn:

Re: dynlist vs memberof performance issues

2022-07-26 Thread David Coutadeur
Hello, Le 26/07/2022 à 00:04, Howard Chu a écrit : David Coutadeur wrote: Hello, I have worked with Soisik on this particular topic. As you mentionned, in many cases we can just query directly the group. In our particular scenario, the software only allows one request for getting the mails

Re: dynlist vs memberof performance issues

2022-07-25 Thread Paul B. Henson
On 7/25/2022 10:38 AM, Shawn McKinney wrote: As you (and others) have pointed out, there's a significant performance penalty for searching attributes generated by dylist. I'm still seeing performance issues with queries that simply return memberOf, with no reference to it in the actual

Re: dynlist vs memberof performance issues

2022-07-25 Thread Howard Chu
David Coutadeur wrote: > Hello, > > I have worked with Soisik on this particular topic. > As you mentionned, in many cases we can just query directly the group. > In our particular scenario, the software only allows one request for getting > the mails of the users present in the dynamic group.

Re: dynlist vs memberof performance issues

2022-07-25 Thread David Coutadeur
Hello, I have worked with Soisik on this particular topic. As you mentionned, in many cases we can just query directly the group. In our particular scenario, the software only allows one request for getting the mails of the users present in the dynamic group. Thus I think it would be great to

Re: dynlist vs memberof performance issues

2022-07-25 Thread Shawn McKinney
> On May 23, 2022, at 3:10 AM, Soisik Froger wrote: > > I've just sent you sample slapd.conf and a data ldif that illustrate the long > query time on large database. Thank you very much to take a look at this ! Hi Soisik, I've completed a review/test of dynlist, following your excellent

Re: Antw: [EXT] Re: dynlist vs memberof performance issues

2022-05-24 Thread Ulrich Windl
>>> Howard Chu schrieb am 23.05.2022 um 18:04 in Nachricht : > Ulrich Windl wrote: > "Paul B. Henson" schrieb am 22.05.2022 um 04:51 in > Nachricht >> <5d343067-aef3-b499-63e3-996f3d680...@acm.org>: >>> On 5/11/2022 3:48 AM, Soisik Froger wrote: >>> Are this performance issues an

Re: Antw: [EXT] Re: dynlist vs memberof performance issues

2022-05-24 Thread Howard Chu
Ulrich Windl wrote: Howard Chu schrieb am 23.05.2022 um 18:04 in Nachricht > : >> Ulrich Windl wrote: >> "Paul B. Henson" schrieb am 22.05.2022 um 04:51 in >> Nachricht >>> <5d343067-aef3-b499-63e3-996f3d680...@acm.org>: On 5/11/2022 3:48 AM, Soisik Froger wrote: >

Re: Antw: [EXT] Re: dynlist vs memberof performance issues

2022-05-23 Thread Howard Chu
Ulrich Windl wrote: "Paul B. Henson" schrieb am 22.05.2022 um 04:51 in Nachricht > <5d343067-aef3-b499-63e3-996f3d680...@acm.org>: >> On 5/11/2022 3:48 AM, Soisik Froger wrote: >> >>> Are this performance issues an expected side-effect of switching to >>> dynlist - as the memberOf

Antw: [EXT] Re: dynlist vs memberof performance issues

2022-05-23 Thread Ulrich Windl
>>> "Paul B. Henson" schrieb am 22.05.2022 um 04:51 in >>> Nachricht <5d343067-aef3-b499-63e3-996f3d680...@acm.org>: > On 5/11/2022 3:48 AM, Soisik Froger wrote: > >> Are this performance issues an expected side-effect of switching to >> dynlist - as the memberOf attributes are now dynamically

Re: dynlist vs memberof performance issues

2022-05-21 Thread Paul B. Henson
On 5/11/2022 3:48 AM, Soisik Froger wrote: Are this performance issues an expected side-effect of switching to dynlist - as the memberOf attributes are now dynamically calculated while the memberOf overlay used to writes these attributes - or I am also having ongoing sporadic issues with

Re: dynlist vs memberof performance issues

2022-05-18 Thread Shawn McKinney
> On May 11, 2022, at 5:48 AM, Soisik Froger wrote: > > If the group used in memberOf has 1200 members, the query takes over 30 > seconds. These results are obtained using an OpenLDAP running in a simple > docker container on a host with 8CPU/16GB RAM. > > When using the memberOf overlay

Re: dynlist vs memberof performance issues

2022-05-11 Thread Howard Chu
Soisik Froger wrote: > On 01/09/2021 17:17, Quanah Gibson-Mount wrote: >> >> >> --On Wednesday, September 1, 2021 2:07 PM +0100 Mark Cairney >> wrote: >> >>> Hi, >>> >>> I've been out the LDAP loop for a bit but the recent discussion of the >>> memberof overlay on 2.5 piqued my curiosity. Having

Re: dynlist vs memberof performance issues

2022-05-11 Thread Soisik Froger
On 01/09/2021 17:17, Quanah Gibson-Mount wrote: --On Wednesday, September 1, 2021 2:07 PM +0100 Mark Cairney wrote: Hi, I've been out the LDAP loop for a bit but the recent discussion of the memberof overlay on 2.5 piqued my curiosity. Having upgraded a Dev box, removed the memberof

Re: dynlist vs memberof performance issues

2021-09-01 Thread Quanah Gibson-Mount
--On Wednesday, September 1, 2021 2:07 PM +0100 Mark Cairney wrote: Hi, I've been out the LDAP loop for a bit but the recent discussion of the memberof overlay on 2.5 piqued my curiosity. Having upgraded a Dev box, removed the memberof elements from the database and replaced the memberof

dynlist vs memberof performance issues

2021-09-01 Thread Mark Cairney
Hi, I've been out the LDAP loop for a bit but the recent discussion of the memberof overlay on 2.5 piqued my curiosity. Having upgraded a Dev box, removed the memberof elements from the database and replaced the memberof overlay with dynlist the queries appear to work as expected but are both a)