Re: (ITS#8875) [Patch] Performance problems in back-mdb with large DITs and many aliases

2019-07-18 Thread henrik . bohnenkamp
On Mon, Jul 15, 2019 at 07:44:05PM +0100, Howard Chu wrote: > Howard Chu wrote: > > Henrik Bohnenkamp wrote: > >> On Mon, Jul 15, 2019 at 02:26:59PM +0100, Howard Chu wrote: > >>> > >>> Fyi, on our problematic test database with 11M entries and 3.7M aliases, > >>> a search with -a always ,

Re: (ITS#8875) [Patch] Performance problems in back-mdb with large DITs and many aliases

2019-07-15 Thread hyc
This is a multi-part message in MIME format. --AED2FFEE73F73B1613190B64 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit h...@symas.com wrote: > The tool to generate the test LDIF is attached. It reads an LDIF containing > 500,000 users on stdin, and outputs

Re: (ITS#8875) [Patch] Performance problems in back-mdb with large DITs and many aliases

2019-07-15 Thread hyc
This is a multi-part message in MIME format. --0F1DE22CD9273A65E1AE5118 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Howard Chu wrote: > Henrik Bohnenkamp wrote: >> On Mon, Jul 15, 2019 at 02:26:59PM +0100, Howard Chu wrote: >>> >>> Fyi, on our problematic

Re: (ITS#8875) [Patch] Performance problems in back-mdb with large DITs and many aliases

2019-07-15 Thread hyc
Henrik Bohnenkamp wrote: > On Mon, Jul 15, 2019 at 02:26:59PM +0100, Howard Chu wrote: >> >> Fyi, on our problematic test database with 11M entries and 3.7M aliases, a >> search with -a always , starting from the >> DB suffix, took 4 minutes without this patch, and 1235 minutes with this >>

Re: (ITS#8875) [Patch] Performance problems in back-mdb with large DITs and many aliases

2019-07-15 Thread henrik . bohnenkamp
On Mon, Jul 15, 2019 at 02:26:59PM +0100, Howard Chu wrote: >=20 > Fyi, on our problematic test database with 11M entries and 3.7M aliases, = a search with -a always , starting from the > DB suffix, took 4 minutes without this patch, and 1235 minutes with this = patch. >=20 > Needless to say,

Re: (ITS#8875) [Patch] Performance problems in back-mdb with large DITs and many aliases

2019-07-15 Thread hyc
henrik.bohnenk...@ionos.com wrote: > On Thu, Jun 27, 2019 at 10:34:19PM -0700, Quanah Gibson-Mount wrote: >> --On Sunday, April 07, 2019 10:15 AM + henrik.bohnenk...@ionos.com >> wrote: >> >>> On Thu, Apr 04, 2019 at 05:32:16PM +0100, Howard Chu wrote: >> >> Had a customer who was hitting this

Re: (ITS#8875) [Patch] Performance problems in back-mdb with large DITs and many aliases

2019-07-08 Thread henrik . bohnenkamp
On Thu, Jun 27, 2019 at 10:34:19PM -0700, Quanah Gibson-Mount wrote: > --On Sunday, April 07, 2019 10:15 AM + henrik.bohnenk...@ionos.com > wrote: > > > On Thu, Apr 04, 2019 at 05:32:16PM +0100, Howard Chu wrote: > > Had a customer who was hitting this issue try out these patches -- It >

Re: (ITS#8875) [Patch] Performance problems in back-mdb with large DITs and many aliases

2019-06-27 Thread quanah
--On Sunday, April 07, 2019 10:15 AM + henrik.bohnenk...@ionos.com wrote: > On Thu, Apr 04, 2019 at 05:32:16PM +0100, Howard Chu wrote: > Hi Howard, > > thanks for your comments. There is now a new version of patches available > in my github repository. Apart from addressing your comments,

Re: (ITS#8875) [Patch] Performance problems in back-mdb with large DITs and many aliases

2019-04-07 Thread henrik . bohnenkamp
On Thu, Apr 04, 2019 at 05:32:16PM +0100, Howard Chu wrote: Hi Howard, thanks for your comments. There is now a new version of patches available in my github repository. Apart from addressing your comments, I have rebased the patches against the current master branch (quite a lot activity in

Re: (ITS#8875) [Patch] Performance problems in back-mdb with large DITs and many aliases

2019-04-04 Thread hyc
henrik.bohnenk...@ionos.com wrote: > On Fri, Jan 25, 2019 at 06:31:41AM -0800, Quanah Gibson-Mount wrote: >> --On Friday, January 25, 2019 1:51 PM + hbohnenk...@united-internet.de >> wrote: >> Hi, thanks for the report and investigation. I've briefly reviewed your patches. Please squash your

Re: (ITS#8875) [Patch] Performance problems in back-mdb with large DITs and many aliases

2019-04-02 Thread henrik . bohnenkamp
On Fri, Jan 25, 2019 at 06:31:41AM -0800, Quanah Gibson-Mount wrote: > --On Friday, January 25, 2019 1:51 PM + hbohnenk...@united-internet.de > wrote: > Hi, I have now done quite a lot of testing in the way described in my email from January (Followup 3). I used version 2.4.47, not the

Re: (ITS#8875) [Patch] Performance problems in back-mdb with large DITs and many aliases

2019-01-25 Thread quanah
--On Friday, January 25, 2019 1:51 PM + hbohnenk...@united-internet.de wrote: > While writing the test scripts I was wondering if somebody else did > ever do something similar. There are of course tests in the test > directory of the Openldap sources, but are there any (regression) > tests

Re: (ITS#8875) [Patch] Performance problems in back-mdb with large DITs and many aliases

2019-01-25 Thread hbohnenkamp
Some months have passed but I finally found the time to set up a test rig for regression testing of my patch under LIVE conditions. I'll describe the setup below. The good news is, today I found the first bug in my patch (handling of scope=one searches is incorrect). I say "good" news because it

Re: (ITS#8875) [Patch] Performance problems in back-mdb with large DITs and many aliases

2018-07-06 Thread quanah
--On Friday, July 06, 2018 11:20 PM + hbohnenk...@united-internet.de wrote: > Full_Name: Henrik Bohnenkamp > Version: = 2.4.44, HEAD > OS: Ubuntu 18.04, Coreos 7.5 > URL: https://github.com/hbo/openldap-mdb-deref-problem > Submission from: (NULL) (77.176.95.241) > > > This is a followup to >

(ITS#8875) [Patch] Performance problems in back-mdb with large DITs and many aliases

2018-07-06 Thread hbohnenkamp
Full_Name: Henrik Bohnenkamp Version: = 2.4.44, HEAD OS: Ubuntu 18.04, Coreos 7.5 URL: https://github.com/hbo/openldap-mdb-deref-problem Submission from: (NULL) (77.176.95.241) This is a followup to http://www.openldap.org/lists/openldap-technical/201805/msg00065.html When MDB is used as