Re: slapd crashes with ch_realloc of X bytes failed

2013-01-17 Thread Quanah Gibson-Mount
--On Thursday, January 17, 2013 6:23 PM +0100 Meike Stone wrote: I was wondering, why it crashed in spite of overcommitting . The solution sometimes is simple, but "far away" ;-) ...: ~# ulimit -v 7353440 Ah, yes... This is an idiotic setting I've seen on SLES systems. We wrote a wrappe

Re: slapd crashes with ch_realloc of X bytes failed

2013-01-17 Thread Meike Stone
> 2013/1/12 Meike Stone : > > What I see, that slapd had reserved "Total: 7350688K" > (overcommitted?), but only referenced 4900700K. > Why does slapd reserve so much memory and use it not? Because of this, > I changed the default values for memory overcomittment > > from: > vm.overcommit_memory =

Re: slapd crashes with ch_realloc of X bytes failed

2013-01-15 Thread Quanah Gibson-Mount
--On Tuesday, January 15, 2013 8:49 PM +0100 Meike Stone wrote: Yes, that would significantly increase memory usage. I have only ever done the *second* modification (BDB_IDL_LOGN) to fix the IDL issues. I've run that way for years. How much have you increased the BDB_IDL_LOGN -> 2^17 or mo

Re: slapd crashes with ch_realloc of X bytes failed

2013-01-15 Thread Meike Stone
> > Yes, that would significantly increase memory usage. I have only ever done > the *second* modification (BDB_IDL_LOGN) to fix the IDL issues. I've run > that way for years. How much have you increased the BDB_IDL_LOGN -> 2^17 or more, would be interesting for me, because we are nearly reach t

Re: slapd crashes with ch_realloc of X bytes failed

2013-01-15 Thread Quanah Gibson-Mount
--On Tuesday, January 15, 2013 2:09 PM +0100 Meike Stone wrote: Btw.: I use a "special version" of openldap. Because of limited index slot of 65535, I changed in openldap-2.4.33.orig/include/ldap_pvt_thread.h from # define LDAP_PVT_THREAD_STACK_SIZE ( 1 * 1024 * 1024 * sizeof(void *) )

Re: slapd crashes with ch_realloc of X bytes failed

2013-01-15 Thread Meike Stone
>> >>> From slapd.conf/cn=config: >>> a) cachesize setting >>> b) idlcachesize setting >>> c) dncachesize setting >> >> >> cachesize 75 >> dncachesize 75 >> idlcachesize225 >> >> Thanks and best regards > > > Your settings here don't make a lot of s

Re: slapd crashes with ch_realloc of X bytes failed

2013-01-14 Thread Quanah Gibson-Mount
--On Monday, January 14, 2013 11:33 PM +0100 Meike Stone wrote: 2013/1/14 Quanah Gibson-Mount : Sorry, I don't have your configuration memorized. Generally, you should list: Oops sorry, I used my gmail account and did not see, that the thread in the mailing list is "broken".. Here are

Re: slapd crashes with ch_realloc of X bytes failed

2013-01-14 Thread Meike Stone
2013/1/14 Quanah Gibson-Mount : > > > Sorry, I don't have your configuration memorized. Generally, you should > list: Oops sorry, I used my gmail account and did not see, that the thread in the mailing list is "broken".. Here are all posted informations from my production system http://www.open

Re: slapd crashes with ch_realloc of X bytes failed

2013-01-14 Thread Quanah Gibson-Mount
--On Saturday, January 12, 2013 4:49 PM +0100 Meike Stone wrote: Hello, I could update both systems during my vacation to 2.4.33. Both servers had 16GByte RAM. The system crashed again randomly (as expected). So we increased the memory on one server to 24 GByte RAM. No effect, this server c

Re: slapd crashes with ch_realloc of X bytes failed

2013-01-12 Thread Meike Stone
Hello, I could update both systems during my vacation to 2.4.33. Both servers had 16GByte RAM. The system crashed again randomly (as expected). So we increased the memory on one server to 24 GByte RAM. No effect, this server crashes too, sometime till 5 times a day. I installed a test machine (

Re: slapd crashes with ch_realloc of X bytes failed

2012-11-23 Thread Quanah Gibson-Mount
--On Saturday, November 24, 2012 3:13 AM +0100 Meike Stone wrote: But where to get, I use SLES11SP1 --Quanah -- Quanah Gibson-Mount Sr. Member of Technical Staff Zimbra, Inc A Division of VMware, Inc. Zimbra :: the leader in op

Re: slapd crashes with ch_realloc of X bytes failed

2012-11-23 Thread Meike Stone
> >> Yes, not before January 2013 ... >> Hope after reorganization, slapd runs more stable... >> The only thing I can do for now. > > > It is highly unlikely that "reorganization" will change the overall > footprint of the slapd database. Yes, I see this now ... Id does not matter ... > Your be

Re: slapd crashes with ch_realloc of X bytes failed

2012-11-23 Thread Quanah Gibson-Mount
--On Saturday, November 24, 2012 1:30 AM +0100 Meike Stone wrote: Yes, not before January 2013 ... Hope after reorganization, slapd runs more stable... The only thing I can do for now. It is highly unlikely that "reorganization" will change the overall footprint of the slapd database. Your

Re: slapd crashes with ch_realloc of X bytes failed

2012-11-23 Thread Meike Stone
> >> I'm afraid to increase the cachesize in DB_CONFIG: > > > ch_realloc means the system ran out of memory. Increasing the DB_CONFIG > cachesize will run you out of memory more quickly. I'm sitting JUST NOW in front of the LDAP Server and slapcat/slapadd the database to reorganize .. (database i

Re: slapd crashes with ch_realloc of X bytes failed

2012-11-23 Thread Quanah Gibson-Mount
--On Friday, November 23, 2012 9:45 PM +0100 Meike Stone wrote: I'm afraid to increase the cachesize in DB_CONFIG: ch_realloc means the system ran out of memory. Increasing the DB_CONFIG cachesize will run you out of memory more quickly. The best thing for you to do would be to upgrade t

Re: slapd crashes with ch_realloc of X bytes failed

2012-11-23 Thread Meike Stone
I'm afraid to increase the cachesize in DB_CONFIG: At the moment slapd uses 13146656K referenced Memory - that is a lot ... Memoy usage: ~# free -m total used free shared buffers cached Mem: 15946 15857 88 0 7

Re: slapd crashes with ch_realloc of X bytes failed

2012-11-23 Thread Meike Stone
Hello Dieter, >> My configuration: >> == DB_CONFIG == >> set_cachesize 2 0 1 >> set_lg_regionmax 262144 >> set_lg_bsize 2097152 >> set_flags DB_LOG_AUTOREMOVE > > you have a cache of 2GB and about 1.5M entries, you should definitly > increase the cachesize, take the

Re: slapd crashes with ch_realloc of X bytes failed

2012-11-23 Thread Dieter Klünter
Am Fri, 23 Nov 2012 18:05:14 +0100 schrieb Meike Stone : > Hello, > > since a short time, my slapd crashes often. > I have two servers running in MM replication. > I use openldap version 2.4.30 (for updates are only dedicated > timeslots...) The loglevel is set to 256 > > I see some strange mess

slapd crashes with ch_realloc of X bytes failed

2012-11-23 Thread Meike Stone
Hello, since a short time, my slapd crashes often. I have two servers running in MM replication. I use openldap version 2.4.30 (for updates are only dedicated timeslots...) The loglevel is set to 256 I see some strange messages in my log before the slapd crashes: "ch_realloc of 986032 bytes fail