Re: [lttng-dev] High memory consumption issue on RCU side

2016-09-25 Thread Evgeniy Ivanov
Hi Mathieu, On Sun, Sep 25, 2016 at 4:10 PM, Mathieu Desnoyers wrote: > Hi, > > Did you enable the CDS_LFHT_ACCOUNTING flag for your hash tables at > creation, or only CDS_LFHT_AUTO_RESIZE ? Only CDS_LFHT_AUTO_RESIZE, with CDS_LFHT_ACCOUNTING situation with

Re: [lttng-dev] High memory consumption issue on RCU side

2016-09-25 Thread Mathieu Desnoyers
Hi, Did you enable the CDS_LFHT_ACCOUNTING flag for your hash tables at creation, or only CDS_LFHT_AUTO_RESIZE ? With only CDS_LFHT_AUTO_RESIZE, the algorithm used in check_resize() is to verify if the current chain is longer than CHAIN_LEN_RESIZE_THRESHOLD (which is currently 3). It effectively

Re: [lttng-dev] High memory consumption issue on RCU side

2016-09-24 Thread Paul E. McKenney
On Sat, Sep 24, 2016 at 03:34:47PM +, Mathieu Desnoyers wrote: > - On Sep 24, 2016, at 11:22 AM, Paul E. McKenney > paul...@linux.vnet.ibm.com wrote: > > > On Sat, Sep 24, 2016 at 10:42:24AM +0300, Evgeniy Ivanov wrote: > >> Hi Mathieu, > >> > >> On Sat, Sep 24, 2016 at 12:59 AM,

Re: [lttng-dev] High memory consumption issue on RCU side

2016-09-24 Thread Evgeniy Ivanov
All hash tables are created with 1024 initial buckets (no limit for max number of buckets). Only three tables can contain at most about 5 000 000 nodes, the rest (I think about 5000) tables contain at most 1000-5000 nodes. Big tables have UUID key and CityHash, small tables have a complicated

Re: [lttng-dev] High memory consumption issue on RCU side

2016-09-24 Thread Paul E. McKenney
On Sat, Sep 24, 2016 at 10:42:24AM +0300, Evgeniy Ivanov wrote: > Hi Mathieu, > > On Sat, Sep 24, 2016 at 12:59 AM, Mathieu Desnoyers > wrote: > > - On Sep 22, 2016, at 3:14 PM, Evgeniy Ivanov lolkaanti...@gmail.com > > wrote: > > > >> Hi all, > >> > >> I'm

Re: [lttng-dev] High memory consumption issue on RCU side

2016-09-24 Thread Mathieu Desnoyers
- On Sep 24, 2016, at 11:22 AM, Paul E. McKenney paul...@linux.vnet.ibm.com wrote: > On Sat, Sep 24, 2016 at 10:42:24AM +0300, Evgeniy Ivanov wrote: >> Hi Mathieu, >> >> On Sat, Sep 24, 2016 at 12:59 AM, Mathieu Desnoyers >> wrote: >> > - On Sep 22,

Re: [lttng-dev] High memory consumption issue on RCU side

2016-09-24 Thread Evgeniy Ivanov
Hi Mathieu, On Sat, Sep 24, 2016 at 12:59 AM, Mathieu Desnoyers wrote: > - On Sep 22, 2016, at 3:14 PM, Evgeniy Ivanov lolkaanti...@gmail.com > wrote: > >> Hi all, >> >> I'm investigating high memory usage of my program: RSS varies between >> executions in

Re: [lttng-dev] High memory consumption issue on RCU side

2016-09-23 Thread Mathieu Desnoyers
- On Sep 22, 2016, at 3:14 PM, Evgeniy Ivanov lolkaanti...@gmail.com wrote: > Hi all, > > I'm investigating high memory usage of my program: RSS varies between > executions in range 20-50 GB, though it should be determenistic. I've > found that all the memory is allocated in this stack: > >