Re: BIRD memory usage

2016-09-19 Thread Justin Cattle
Roger that. I've deployed a new version with the patch from a290da25a16b7c79d4a7a87f522b4068bca04979 - I'll leave it for a few days and report back. Please let me know if you think there are any further issues, or any subsequent extra patches on top that are relevant. Thanks! Cheers, Just

Re: BIRD memory usage

2016-09-19 Thread Ondrej Zajicek
On Mon, Sep 19, 2016 at 11:04:29AM +0100, Justin Cattle wrote: > I *think* I have answered my own question. The patch in the email doesn't > include the switch to xmalloc that was originally in > the krt-export-filtr-fix branch as well. > > I can see from `git blame` that it's in the previous com

Re: BIRD memory usage

2016-09-19 Thread Justin Cattle
I *think* I have answered my own question. The patch in the email doesn't include the switch to xmalloc that was originally in the krt-export-filtr-fix branch as well. I can see from `git blame` that it's in the previous commit, bc00f058154bb4a630d24d64a55b5f181d235c63 [ Filter: Prefer xmalloc/x

Re: BIRD memory usage

2016-09-19 Thread Justin Cattle
Ok - great. Should this patch apply to the 1.6 released version ok ? I was tracking from the krt-export-filtr-fix before, that that is now gone :) Cheers, Just On 19 September 2016 at 10:13, Ondrej Zajicek wrote: > On Mon, Sep 19, 2016 at 09:46:03AM +0100, Justin Cattle wrote: > > Hi Pavel,

Re: BIRD memory usage

2016-09-19 Thread Ondrej Zajicek
On Mon, Sep 19, 2016 at 09:46:03AM +0100, Justin Cattle wrote: > Hi Pavel, > > > After running with this latest fixup commit for a week, I see mixed results. > > With the first fix you created, all the processes remained using a very > small amount of memory, consistently. As per my previous em

Re: BIRD memory usage

2016-09-19 Thread Justin Cattle
Hi Pavel, After running with this latest fixup commit for a week, I see mixed results. With the first fix you created, all the processes remained using a very small amount of memory, consistently. As per my previous email, around 80Mg. With the second fix, some of the bird processes are using u

Re: BIRD memory usage

2016-09-12 Thread Justin Cattle
Thanks Pavel - I have updated our package and rolled this version out where the previous new package was. As it's a new version, I will leave it a few more days before deploying everywhere now. Cheers, Just On 12 September 2016 at 08:16, Pavel Tvrdík wrote: > Hi, Justin. > > On 2016-09-09

Re: BIRD memory usage

2016-09-12 Thread Pavel Tvrdík
Hi, Justin. On 2016-09-09 10:45, Justin Cattle wrote: Hi Pavel, This is looking good for us :) It's been in the lab for 3 days across 25 hosts, and memory usage looks absolutely static after process start. We have a couple of canary hosts in production too, and they are showing the same result

Re: BIRD memory usage

2016-09-09 Thread Justin Cattle
Hi Pavel, This is looking good for us :) It's been in the lab for 3 days across 25 hosts, and memory usage looks absolutely static after process start. We have a couple of canary hosts in production too, and they are showing the same results. Example stats: # birdc show route count BIRD 1.6.0

Re: BIRD memory usage

2016-09-07 Thread Pavel Tvrdík
Hi, Just. On 2016-09-06 22:50, Justin Cattle wrote: I found some time to package using a patch to the latest 1.6.0 release, created from a diff of origin/krt-export-filtr-fix against v1.6.0-34-g768d013 [ seems to be the top three commits ]. Yes, the top three commits, exactly! I hope that's

Re: BIRD memory usage

2016-09-06 Thread Justin Cattle
I found some time to package using a patch to the latest 1.6.0 release, created from a diff of origin/krt-export-filtr-fix against v1.6.0-34-g768d013 [ seems to be the top three commits ]. I hope that's valid. That patch applied without issue, and I wrapped it into a debian patch. I've installed

Re: BIRD memory usage

2016-09-06 Thread Justin Cattle
Hi Ondrej, Yes - it's a version from git with BGP multipath support: v1.5.0-19-g8d9eef1. Cheers, Just On 6 September 2016 at 17:05, Ondrej Zajicek wrote: > On Mon, Sep 05, 2016 at 03:21:40PM +0100, Justin Cattle wrote: > > Hi, > > > > > > A colleague of mine reported a memory usage issue w

Re: BIRD memory usage

2016-09-06 Thread Justin Cattle
Hi Pavel, Thanks for quick response! I will try that as soon as I can, hopefully in the next couple of days. I'll report back as soon as I know. Cheers, Just On 6 September 2016 at 16:46, Pavel Tvrdík wrote: > Hi Justin, > > > On 2016-09-05 16:21, Justin Cattle wrote: > >> Hi, >> >> A coll

Re: BIRD memory usage

2016-09-06 Thread Ondrej Zajicek
On Mon, Sep 05, 2016 at 03:21:40PM +0100, Justin Cattle wrote: > Hi, > > > A colleague of mine reported a memory usage issue with the bird daemon last > year, which resulted in a request for a core dump, but we never followed it > up. > I'd like to re-open this discussion and see if anything can

Re: BIRD memory usage

2016-09-06 Thread Pavel Tvrdík
Hi Justin, On 2016-09-05 16:21, Justin Cattle wrote: Hi, A colleague of mine reported a memory usage issue with the bird daemon last year, which resulted in a request for a core dump, but we never followed it up. I'd like to re-open this discussion and see if anything can be done to fix it. I'

Re: BIRD memory usage

2015-10-01 Thread Alexander Frolkin
Hi Ondrej, > I cannot reproduce the problem. Could you get me a core dump when the memory > consumption is noticeable higher than after the start? I was going to do this, but then saw that all our instances are now using at most 28MB for routing tables! The config has not changed since I reporte

Re: BIRD memory usage

2015-09-29 Thread Ondrej Zajicek
On Mon, Sep 21, 2015 at 10:10:08AM +0200, Alexander Frolkin wrote: > Hi Ondrej, > > > > Is there something we can do to reduce the memory usage? Or could this > > > be a memory leak bug? > > This is definitely a memory leak, probably related to path merging. You > > are using current code from gi

Re: BIRD memory usage

2015-09-21 Thread Alexander Frolkin
Hi Ondrej, > > Is there something we can do to reduce the memory usage? Or could this > > be a memory leak bug? > This is definitely a memory leak, probably related to path merging. You > are using current code from git or patched 1.5.0? I will try to reproduce > it. Thanks. We are using a vers

Re: BIRD memory usage

2015-09-19 Thread Ondrej Zajicek
On Fri, Sep 18, 2015 at 01:55:25PM +0200, Alexander Frolkin wrote: > Hello, > > We are running BIRD on a number of servers. It is configured with two BGP > peers. > > We are seeing BIRD using over a gig of memory, and this seems excessive, > especially given the number of routes. ... > Is there