On Tue, 22 Jul 2014, Micah Yoder wrote:
Hi,We're seeing signifcant memory leakage in rsyslogd in our production environment. Verified with 8.2.1 and after the upgrade to 8.2.2. To give you an idea, rsyslogd now uses nearly 40GB of RSS memory with about 20 hours of uptime. This is using the package from the RPM repo. Unfortunately I'm not sure how much detail I can go into on our configuration on the public list. It's moderately complex, but I'm sure there are more complex systems around. I ran some impstats output through the online stats analyzer and got a lot of this: - 33% File Requests were evicted ('10885927' requests, '3594792' evicted) between line 253 and 255 (Startdate: '2014/Jul/22 07:16:42' Enddate: '2014/Jul/22 07:16:42') - 7% File Requests were evicted ('1982155' requests, '141794' evicted) between line 255 and 301 (Startdate: '2014/Jul/22 07:16:42' Enddate: '2014/Jul/22 07:17:42') - 32% File Requests were evicted ('10907196' requests, '3598535' evicted) between line 303 and 305 (Startdate: '2014/Jul/22 07:17:42' Enddate: '2014/Jul/22 07:17:42') This appears on dynafile lines - could this have something to do with it? Has anyone else seen significant memory leakage? I/O wait is pretty much zero, as is user and system CPU usage. The system is virtually idle, with very low load, even for quite a high traffic of logs coming in.
Well, that indicates that you have a problem with your dynafile configuration, you don't allow enough files to be open, lookup dynafilecachesize and increase it to be much larger
With this sort of problem, your performance is going to be horrid, and as such, your queues will grow. Not seeing your impstats output, but I'll bet the size of the queues is large, and if you mutiply those sizes by the maxmessagesize, you will probably end up accounting for a lot of the memory that you think is 'leaking'
David Lang _______________________________________________ rsyslog mailing list http://lists.adiscon.net/mailman/listinfo/rsyslog http://www.rsyslog.com/professional-services/ What's up with rsyslog? Follow https://twitter.com/rgerhards NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
