On Fri, 4 Oct 2013, Rainer Gerhards wrote:
On Fri, Oct 4, 2013 at 12:54 PM, David Lang <[email protected]> wrote:
while you are making changes like this, you should also increase a couple
of other limits
the imfile limit of 100 inputs is something that people keep running into.
I will work on imfile in the next time and that will remove that limit
altogether.
sounds great.
the dynafile cache size is way too small. I don't understand why this
would take a significant amount of memory, even if you keep a output buffer
live for each file, it's only a few KB per file. I'd be looking to push
this up to 1000 or so unless there's some significant other memory needed.
It's not just about memory. Keep in mind that files are currently only
closed when they are evicted from cache. So this can lead to tons of open
files. Also, a high number is very dangerous when multiple dynafile actions
are being used (which is common). Let's say we have 20 such actions, that
means we potentially have a total of 20,000 files open (worst case). The
whole omfile file cache system can need a refactoring, and I think I prefer
to keep the numbers very conservative rather than risk blowing the system.
well, there's conservative and then there's what rsyslog currently has. :-)
but your comment brings up a question, you make it sound like there is a
separate dynafile cach for each action. Is this the case or is it one filehandle
cache? Given that you could have multiple actions write to the same file, I
would have expected a single cache to serialize the writes to the file.
it seems that what's really needed is some way of detecting that a file handle
has been inactive for a while and closing it. I'll have to think about hwo to
cheaply do this.
David Lang
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of
sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE
THAT.
