On Fri, Jan 11, 2013 at 4:00 PM, David Lang <[email protected]> wrote:

> I need to find a program to scrape log files and send them to a syslog
> server.
>
> Similar to what logger will do, but I would like to find something that
> can deal somewhat sanely with multi-line (java) logfiles, trying to combine
> the multi-line dumps into one log entry. Since this can create very long
> log messages, it would need to have some way of dealing with them
> (splitting into multiple smaller messages ideally)
>
> I also have the problem that some of the programs create logfiles that
> have timestamps in the filename, so I need to tell the program to scrape
> all logs it finds that match a pattern (and have it find new logs that
> match that pattern over time)
>
> I worked on writing a perl program to do this, but after doing a bunch of
> work on it I had it go into a cpu burning loop and so now management wants
> an 'off the shelf' solution instead of something that I've written :-/
>
> Any suggestions?
>
> logger doesn't handle multi-line messages or wildcarded filenames
>
> rsyslog doesn't handle wildcarded filenames or splitting long messages (it
> does handle combining the lines, but it will then truncate them to the max
> log size)
>
> Unfortunantly the engineering team doesn't want to take the 'risk' of
> reconfiguring the Java logging to send directly to a syslog server so just
> reconfiguring log4j and equivalent are not an option.
>
> David Lang
> ______________________________**_________________
> Tech mailing list
> [email protected]
> https://lists.lopsa.org/cgi-**bin/mailman/listinfo/tech<https://lists.lopsa.org/cgi-bin/mailman/listinfo/tech>
> This list provided by the League of Professional System Administrators
> http://lopsa.org/
>


Hello David,

I haven't gotten a chance to play with it myself yet, but my Network Admin
says "Logstash" should be able to meet many of those requirements.

http://logstash.net/


Best of luck!
-- 
##### "The compassionate have no enemies, the wise have no worries."
#####                                          - Jing-si Aphorism
##### http://kso.cc
_______________________________________________
Tech mailing list
[email protected]
https://lists.lopsa.org/cgi-bin/mailman/listinfo/tech
This list provided by the League of Professional System Administrators
 http://lopsa.org/

Reply via email to