Also grok filters will probably be a good fit for your parsing of the log files .. http://logstash.net/docs/1.1.3/filters/grok
On Thursday, October 25, 2012 2:04:26 PM UTC+11, Craig Read wrote: > > I'm currently parsing some large log files and populating a rails db with > 'key' pieces of information from those logs via ActiveResource. > They're not 'web logs', and each line can have totally different data > (including how the data is structured), so most of the tools I see around > aren't applicable to my particular use case. Also, only about 0.05% of the > data is actually relevant, so I'm looking for a 'better way'. > > I did see mention of 'treating logs as data' (and Splunk in particular) on > the latest TW Tech Radar. > Is anybody using Splunk <http://www.splunk.com/> with (or without) the > ruby-splunk <https://github.com/beezly/ruby-splunk> gem? > If so, do you recommend it, or is there a better approach to doing this? > > Cheers, > > -- > Craig Read > > @Catharz > https://github.com/Catharz > http://stackoverflow.com/users/158893/catharz > > -- You received this message because you are subscribed to the Google Groups "Ruby or Rails Oceania" group. To view this discussion on the web visit https://groups.google.com/d/msg/rails-oceania/-/sKBZm-k6tYkJ. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/rails-oceania?hl=en.
