I like the look of that! I'll have a play with it over the weekend. -- Craig Read @Catharz https://github.com/Catharz http://code.google.com/p/bsss
On 25/10/2012, at 2:24 PM, "Tim Koopmans @90kts" <[email protected]> wrote: > Also grok filters will probably be a good fit for your parsing of the log > files .. > http://logstash.net/docs/1.1.3/filters/grok > > > > On Thursday, October 25, 2012 2:04:26 PM UTC+11, Craig Read wrote: >> >> I'm currently parsing some large log files and populating a rails db with >> 'key' pieces of information from those logs via ActiveResource. >> They're not 'web logs', and each line can have totally different data >> (including how the data is structured), so most of the tools I see around >> aren't applicable to my particular use case. Also, only about 0.05% of the >> data is actually relevant, so I'm looking for a 'better way'. >> >> I did see mention of 'treating logs as data' (and Splunk in particular) on >> the latest TW Tech Radar. >> Is anybody using Splunk with (or without) the ruby-splunk gem? >> If so, do you recommend it, or is there a better approach to doing this? >> >> Cheers, >> >> -- >> Craig Read >> >> @Catharz >> https://github.com/Catharz >> http://stackoverflow.com/users/158893/catharz > > -- > You received this message because you are subscribed to the Google Groups > "Ruby or Rails Oceania" group. > To view this discussion on the web visit > https://groups.google.com/d/msg/rails-oceania/-/sKBZm-k6tYkJ. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/rails-oceania?hl=en. -- You received this message because you are subscribed to the Google Groups "Ruby or Rails Oceania" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/rails-oceania?hl=en.
