At LinkedIn, we use Sensei DB which is a distributed, real-time database that allows you to plug various gateways for indexing. One of these gateways is Kafka. This allows you to search the logs that are sent to Kafka in a semi-structured manner.
http://engineering.linkedin.com/open-source/introducing-senseidb-10-open-source-distributed-realtime-semi-structured-database Thanks, Neha On Mon, Oct 22, 2012 at 9:13 AM, Guy Doulberg <guy.doulb...@conduit.com> wrote: > Hi, > > I did a POC using Graylog, > > I changed the indexing policy of graylog (using grules), > > And than I made my logs searchable, > > > > On 10/22/2012 06:08 PM, Taylor Gautier wrote: >> >> Hey there, >> >> I'm wondering if anyone has put logstash and kafka together? I want to be >> able to have a good searchable interface to my logs that I intend to have >> go through kafka. >> >> If you haven't used logstash, are there any other suggestions for an web >> based interface to search and/or do analytics with the logs? >> >> Thanks in advance! > >
