Hi For performance improvement I'm trying to combine Elasticsearch/Logstash/Kibana with Hadoop (cdh4) and configure opensource alternative to Hunk. Unfortunately I'm familiar only with HDFS where I store logs. In my opinion the combination of Elasticsearch and Hadoop should use HDFS as storage and transparent Hadoop map/reduce functionality for search.
I ran through elasticsearch-hadoop documentation and unfortunately I didn't understand how this combination could help me for Kibana log analysis. Documentation says "Elasticsearch real-time search and analytics natively integrated with Hadoop.". But what should I configure? Hadoop with Elasticsearch or Elasticsearch with Hadoop? As for the first one, I found only Java code parts, nothing about the Hadoop configuration, so it seems that I should be familiar with Java programming. As for the last one I found only "Hadoop HDFS Snapshot/Restore plugin", but I guess it was developed for indexes backup/restore, am I right? Anyway, are my expectations right? Or elasticsearch-hadoop was developed for Hadoop developers only and it is not suitable for "elasticsearch/logstash/kibana + hadoop" (like Hunk). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/cb3a8c8e-a279-422b-8967-c9e2a544ca9e%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
