Re: Solr Log Analysis

[Mark Miller]

Best tool for this job really depends on your needs, but one option:

I have a dev tool for Solr log analysis:
https://github.com/markrmiller/SolrLogReader

If you use the -o option, it will spill out just the queries to a file with
qtimes.

- Mark

On Wed, Sep 23, 2015 at 8:16 PM Tarala, Magesh <mtar...@bh.com> wrote:

> I'm using Solr 4.10.4 in a 3 node cloud setup. I have 3 shards and 3
> replicas for the collection.
>
> I want to analyze the logs to extract the queries and query times. Is
> there a tool or script someone has created already for this?
>
> Thanks,
> Magesh
>
-- 
- Mark
about.me/markrmiller

Re: Solr Log Analysis

[Ahmet Arslan]

Hi Tarala,

Never used my self but please see:

https://soleami.com/blog/soleami-start_en.html

Ahmet



On Thursday, September 24, 2015 3:16 AM, "Tarala, Magesh"  
wrote:
I'm using Solr 4.10.4 in a 3 node cloud setup. I have 3 shards and 3 replicas 
for the collection.

I want to analyze the logs to extract the queries and query times. Is there a 
tool or script someone has created already for this?

Thanks,
Magesh 

Re: Solr Log Analysis

[Will Hayes]

Hi - If you use Logstash for the log ingestion the config below will parse
what you need for search analytics including: terms, 0 results, response
times and more. Happy to assist off-list if you have any questions

https://github.com/LucidWorks/silkusecases/blob/master/searchanalytics/silk_solrlogs.conf

If you want an open source Solr centric solution pre-packaged for the
ingestion and visualization of those logs you can download Silk here:

http://lucidworks.com/fusion/silk/

Best Regards,
-wh

--
Will Hayes | CEO
email. w...@lucidworks.com | direct. +1.415.997.9455
Lucidworks | 340 Brannan St. Suite 400 | San Francisco, CA
www.lucidworks.com | www.linkedin.com/in/willhayes | @iamwillhayes


On Thu, Sep 24, 2015 at 3:23 AM, Ahmet Arslan 
wrote:

> Hi Tarala,
>
> Never used my self but please see:
>
> https://soleami.com/blog/soleami-start_en.html
>
> Ahmet
>
>
>
> On Thursday, September 24, 2015 3:16 AM, "Tarala, Magesh" 
> wrote:
> I'm using Solr 4.10.4 in a 3 node cloud setup. I have 3 shards and 3
> replicas for the collection.
>
> I want to analyze the logs to extract the queries and query times. Is
> there a tool or script someone has created already for this?
>
> Thanks,
> Magesh
>

Re: Solr Log Analysis

[Otis Gospodnetić]

Hi Magesh,

Here are 2 more solutions you could use:

1) Site Search Analytics  -- this
basically integrates into your search results via JS like Google Analytics
and automatically captures a bunch of search and click data and gives you a
number of search-focused reports/charts (at aggregate level) out of the box.
2) Logsene  - this will take any events and
let you search then, filter them, graph them, aggregate on them, alert on
them, put them on custom dashboards, correlate with app/server logs, with
Solr metrics (via SPM for Solr
), etc. etc.  If
you happen to like/know Kibana or Banana or Spunk this will look very
familiar.  As a matter of fact, Kibana 4 is integrated into Logsene.

Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/


On Wed, Sep 23, 2015 at 8:16 PM, Tarala, Magesh  wrote:

> I'm using Solr 4.10.4 in a 3 node cloud setup. I have 3 shards and 3
> replicas for the collection.
>
> I want to analyze the logs to extract the queries and query times. Is
> there a tool or script someone has created already for this?
>
> Thanks,
> Magesh
>

Solr Log Analysis

[Tarala, Magesh]

I'm using Solr 4.10.4 in a 3 node cloud setup. I have 3 shards and 3 replicas 
for the collection.

I want to analyze the logs to extract the queries and query times. Is there a 
tool or script someone has created already for this?

Thanks,
Magesh