Re: Solr metrics in Codahale metrics and Graphite?

2014-03-16 Thread Greg Pendlebury
In the codahale metrics library there are 1, 5 and 15 minute moving averages just like you would see in a tool like 'top'. However in Solr I can only see 5 and 15 minute values, plus 'avgRequestsPerSecond'. I assumed this was the 1 minute value initially, but it seems to be something like the

Re: Solr metrics in Codahale metrics and Graphite?

2014-03-16 Thread Shalin Shekhar Mangar
Greg, SOLR-4735 (using the codahale metrics lib) hasn't been committed yet. It is still work in progress. Actually the internal Solr Metrics class has a method to return 1 minute stats but it is not used. On Mon, Mar 17, 2014 at 10:06 AM, Greg Pendlebury greg.pendleb...@gmail.com wrote: In the

Re: Solr metrics in Codahale metrics and Graphite?

2014-03-16 Thread Greg Pendlebury
Oh my bad. I thought it was already in. Thanks for the correction. Ta, Greg On 17 March 2014 15:55, Shalin Shekhar Mangar shalinman...@gmail.comwrote: Greg, SOLR-4735 (using the codahale metrics lib) hasn't been committed yet. It is still work in progress. Actually the internal Solr

Re: Solr metrics in Codahale metrics and Graphite?

2013-05-03 Thread Furkan KAMACI
Does anybody tested Ganglia with JMXTrans at production environment for SolrCloud? 2013/4/26 Dmitry Kan solrexp...@gmail.com Alan, Shawn, If backporting to 3.x is hard, no worries, we don't necessarily require the patch as we are heading to 4.x eventually. It is just much easier within our

Re: Solr metrics in Codahale metrics and Graphite?

2013-04-26 Thread Dmitry Kan
Alan, Shawn, If backporting to 3.x is hard, no worries, we don't necessarily require the patch as we are heading to 4.x eventually. It is just much easier within our organization to test on the existing solr 3.4 as there are a few of internal dependencies and custom code on top of solr. Also solr

Re: Solr metrics in Codahale metrics and Graphite?

2013-04-25 Thread Alan Woodward
Hi Walter, Dmitry, I opened https://issues.apache.org/jira/browse/SOLR-4735 for this, with some work-in-progress. Have a look! Alan Woodward www.flax.co.uk On 23 Apr 2013, at 07:40, Dmitry Kan wrote: Hello Walter, Have you had a chance to get something working with graphite, codahale

Re: Solr metrics in Codahale metrics and Graphite?

2013-04-25 Thread Dmitry Kan
Hi Alan, Great! What is the solr version you are patching? Speaking of graphite, we have set it up recently to monitor our shard farm. So far since the RAM usage has been most important metric we were fine with pidstat command and a little script generating stats for carbon. Having some

Re: Solr metrics in Codahale metrics and Graphite?

2013-04-25 Thread Alan Woodward
This is on top of trunk at the moment, but would be back ported to 4.4 if there was interest. Alan Woodward www.flax.co.uk On 25 Apr 2013, at 10:32, Dmitry Kan wrote: Hi Alan, Great! What is the solr version you are patching? Speaking of graphite, we have set it up recently to monitor

Re: Solr metrics in Codahale metrics and Graphite?

2013-04-25 Thread Dmitry Kan
We are very much interested in 3.4. On Thu, Apr 25, 2013 at 12:55 PM, Alan Woodward a...@flax.co.uk wrote: This is on top of trunk at the moment, but would be back ported to 4.4 if there was interest. Alan Woodward www.flax.co.uk On 25 Apr 2013, at 10:32, Dmitry Kan wrote: Hi Alan,

Re: Solr metrics in Codahale metrics and Graphite?

2013-04-25 Thread Shawn Heisey
On 4/25/2013 6:30 AM, Dmitry Kan wrote: We are very much interested in 3.4. On Thu, Apr 25, 2013 at 12:55 PM, Alan Woodward a...@flax.co.uk wrote: This is on top of trunk at the moment, but would be back ported to 4.4 if there was interest. This will be bad news, I'm sorry: All remaining

Re: Solr metrics in Codahale metrics and Graphite?

2013-04-23 Thread Dmitry Kan
Hello Walter, Have you had a chance to get something working with graphite, codahale and solr? Has anyone else tried these tools with Solr 3.x family? How much work is it to set things up? We have tried zabbix in the past. Even though it required lots of up front investment on configuration, it

Re: Solr metrics in Codahale metrics and Graphite?

2013-04-09 Thread Walter Underwood
If it isn't obvious, I'm glad to help test a patch for this. We can run a simulated production load in dev and report to our metrics server. wunder On Apr 8, 2013, at 1:07 PM, Walter Underwood wrote: That approach sounds great. --wunder On Apr 7, 2013, at 9:40 AM, Alan Woodward wrote:

Re: Solr metrics in Codahale metrics and Graphite?

2013-04-08 Thread Walter Underwood
That approach sounds great. --wunder On Apr 7, 2013, at 9:40 AM, Alan Woodward wrote: I've been thinking about how to improve this reporting, especially now that metrics-3 (which removes all of the funky thread issues we ran into last time I tried to add it to Solr) is close to release. I

Re: Solr metrics in Codahale metrics and Graphite?

2013-04-07 Thread Alan Woodward
I've been thinking about how to improve this reporting, especially now that metrics-3 (which removes all of the funky thread issues we ran into last time I tried to add it to Solr) is close to release. I think we could go about it as follows: * refactor the existing JMX reporting to use

Re: Solr metrics in Codahale metrics and Graphite?

2013-04-06 Thread Walter Underwood
Wow, that really doesn't help at all, since these seem to only be reported in the stats page. I don't need another non-standard app-specific set of metrics, especially one that needs polling. I need metrics delivered to the common system that we use for all our servers. This is also why SPM

Re: Solr metrics in Codahale metrics and Graphite?

2013-04-03 Thread Shawn Heisey
On 3/29/2013 12:07 PM, Walter Underwood wrote: What are folks using for this? I don't know that this really answers your question, but Solr 4.1 and later includes a big chunk of codahale metrics internally for request handler statistics - see SOLR-1972. First we tried including the jar and

Re: Solr metrics in Codahale metrics and Graphite?

2013-04-03 Thread Walter Underwood
That sounds great. I'll check out the bug, I didn't see anything in the docs about this. And if I can't find it with a search engine, it probably isn't there. --wunder On Apr 3, 2013, at 6:39 AM, Shawn Heisey wrote: On 3/29/2013 12:07 PM, Walter Underwood wrote: What are folks using for

Re: Solr metrics in Codahale metrics and Graphite?

2013-04-03 Thread Otis Gospodnetic
It's there! :) http://search-lucene.com/?q=percentilefc_project=Solrfc_type=issue Otis -- Solr ElasticSearch Support http://sematext.com/ On Wed, Apr 3, 2013 at 6:29 PM, Walter Underwood wun...@wunderwood.org wrote: That sounds great. I'll check out the bug, I didn't see anything in the

Re: Solr metrics in Codahale metrics and Graphite?

2013-04-03 Thread Walter Underwood
In the Jira, but not in the docs. It would be nice to have VM stats like GC, too, so we can have common monitoring and alerting on all our services. wunder On Apr 3, 2013, at 3:31 PM, Otis Gospodnetic wrote: It's there! :) http://search-lucene.com/?q=percentilefc_project=Solrfc_type=issue

Solr metrics in Codahale metrics and Graphite?

2013-03-29 Thread Walter Underwood
What are folks using for this? wunder -- Walter Underwood wun...@wunderwood.org