Re: cache monitoring tools?
,
minSize=9000, acceptableSize=9500, cleanupThread=false)
stats: lookups : 79
hits : 77
hitratio : 0.97
inserts : 1
evictions : 0
size : 1
warmupTime : 0
cumulative_lookups : 79
cumulative_hits : 77
cumulative_hitratio : 0.97
cumulative_inserts : 1
cumulative_evictions : 0
item_shingleContent_trigram :
{field=shingleContent_trigram,memSize=326924381,tindexSize=4765394,time=215426,phase1=213868,nTerms=14827061,bigTerms=35,termInstances=114359167,uses=78}
name: filterCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=153600,
initialSize=4096,
minSize=138240, acceptableSize=145920, cleanupThread=false)
stats: lookups : 1082854
hits : 940370
hitratio : 0.86
inserts : 142486
evictions : 0
size : 142486
warmupTime : 0
cumulative_lookups : 1082854
cumulative_hits : 940370
cumulative_hitratio : 0.86
cumulative_inserts : 142486
cumulative_evictions : 0
index size: 3,25 GB
Does anyone have some pointers to where to look at and optimize
for
query
time?
2011/12/7 Tomás Fernández Löbbe tomasflo...@gmail.com
Hi Dimitry, cache information is exposed via JMX, so you
should
be
able
to
monitor that information with any JMX tool. See
http://wiki.apache.org/solr/SolrJmx
On Wed, Dec 7, 2011 at 6:19 AM, Dmitry Kan
dmitry@gmail.com
wrote:
Yes, we do require that much.
Ok, thanks, I will try increasing the maxsize.
On Wed, Dec 7, 2011 at 10:56 AM, pravesh
suyalprav...@yahoo.com
wrote:
facet.limit=50
your facet.limit seems too high. Do you actually require
this
much?
Since there a lot of evictions from filtercache, so,
increase
the
maxsize
value to your acceptable limit.
Regards
Pravesh
--
View this message in context:
http://lucene.472066.n3.nabble.com/cache-monitoring-tools-tp3566645p3566811.html
Sent from the Solr - User mailing list archive at
Nabble.com.
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
Re: cache monitoring tools?
: org.apache.solr.search.FastLRUCache version: 1.0 description: Concurrent LRU Cache(maxSize=153600, initialSize=4096, minSize=138240, acceptableSize=145920, cleanupThread=false) stats: lookups : 1082854 hits : 940370 hitratio : 0.86 inserts : 142486 evictions : 0 size : 142486 warmupTime : 0 cumulative_lookups : 1082854 cumulative_hits : 940370 cumulative_hitratio : 0.86 cumulative_inserts : 142486 cumulative_evictions : 0 index size: 3,25 GB Does anyone have some pointers to where to look at and optimize for query time? 2011/12/7 Tomás Fernández Löbbe tomasflo...@gmail.com Hi Dimitry, cache information is exposed via JMX, so you should be able to monitor that information with any JMX tool. See http://wiki.apache.org/solr/SolrJmx On Wed, Dec 7, 2011 at 6:19 AM, Dmitry Kan dmitry@gmail.com wrote: Yes, we do require that much. Ok, thanks, I will try increasing the maxsize. On Wed, Dec 7, 2011 at 10:56 AM, pravesh suyalprav...@yahoo.com wrote: facet.limit=50 your facet.limit seems too high. Do you actually require this much? Since there a lot of evictions from filtercache, so, increase the maxsize value to your acceptable limit. Regards Pravesh -- View this message in context: http://lucene.472066.n3.nabble.com/cache-monitoring-tools-tp3566645p3566811.html Sent from the Solr - User mailing list archive at Nabble.com. -- Regards, Dmitry Kan -- Regards, Dmitry Kan -- Regards, Dmitry Kan -- Regards, Dmitry Kan
Re: cache monitoring tools?
? 2011/12/7 Tomás Fernández Löbbe tomasflo...@gmail.com Hi Dimitry, cache information is exposed via JMX, so you should be able to monitor that information with any JMX tool. See http://wiki.apache.org/solr/SolrJmx On Wed, Dec 7, 2011 at 6:19 AM, Dmitry Kan dmitry@gmail.com wrote: Yes, we do require that much. Ok, thanks, I will try increasing the maxsize. On Wed, Dec 7, 2011 at 10:56 AM, pravesh suyalprav...@yahoo.com wrote: facet.limit=50 your facet.limit seems too high. Do you actually require this much? Since there a lot of evictions from filtercache, so, increase the maxsize value to your acceptable limit. Regards Pravesh -- View this message in context: http://lucene.472066.n3.nabble.com/cache-monitoring-tools-tp3566645p3566811.html Sent from the Solr - User mailing list archive at Nabble.com. -- Regards, Dmitry Kan -- Regards, Dmitry Kan -- Regards, Dmitry Kan -- Regards, Dmitry Kan -- Regards, Dmitry Kan
Re: cache monitoring tools?
Hoss, I can't see why Network IO is the issue as the shards and the front end SOLR resided on the same server. I said resided, because I got rid of the front end (which according to my measurements, was taking at least as much time for merging as it took to find the actual data in the shards) and shards. Now I have only one shard having all the data. Filter cache tuning also helped to reduce the amount of evictions to a minimum. Dmitry On Fri, Dec 9, 2011 at 10:42 PM, Chris Hostetter hossman_luc...@fucit.orgwrote: : The culprit seems to be the merger (frontend) SOLR. Talking to one shard : directly takes substantially less time (1-2 sec). ... :facet.limit=50 Your probably most likeley has very little to do with your caches at all -- a facet.limit that high requires sending a very large amount of data over the wire, multiplied by the number of shards, multipled by some constant (i think it's 2 but it might be higher) in order to over request facet constriant counts from each shard to aggregate them. the dominant factor in the slow speed you are seeing is most likeley Network IO between the shards. -Hoss -- Regards, Dmitry Kan
Re: cache monitoring tools?
Paul, have you checked solrmeter and zabbix?
Dmitry
On Fri, Dec 9, 2011 at 11:16 PM, Paul Libbrecht p...@hoplahup.net wrote:
Allow me to chim in and ask a generic question about monitoring tools for
people close to developers: are any of the tools mentioned in this thread
actually able to show graphs of loads, e.g. cache counts or CPU load, in
parallel to a console log or to an http request log??
I am working on such a tool currently but I have a bad feeling of
reinventing the wheel.
thanks in advance
Paul
Le 8 déc. 2011 à 08:53, Dmitry Kan a écrit :
Otis, Tomás: thanks for the great links!
2011/12/7 Tomás Fernández Löbbe tomasflo...@gmail.com
Hi Dimitry, I pointed to the wiki page to enable JMX, then you can use
any
tool that visualizes JMX stuff like Zabbix. See
http://www.lucidimagination.com/blog/2011/10/02/monitoring-apache-solr-and-lucidworks-with-zabbix/
On Wed, Dec 7, 2011 at 11:49 AM, Dmitry Kan dmitry@gmail.com
wrote:
The culprit seems to be the merger (frontend) SOLR. Talking to one
shard
directly takes substantially less time (1-2 sec).
On Wed, Dec 7, 2011 at 4:10 PM, Dmitry Kan dmitry@gmail.com
wrote:
Tomás: thanks. The page you gave didn't mention cache specifically, is
there more documentation on this specifically? I have used solrmeter
tool,
it draws the cache diagrams, is there a similar tool, but which would
use
jmx directly and present the cache usage in runtime?
pravesh:
I have increased the size of filterCache, but the search hasn't become
any
faster, taking almost 9 sec on avg :(
name: search
class: org.apache.solr.handler.component.SearchHandler
version: $Revision: 1052938 $
description: Search using components:
org.apache.solr.handler.component.QueryComponent,org.apache.solr.handler.component.FacetComponent,org.apache.solr.handler.component.MoreLikeThisComponent,org.apache.solr.handler.component.HighlightComponent,org.apache.solr.handler.component.StatsComponent,org.apache.solr.handler.component.DebugComponent,
stats: handlerStart : 1323255147351
requests : 100
errors : 3
timeouts : 0
totalTime : 885438
avgTimePerRequest : 8854.38
avgRequestsPerSecond : 0.008789442
the stats (copying fieldValueCache as well here, to show term
statistics):
name: fieldValueCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=1, initialSize=10,
minSize=9000, acceptableSize=9500, cleanupThread=false)
stats: lookups : 79
hits : 77
hitratio : 0.97
inserts : 1
evictions : 0
size : 1
warmupTime : 0
cumulative_lookups : 79
cumulative_hits : 77
cumulative_hitratio : 0.97
cumulative_inserts : 1
cumulative_evictions : 0
item_shingleContent_trigram :
{field=shingleContent_trigram,memSize=326924381,tindexSize=4765394,time=215426,phase1=213868,nTerms=14827061,bigTerms=35,termInstances=114359167,uses=78}
name: filterCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=153600, initialSize=4096,
minSize=138240, acceptableSize=145920, cleanupThread=false)
stats: lookups : 1082854
hits : 940370
hitratio : 0.86
inserts : 142486
evictions : 0
size : 142486
warmupTime : 0
cumulative_lookups : 1082854
cumulative_hits : 940370
cumulative_hitratio : 0.86
cumulative_inserts : 142486
cumulative_evictions : 0
index size: 3,25 GB
Does anyone have some pointers to where to look at and optimize for
query
time?
2011/12/7 Tomás Fernández Löbbe tomasflo...@gmail.com
Hi Dimitry, cache information is exposed via JMX, so you should be
able
to
monitor that information with any JMX tool. See
http://wiki.apache.org/solr/SolrJmx
On Wed, Dec 7, 2011 at 6:19 AM, Dmitry Kan dmitry@gmail.com
wrote:
Yes, we do require that much.
Ok, thanks, I will try increasing the maxsize.
On Wed, Dec 7, 2011 at 10:56 AM, pravesh suyalprav...@yahoo.com
wrote:
facet.limit=50
your facet.limit seems too high. Do you actually require this
much?
Since there a lot of evictions from filtercache, so, increase the
maxsize
value to your acceptable limit.
Regards
Pravesh
--
View this message in context:
http://lucene.472066.n3.nabble.com/cache-monitoring-tools-tp3566645p3566811.html
Sent from the Solr - User mailing list archive at Nabble.com.
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
Re: cache monitoring tools?
Justin, in terms of the overhead, have you noticed if Munin puts much of it
when used in production? In terms of the solr farm: how big is a shard's
index (given you have sharded architecture).
Dmitry
On Sun, Dec 11, 2011 at 6:39 PM, Justin Caratzas
justin.carat...@gmail.comwrote:
At my work, we use Munin and Nagio for monitoring and alerts. Munin is
great because writing a plugin for it so simple, and with Solr's
statistics handler, we can track almost any solr stat we want. It also
comes with included plugins for load, file system stats, processes,
etc.
http://munin-monitoring.org/
Justin
Paul Libbrecht p...@hoplahup.net writes:
Allow me to chim in and ask a generic question about monitoring tools
for people close to developers: are any of the tools mentioned in this
thread actually able to show graphs of loads, e.g. cache counts or CPU
load, in parallel to a console log or to an http request log??
I am working on such a tool currently but I have a bad feeling of
reinventing the wheel.
thanks in advance
Paul
Le 8 déc. 2011 à 08:53, Dmitry Kan a écrit :
Otis, Tomás: thanks for the great links!
2011/12/7 Tomás Fernández Löbbe tomasflo...@gmail.com
Hi Dimitry, I pointed to the wiki page to enable JMX, then you can use
any
tool that visualizes JMX stuff like Zabbix. See
http://www.lucidimagination.com/blog/2011/10/02/monitoring-apache-solr-and-lucidworks-with-zabbix/
On Wed, Dec 7, 2011 at 11:49 AM, Dmitry Kan dmitry@gmail.com
wrote:
The culprit seems to be the merger (frontend) SOLR. Talking to one
shard
directly takes substantially less time (1-2 sec).
On Wed, Dec 7, 2011 at 4:10 PM, Dmitry Kan dmitry@gmail.com
wrote:
Tomás: thanks. The page you gave didn't mention cache specifically,
is
there more documentation on this specifically? I have used solrmeter
tool,
it draws the cache diagrams, is there a similar tool, but which would
use
jmx directly and present the cache usage in runtime?
pravesh:
I have increased the size of filterCache, but the search hasn't
become
any
faster, taking almost 9 sec on avg :(
name: search
class: org.apache.solr.handler.component.SearchHandler
version: $Revision: 1052938 $
description: Search using components:
org.apache.solr.handler.component.QueryComponent,org.apache.solr.handler.component.FacetComponent,org.apache.solr.handler.component.MoreLikeThisComponent,org.apache.solr.handler.component.HighlightComponent,org.apache.solr.handler.component.StatsComponent,org.apache.solr.handler.component.DebugComponent,
stats: handlerStart : 1323255147351
requests : 100
errors : 3
timeouts : 0
totalTime : 885438
avgTimePerRequest : 8854.38
avgRequestsPerSecond : 0.008789442
the stats (copying fieldValueCache as well here, to show term
statistics):
name: fieldValueCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=1, initialSize=10,
minSize=9000, acceptableSize=9500, cleanupThread=false)
stats: lookups : 79
hits : 77
hitratio : 0.97
inserts : 1
evictions : 0
size : 1
warmupTime : 0
cumulative_lookups : 79
cumulative_hits : 77
cumulative_hitratio : 0.97
cumulative_inserts : 1
cumulative_evictions : 0
item_shingleContent_trigram :
{field=shingleContent_trigram,memSize=326924381,tindexSize=4765394,time=215426,phase1=213868,nTerms=14827061,bigTerms=35,termInstances=114359167,uses=78}
name: filterCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=153600, initialSize=4096,
minSize=138240, acceptableSize=145920, cleanupThread=false)
stats: lookups : 1082854
hits : 940370
hitratio : 0.86
inserts : 142486
evictions : 0
size : 142486
warmupTime : 0
cumulative_lookups : 1082854
cumulative_hits : 940370
cumulative_hitratio : 0.86
cumulative_inserts : 142486
cumulative_evictions : 0
index size: 3,25 GB
Does anyone have some pointers to where to look at and optimize for
query
time?
2011/12/7 Tomás Fernández Löbbe tomasflo...@gmail.com
Hi Dimitry, cache information is exposed via JMX, so you should be
able
to
monitor that information with any JMX tool. See
http://wiki.apache.org/solr/SolrJmx
On Wed, Dec 7, 2011 at 6:19 AM, Dmitry Kan dmitry@gmail.com
wrote:
Yes, we do require that much.
Ok, thanks, I will try increasing the maxsize.
On Wed, Dec 7, 2011 at 10:56 AM, pravesh suyalprav...@yahoo.com
wrote:
facet.limit=50
your facet.limit seems too high. Do you actually require this
much?
Since there a lot of evictions from filtercache, so, increase the
maxsize
value to your acceptable limit.
Regards
Pravesh
--
View this message in context:
http://lucene.472066.n3.nabble.com/cache-monitoring-tools-tp3566645p3566811.html
Sent from the Solr - User mailing list archive
Re: cache monitoring tools?
, pravesh suyalprav...@yahoo.com wrote: facet.limit=50 your facet.limit seems too high. Do you actually require this much? Since there a lot of evictions from filtercache, so, increase the maxsize value to your acceptable limit. Regards Pravesh -- View this message in context: http://lucene.472066.n3.nabble.com/cache-monitoring-tools-tp3566645p3566811.html Sent from the Solr - User mailing list archive at Nabble.com. -- Regards, Dmitry Kan -- Regards, Dmitry Kan -- Regards, Dmitry Kan -- Regards, Dmitry Kan
Re: cache monitoring tools?
At my work, we use Munin and Nagio for monitoring and alerts. Munin is
great because writing a plugin for it so simple, and with Solr's
statistics handler, we can track almost any solr stat we want. It also
comes with included plugins for load, file system stats, processes,
etc.
http://munin-monitoring.org/
Justin
Paul Libbrecht p...@hoplahup.net writes:
Allow me to chim in and ask a generic question about monitoring tools
for people close to developers: are any of the tools mentioned in this
thread actually able to show graphs of loads, e.g. cache counts or CPU
load, in parallel to a console log or to an http request log??
I am working on such a tool currently but I have a bad feeling of reinventing
the wheel.
thanks in advance
Paul
Le 8 déc. 2011 à 08:53, Dmitry Kan a écrit :
Otis, Tomás: thanks for the great links!
2011/12/7 Tomás Fernández Löbbe tomasflo...@gmail.com
Hi Dimitry, I pointed to the wiki page to enable JMX, then you can use any
tool that visualizes JMX stuff like Zabbix. See
http://www.lucidimagination.com/blog/2011/10/02/monitoring-apache-solr-and-lucidworks-with-zabbix/
On Wed, Dec 7, 2011 at 11:49 AM, Dmitry Kan dmitry@gmail.com wrote:
The culprit seems to be the merger (frontend) SOLR. Talking to one shard
directly takes substantially less time (1-2 sec).
On Wed, Dec 7, 2011 at 4:10 PM, Dmitry Kan dmitry@gmail.com wrote:
Tomás: thanks. The page you gave didn't mention cache specifically, is
there more documentation on this specifically? I have used solrmeter
tool,
it draws the cache diagrams, is there a similar tool, but which would
use
jmx directly and present the cache usage in runtime?
pravesh:
I have increased the size of filterCache, but the search hasn't become
any
faster, taking almost 9 sec on avg :(
name: search
class: org.apache.solr.handler.component.SearchHandler
version: $Revision: 1052938 $
description: Search using components:
org.apache.solr.handler.component.QueryComponent,org.apache.solr.handler.component.FacetComponent,org.apache.solr.handler.component.MoreLikeThisComponent,org.apache.solr.handler.component.HighlightComponent,org.apache.solr.handler.component.StatsComponent,org.apache.solr.handler.component.DebugComponent,
stats: handlerStart : 1323255147351
requests : 100
errors : 3
timeouts : 0
totalTime : 885438
avgTimePerRequest : 8854.38
avgRequestsPerSecond : 0.008789442
the stats (copying fieldValueCache as well here, to show term
statistics):
name: fieldValueCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=1, initialSize=10,
minSize=9000, acceptableSize=9500, cleanupThread=false)
stats: lookups : 79
hits : 77
hitratio : 0.97
inserts : 1
evictions : 0
size : 1
warmupTime : 0
cumulative_lookups : 79
cumulative_hits : 77
cumulative_hitratio : 0.97
cumulative_inserts : 1
cumulative_evictions : 0
item_shingleContent_trigram :
{field=shingleContent_trigram,memSize=326924381,tindexSize=4765394,time=215426,phase1=213868,nTerms=14827061,bigTerms=35,termInstances=114359167,uses=78}
name: filterCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=153600, initialSize=4096,
minSize=138240, acceptableSize=145920, cleanupThread=false)
stats: lookups : 1082854
hits : 940370
hitratio : 0.86
inserts : 142486
evictions : 0
size : 142486
warmupTime : 0
cumulative_lookups : 1082854
cumulative_hits : 940370
cumulative_hitratio : 0.86
cumulative_inserts : 142486
cumulative_evictions : 0
index size: 3,25 GB
Does anyone have some pointers to where to look at and optimize for
query
time?
2011/12/7 Tomás Fernández Löbbe tomasflo...@gmail.com
Hi Dimitry, cache information is exposed via JMX, so you should be
able
to
monitor that information with any JMX tool. See
http://wiki.apache.org/solr/SolrJmx
On Wed, Dec 7, 2011 at 6:19 AM, Dmitry Kan dmitry@gmail.com
wrote:
Yes, we do require that much.
Ok, thanks, I will try increasing the maxsize.
On Wed, Dec 7, 2011 at 10:56 AM, pravesh suyalprav...@yahoo.com
wrote:
facet.limit=50
your facet.limit seems too high. Do you actually require this
much?
Since there a lot of evictions from filtercache, so, increase the
maxsize
value to your acceptable limit.
Regards
Pravesh
--
View this message in context:
http://lucene.472066.n3.nabble.com/cache-monitoring-tools-tp3566645p3566811.html
Sent from the Solr - User mailing list archive at Nabble.com.
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
Re: cache monitoring tools?
Justin,
I am not sure this answers the question: is there a graph view (of some
measurements) which can be synched to one or several logs? I'd like to click on
a spike of CPU to see the log around the time of that spike.
Does munin or any other do that?
paul
Le 11 déc. 2011 à 17:39, Justin Caratzas a écrit :
At my work, we use Munin and Nagio for monitoring and alerts. Munin is
great because writing a plugin for it so simple, and with Solr's
statistics handler, we can track almost any solr stat we want. It also
comes with included plugins for load, file system stats, processes,
etc.
http://munin-monitoring.org/
Justin
Paul Libbrecht p...@hoplahup.net writes:
Allow me to chim in and ask a generic question about monitoring tools
for people close to developers: are any of the tools mentioned in this
thread actually able to show graphs of loads, e.g. cache counts or CPU
load, in parallel to a console log or to an http request log??
I am working on such a tool currently but I have a bad feeling of
reinventing the wheel.
thanks in advance
Paul
Le 8 déc. 2011 à 08:53, Dmitry Kan a écrit :
Otis, Tomás: thanks for the great links!
2011/12/7 Tomás Fernández Löbbe tomasflo...@gmail.com
Hi Dimitry, I pointed to the wiki page to enable JMX, then you can use any
tool that visualizes JMX stuff like Zabbix. See
http://www.lucidimagination.com/blog/2011/10/02/monitoring-apache-solr-and-lucidworks-with-zabbix/
On Wed, Dec 7, 2011 at 11:49 AM, Dmitry Kan dmitry@gmail.com wrote:
The culprit seems to be the merger (frontend) SOLR. Talking to one shard
directly takes substantially less time (1-2 sec).
On Wed, Dec 7, 2011 at 4:10 PM, Dmitry Kan dmitry@gmail.com wrote:
Tomás: thanks. The page you gave didn't mention cache specifically, is
there more documentation on this specifically? I have used solrmeter
tool,
it draws the cache diagrams, is there a similar tool, but which would
use
jmx directly and present the cache usage in runtime?
pravesh:
I have increased the size of filterCache, but the search hasn't become
any
faster, taking almost 9 sec on avg :(
name: search
class: org.apache.solr.handler.component.SearchHandler
version: $Revision: 1052938 $
description: Search using components:
org.apache.solr.handler.component.QueryComponent,org.apache.solr.handler.component.FacetComponent,org.apache.solr.handler.component.MoreLikeThisComponent,org.apache.solr.handler.component.HighlightComponent,org.apache.solr.handler.component.StatsComponent,org.apache.solr.handler.component.DebugComponent,
stats: handlerStart : 1323255147351
requests : 100
errors : 3
timeouts : 0
totalTime : 885438
avgTimePerRequest : 8854.38
avgRequestsPerSecond : 0.008789442
the stats (copying fieldValueCache as well here, to show term
statistics):
name: fieldValueCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=1, initialSize=10,
minSize=9000, acceptableSize=9500, cleanupThread=false)
stats: lookups : 79
hits : 77
hitratio : 0.97
inserts : 1
evictions : 0
size : 1
warmupTime : 0
cumulative_lookups : 79
cumulative_hits : 77
cumulative_hitratio : 0.97
cumulative_inserts : 1
cumulative_evictions : 0
item_shingleContent_trigram :
{field=shingleContent_trigram,memSize=326924381,tindexSize=4765394,time=215426,phase1=213868,nTerms=14827061,bigTerms=35,termInstances=114359167,uses=78}
name: filterCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=153600, initialSize=4096,
minSize=138240, acceptableSize=145920, cleanupThread=false)
stats: lookups : 1082854
hits : 940370
hitratio : 0.86
inserts : 142486
evictions : 0
size : 142486
warmupTime : 0
cumulative_lookups : 1082854
cumulative_hits : 940370
cumulative_hitratio : 0.86
cumulative_inserts : 142486
cumulative_evictions : 0
index size: 3,25 GB
Does anyone have some pointers to where to look at and optimize for
query
time?
2011/12/7 Tomás Fernández Löbbe tomasflo...@gmail.com
Hi Dimitry, cache information is exposed via JMX, so you should be
able
to
monitor that information with any JMX tool. See
http://wiki.apache.org/solr/SolrJmx
On Wed, Dec 7, 2011 at 6:19 AM, Dmitry Kan dmitry@gmail.com
wrote:
Yes, we do require that much.
Ok, thanks, I will try increasing the maxsize.
On Wed, Dec 7, 2011 at 10:56 AM, pravesh suyalprav...@yahoo.com
wrote:
facet.limit=50
your facet.limit seems too high. Do you actually require this
much?
Since there a lot of evictions from filtercache, so, increase the
maxsize
value to your acceptable limit.
Regards
Pravesh
--
View this message in context:
http://lucene.472066.n3.nabble.com/cache-monitoring-tools-tp3566645p3566811.html
Sent from the Solr - User mailing list archive at Nabble.com.
--
Regards,
Dmitry Kan
--
Regards
Re: cache monitoring tools?
: The culprit seems to be the merger (frontend) SOLR. Talking to one shard : directly takes substantially less time (1-2 sec). ... :facet.limit=50 Your probably most likeley has very little to do with your caches at all -- a facet.limit that high requires sending a very large amount of data over the wire, multiplied by the number of shards, multipled by some constant (i think it's 2 but it might be higher) in order to over request facet constriant counts from each shard to aggregate them. the dominant factor in the slow speed you are seeing is most likeley Network IO between the shards. -Hoss
Re: cache monitoring tools?
Allow me to chim in and ask a generic question about monitoring tools for
people close to developers: are any of the tools mentioned in this thread
actually able to show graphs of loads, e.g. cache counts or CPU load, in
parallel to a console log or to an http request log??
I am working on such a tool currently but I have a bad feeling of reinventing
the wheel.
thanks in advance
Paul
Le 8 déc. 2011 à 08:53, Dmitry Kan a écrit :
Otis, Tomás: thanks for the great links!
2011/12/7 Tomás Fernández Löbbe tomasflo...@gmail.com
Hi Dimitry, I pointed to the wiki page to enable JMX, then you can use any
tool that visualizes JMX stuff like Zabbix. See
http://www.lucidimagination.com/blog/2011/10/02/monitoring-apache-solr-and-lucidworks-with-zabbix/
On Wed, Dec 7, 2011 at 11:49 AM, Dmitry Kan dmitry@gmail.com wrote:
The culprit seems to be the merger (frontend) SOLR. Talking to one shard
directly takes substantially less time (1-2 sec).
On Wed, Dec 7, 2011 at 4:10 PM, Dmitry Kan dmitry@gmail.com wrote:
Tomás: thanks. The page you gave didn't mention cache specifically, is
there more documentation on this specifically? I have used solrmeter
tool,
it draws the cache diagrams, is there a similar tool, but which would
use
jmx directly and present the cache usage in runtime?
pravesh:
I have increased the size of filterCache, but the search hasn't become
any
faster, taking almost 9 sec on avg :(
name: search
class: org.apache.solr.handler.component.SearchHandler
version: $Revision: 1052938 $
description: Search using components:
org.apache.solr.handler.component.QueryComponent,org.apache.solr.handler.component.FacetComponent,org.apache.solr.handler.component.MoreLikeThisComponent,org.apache.solr.handler.component.HighlightComponent,org.apache.solr.handler.component.StatsComponent,org.apache.solr.handler.component.DebugComponent,
stats: handlerStart : 1323255147351
requests : 100
errors : 3
timeouts : 0
totalTime : 885438
avgTimePerRequest : 8854.38
avgRequestsPerSecond : 0.008789442
the stats (copying fieldValueCache as well here, to show term
statistics):
name: fieldValueCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=1, initialSize=10,
minSize=9000, acceptableSize=9500, cleanupThread=false)
stats: lookups : 79
hits : 77
hitratio : 0.97
inserts : 1
evictions : 0
size : 1
warmupTime : 0
cumulative_lookups : 79
cumulative_hits : 77
cumulative_hitratio : 0.97
cumulative_inserts : 1
cumulative_evictions : 0
item_shingleContent_trigram :
{field=shingleContent_trigram,memSize=326924381,tindexSize=4765394,time=215426,phase1=213868,nTerms=14827061,bigTerms=35,termInstances=114359167,uses=78}
name: filterCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=153600, initialSize=4096,
minSize=138240, acceptableSize=145920, cleanupThread=false)
stats: lookups : 1082854
hits : 940370
hitratio : 0.86
inserts : 142486
evictions : 0
size : 142486
warmupTime : 0
cumulative_lookups : 1082854
cumulative_hits : 940370
cumulative_hitratio : 0.86
cumulative_inserts : 142486
cumulative_evictions : 0
index size: 3,25 GB
Does anyone have some pointers to where to look at and optimize for
query
time?
2011/12/7 Tomás Fernández Löbbe tomasflo...@gmail.com
Hi Dimitry, cache information is exposed via JMX, so you should be
able
to
monitor that information with any JMX tool. See
http://wiki.apache.org/solr/SolrJmx
On Wed, Dec 7, 2011 at 6:19 AM, Dmitry Kan dmitry@gmail.com
wrote:
Yes, we do require that much.
Ok, thanks, I will try increasing the maxsize.
On Wed, Dec 7, 2011 at 10:56 AM, pravesh suyalprav...@yahoo.com
wrote:
facet.limit=50
your facet.limit seems too high. Do you actually require this
much?
Since there a lot of evictions from filtercache, so, increase the
maxsize
value to your acceptable limit.
Regards
Pravesh
--
View this message in context:
http://lucene.472066.n3.nabble.com/cache-monitoring-tools-tp3566645p3566811.html
Sent from the Solr - User mailing list archive at Nabble.com.
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
Re: cache monitoring tools?
Hi Otis,
I can't find the download for the free SPM.
What Hardware and OS do I need for installing SPM to monitor my servers?
Regards
Bernd
Am 07.12.2011 18:47, schrieb Otis Gospodnetic:
Hi Dmitry,
You should use SPM for Solr - it exposes all Solr metrics and more (JVM, system
info, etc.)
PLUS it's currently 100% free.
http://sematext.com/spm/solr-performance-monitoring/index.html
We use it with our clients on a regular basis and it helps us a TON - we just
helped a very popular mobile app company improve Solr performance by a few
orders of magnitude (including filter tuning) with the help of SPM.
Otis
Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/
From: Dmitry Kandmitry@gmail.com
To: solr-user@lucene.apache.org
Sent: Wednesday, December 7, 2011 2:13 AM
Subject: cache monitoring tools?
Hello list,
We've noticed quite huge strain on the filterCache in facet queries against
trigram fields (see schema in the end of this e-mail). The typical query
contains some keywords in the q parameter and boolean filter query on other
solr fields. It is also facet query, the facet field is of
type shingle_text_trigram (see schema) and facet.limit=50.
Questions: are there some tools (except for solrmeter) and/or approaches to
monitor / profile the load on caches, which would help to derive better
tuning parameters?
Can you recommend checking config parameters of other components but caches?
BTW, this has become much faster compared to solr 1.4 where we had to a lot
of optimizations on schema level (e.g. by making a number of stored fields
non-stored)
Here are the relevant stats from admin (SOLR 3.4):
description: Concurrent LRU Cache(maxSize=1, initialSize=10,
minSize=9000, acceptableSize=9500, cleanupThread=false)
stats: lookups : 93
hits : 90
hitratio : 0.96
inserts : 1
evictions : 0
size : 1
warmupTime : 0
cumulative_lookups : 93
cumulative_hits : 90
cumulative_hitratio : 0.96
cumulative_inserts : 1
cumulative_evictions : 0
item_shingleContent_trigram :
{field=shingleContent_trigram,memSize=326924381,tindexSize=4765394,time=222924,phase1=221106,nTerms=14827061,bigTerms=35,termInstances=114359167,uses=91}
name: filterCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=512, initialSize=512,
minSize=460, acceptableSize=486, cleanupThread=false)
stats: lookups : 1003486
hits : 2809
hitratio : 0.00
inserts : 1000694
evictions : 1000221
size : 473
warmupTime : 0
cumulative_lookups : 1003486
cumulative_hits : 2809
cumulative_hitratio : 0.00
cumulative_inserts : 1000694
cumulative_evictions : 1000221
schema excerpt:
fieldType name=shingle_text_trigram class=solr.TextField
positionIncrementGap=100
analyzer
tokenizer class=solr.StandardTokenizerFactory/
filter class=solr.LowerCaseFilterFactory/
filter class=solr.ShingleFilterFactory maxShingleSize=3
outputUnigrams=true/
/analyzer
/fieldType
--
Regards,
Dmitry Kan
Re: cache monitoring tools?
Hi Bernd,
Check this:
SPM for Solr is the enterprise-class, cloud-based, System/OS and Solr
Performance Monitoring SaaS.
So it's a SaaS - you simply sign up for it. During the signup you'll get to
download a small agent that works on RedHat, CentOS, Debian, Ubuntu, and maybe
other OSes.
If you have any more SPM questions, it may be best to email me directly. For
example, if you are only interested in SPM if it runs in your datacenter,
please let me know.
Otis
Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/
From: Bernd Fehling bernd.fehl...@uni-bielefeld.de
To: solr-user@lucene.apache.org
Sent: Thursday, December 8, 2011 4:04 AM
Subject: Re: cache monitoring tools?
Hi Otis,
I can't find the download for the free SPM.
What Hardware and OS do I need for installing SPM to monitor my servers?
Regards
Bernd
Am 07.12.2011 18:47, schrieb Otis Gospodnetic:
Hi Dmitry,
You should use SPM for Solr - it exposes all Solr metrics and more (JVM,
system info, etc.)
PLUS it's currently 100% free.
http://sematext.com/spm/solr-performance-monitoring/index.html
We use it with our clients on a regular basis and it helps us a TON - we
just helped a very popular mobile app company improve Solr performance by a
few orders of magnitude (including filter tuning) with the help of SPM.
Otis
Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/
From: Dmitry Kandmitry@gmail.com
To: solr-user@lucene.apache.org
Sent: Wednesday, December 7, 2011 2:13 AM
Subject: cache monitoring tools?
Hello list,
We've noticed quite huge strain on the filterCache in facet queries against
trigram fields (see schema in the end of this e-mail). The typical query
contains some keywords in the q parameter and boolean filter query on other
solr fields. It is also facet query, the facet field is of
type shingle_text_trigram (see schema) and facet.limit=50.
Questions: are there some tools (except for solrmeter) and/or approaches to
monitor / profile the load on caches, which would help to derive better
tuning parameters?
Can you recommend checking config parameters of other components but caches?
BTW, this has become much faster compared to solr 1.4 where we had to a lot
of optimizations on schema level (e.g. by making a number of stored fields
non-stored)
Here are the relevant stats from admin (SOLR 3.4):
description: Concurrent LRU Cache(maxSize=1, initialSize=10,
minSize=9000, acceptableSize=9500, cleanupThread=false)
stats: lookups : 93
hits : 90
hitratio : 0.96
inserts : 1
evictions : 0
size : 1
warmupTime : 0
cumulative_lookups : 93
cumulative_hits : 90
cumulative_hitratio : 0.96
cumulative_inserts : 1
cumulative_evictions : 0
item_shingleContent_trigram :
{field=shingleContent_trigram,memSize=326924381,tindexSize=4765394,time=222924,phase1=221106,nTerms=14827061,bigTerms=35,termInstances=114359167,uses=91}
name: filterCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=512, initialSize=512,
minSize=460, acceptableSize=486, cleanupThread=false)
stats: lookups : 1003486
hits : 2809
hitratio : 0.00
inserts : 1000694
evictions : 1000221
size : 473
warmupTime : 0
cumulative_lookups : 1003486
cumulative_hits : 2809
cumulative_hitratio : 0.00
cumulative_inserts : 1000694
cumulative_evictions : 1000221
schema excerpt:
fieldType name=shingle_text_trigram class=solr.TextField
positionIncrementGap=100
analyzer
tokenizer class=solr.StandardTokenizerFactory/
filter class=solr.LowerCaseFilterFactory/
filter class=solr.ShingleFilterFactory maxShingleSize=3
outputUnigrams=true/
/analyzer
/fieldType
--
Regards,
Dmitry Kan
Re: cache monitoring tools?
facet.limit=50 your facet.limit seems too high. Do you actually require this much? Since there a lot of evictions from filtercache, so, increase the maxsize value to your acceptable limit. Regards Pravesh -- View this message in context: http://lucene.472066.n3.nabble.com/cache-monitoring-tools-tp3566645p3566811.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: cache monitoring tools?
Yes, we do require that much. Ok, thanks, I will try increasing the maxsize. On Wed, Dec 7, 2011 at 10:56 AM, pravesh suyalprav...@yahoo.com wrote: facet.limit=50 your facet.limit seems too high. Do you actually require this much? Since there a lot of evictions from filtercache, so, increase the maxsize value to your acceptable limit. Regards Pravesh -- View this message in context: http://lucene.472066.n3.nabble.com/cache-monitoring-tools-tp3566645p3566811.html Sent from the Solr - User mailing list archive at Nabble.com. -- Regards, Dmitry Kan
Re: cache monitoring tools?
Hi Dimitry, cache information is exposed via JMX, so you should be able to monitor that information with any JMX tool. See http://wiki.apache.org/solr/SolrJmx On Wed, Dec 7, 2011 at 6:19 AM, Dmitry Kan dmitry@gmail.com wrote: Yes, we do require that much. Ok, thanks, I will try increasing the maxsize. On Wed, Dec 7, 2011 at 10:56 AM, pravesh suyalprav...@yahoo.com wrote: facet.limit=50 your facet.limit seems too high. Do you actually require this much? Since there a lot of evictions from filtercache, so, increase the maxsize value to your acceptable limit. Regards Pravesh -- View this message in context: http://lucene.472066.n3.nabble.com/cache-monitoring-tools-tp3566645p3566811.html Sent from the Solr - User mailing list archive at Nabble.com. -- Regards, Dmitry Kan
Re: cache monitoring tools?
Tomás: thanks. The page you gave didn't mention cache specifically, is
there more documentation on this specifically? I have used solrmeter tool,
it draws the cache diagrams, is there a similar tool, but which would use
jmx directly and present the cache usage in runtime?
pravesh:
I have increased the size of filterCache, but the search hasn't become any
faster, taking almost 9 sec on avg :(
name: search
class: org.apache.solr.handler.component.SearchHandler
version: $Revision: 1052938 $
description: Search using components:
org.apache.solr.handler.component.QueryComponent,org.apache.solr.handler.component.FacetComponent,org.apache.solr.handler.component.MoreLikeThisComponent,org.apache.solr.handler.component.HighlightComponent,org.apache.solr.handler.component.StatsComponent,org.apache.solr.handler.component.DebugComponent,
stats: handlerStart : 1323255147351
requests : 100
errors : 3
timeouts : 0
totalTime : 885438
avgTimePerRequest : 8854.38
avgRequestsPerSecond : 0.008789442
the stats (copying fieldValueCache as well here, to show term statistics):
name: fieldValueCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=1, initialSize=10,
minSize=9000, acceptableSize=9500, cleanupThread=false)
stats: lookups : 79
hits : 77
hitratio : 0.97
inserts : 1
evictions : 0
size : 1
warmupTime : 0
cumulative_lookups : 79
cumulative_hits : 77
cumulative_hitratio : 0.97
cumulative_inserts : 1
cumulative_evictions : 0
item_shingleContent_trigram :
{field=shingleContent_trigram,memSize=326924381,tindexSize=4765394,time=215426,phase1=213868,nTerms=14827061,bigTerms=35,termInstances=114359167,uses=78}
name: filterCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=153600, initialSize=4096,
minSize=138240, acceptableSize=145920, cleanupThread=false)
stats: lookups : 1082854
hits : 940370
hitratio : 0.86
inserts : 142486
evictions : 0
size : 142486
warmupTime : 0
cumulative_lookups : 1082854
cumulative_hits : 940370
cumulative_hitratio : 0.86
cumulative_inserts : 142486
cumulative_evictions : 0
index size: 3,25 GB
Does anyone have some pointers to where to look at and optimize for query
time?
2011/12/7 Tomás Fernández Löbbe tomasflo...@gmail.com
Hi Dimitry, cache information is exposed via JMX, so you should be able to
monitor that information with any JMX tool. See
http://wiki.apache.org/solr/SolrJmx
On Wed, Dec 7, 2011 at 6:19 AM, Dmitry Kan dmitry@gmail.com wrote:
Yes, we do require that much.
Ok, thanks, I will try increasing the maxsize.
On Wed, Dec 7, 2011 at 10:56 AM, pravesh suyalprav...@yahoo.com wrote:
facet.limit=50
your facet.limit seems too high. Do you actually require this much?
Since there a lot of evictions from filtercache, so, increase the
maxsize
value to your acceptable limit.
Regards
Pravesh
--
View this message in context:
http://lucene.472066.n3.nabble.com/cache-monitoring-tools-tp3566645p3566811.html
Sent from the Solr - User mailing list archive at Nabble.com.
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
Re: cache monitoring tools?
The culprit seems to be the merger (frontend) SOLR. Talking to one shard
directly takes substantially less time (1-2 sec).
On Wed, Dec 7, 2011 at 4:10 PM, Dmitry Kan dmitry@gmail.com wrote:
Tomás: thanks. The page you gave didn't mention cache specifically, is
there more documentation on this specifically? I have used solrmeter tool,
it draws the cache diagrams, is there a similar tool, but which would use
jmx directly and present the cache usage in runtime?
pravesh:
I have increased the size of filterCache, but the search hasn't become any
faster, taking almost 9 sec on avg :(
name: search
class: org.apache.solr.handler.component.SearchHandler
version: $Revision: 1052938 $
description: Search using components:
org.apache.solr.handler.component.QueryComponent,org.apache.solr.handler.component.FacetComponent,org.apache.solr.handler.component.MoreLikeThisComponent,org.apache.solr.handler.component.HighlightComponent,org.apache.solr.handler.component.StatsComponent,org.apache.solr.handler.component.DebugComponent,
stats: handlerStart : 1323255147351
requests : 100
errors : 3
timeouts : 0
totalTime : 885438
avgTimePerRequest : 8854.38
avgRequestsPerSecond : 0.008789442
the stats (copying fieldValueCache as well here, to show term statistics):
name: fieldValueCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=1, initialSize=10,
minSize=9000, acceptableSize=9500, cleanupThread=false)
stats: lookups : 79
hits : 77
hitratio : 0.97
inserts : 1
evictions : 0
size : 1
warmupTime : 0
cumulative_lookups : 79
cumulative_hits : 77
cumulative_hitratio : 0.97
cumulative_inserts : 1
cumulative_evictions : 0
item_shingleContent_trigram :
{field=shingleContent_trigram,memSize=326924381,tindexSize=4765394,time=215426,phase1=213868,nTerms=14827061,bigTerms=35,termInstances=114359167,uses=78}
name: filterCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=153600, initialSize=4096,
minSize=138240, acceptableSize=145920, cleanupThread=false)
stats: lookups : 1082854
hits : 940370
hitratio : 0.86
inserts : 142486
evictions : 0
size : 142486
warmupTime : 0
cumulative_lookups : 1082854
cumulative_hits : 940370
cumulative_hitratio : 0.86
cumulative_inserts : 142486
cumulative_evictions : 0
index size: 3,25 GB
Does anyone have some pointers to where to look at and optimize for query
time?
2011/12/7 Tomás Fernández Löbbe tomasflo...@gmail.com
Hi Dimitry, cache information is exposed via JMX, so you should be able to
monitor that information with any JMX tool. See
http://wiki.apache.org/solr/SolrJmx
On Wed, Dec 7, 2011 at 6:19 AM, Dmitry Kan dmitry@gmail.com wrote:
Yes, we do require that much.
Ok, thanks, I will try increasing the maxsize.
On Wed, Dec 7, 2011 at 10:56 AM, pravesh suyalprav...@yahoo.com
wrote:
facet.limit=50
your facet.limit seems too high. Do you actually require this much?
Since there a lot of evictions from filtercache, so, increase the
maxsize
value to your acceptable limit.
Regards
Pravesh
--
View this message in context:
http://lucene.472066.n3.nabble.com/cache-monitoring-tools-tp3566645p3566811.html
Sent from the Solr - User mailing list archive at Nabble.com.
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
Re: cache monitoring tools?
Hi Dmitry,
You should use SPM for Solr - it exposes all Solr metrics and more (JVM, system
info, etc.)
PLUS it's currently 100% free.
http://sematext.com/spm/solr-performance-monitoring/index.html
We use it with our clients on a regular basis and it helps us a TON - we just
helped a very popular mobile app company improve Solr performance by a few
orders of magnitude (including filter tuning) with the help of SPM.
Otis
Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/
From: Dmitry Kan dmitry@gmail.com
To: solr-user@lucene.apache.org
Sent: Wednesday, December 7, 2011 2:13 AM
Subject: cache monitoring tools?
Hello list,
We've noticed quite huge strain on the filterCache in facet queries against
trigram fields (see schema in the end of this e-mail). The typical query
contains some keywords in the q parameter and boolean filter query on other
solr fields. It is also facet query, the facet field is of
type shingle_text_trigram (see schema) and facet.limit=50.
Questions: are there some tools (except for solrmeter) and/or approaches to
monitor / profile the load on caches, which would help to derive better
tuning parameters?
Can you recommend checking config parameters of other components but caches?
BTW, this has become much faster compared to solr 1.4 where we had to a lot
of optimizations on schema level (e.g. by making a number of stored fields
non-stored)
Here are the relevant stats from admin (SOLR 3.4):
description: Concurrent LRU Cache(maxSize=1, initialSize=10,
minSize=9000, acceptableSize=9500, cleanupThread=false)
stats: lookups : 93
hits : 90
hitratio : 0.96
inserts : 1
evictions : 0
size : 1
warmupTime : 0
cumulative_lookups : 93
cumulative_hits : 90
cumulative_hitratio : 0.96
cumulative_inserts : 1
cumulative_evictions : 0
item_shingleContent_trigram :
{field=shingleContent_trigram,memSize=326924381,tindexSize=4765394,time=222924,phase1=221106,nTerms=14827061,bigTerms=35,termInstances=114359167,uses=91}
name: filterCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=512, initialSize=512,
minSize=460, acceptableSize=486, cleanupThread=false)
stats: lookups : 1003486
hits : 2809
hitratio : 0.00
inserts : 1000694
evictions : 1000221
size : 473
warmupTime : 0
cumulative_lookups : 1003486
cumulative_hits : 2809
cumulative_hitratio : 0.00
cumulative_inserts : 1000694
cumulative_evictions : 1000221
schema excerpt:
fieldType name=shingle_text_trigram class=solr.TextField
positionIncrementGap=100
analyzer
tokenizer class=solr.StandardTokenizerFactory/
filter class=solr.LowerCaseFilterFactory/
filter class=solr.ShingleFilterFactory maxShingleSize=3
outputUnigrams=true/
/analyzer
/fieldType
--
Regards,
Dmitry Kan
Re: cache monitoring tools?
Hi Dimitry, I pointed to the wiki page to enable JMX, then you can use any
tool that visualizes JMX stuff like Zabbix. See
http://www.lucidimagination.com/blog/2011/10/02/monitoring-apache-solr-and-lucidworks-with-zabbix/
On Wed, Dec 7, 2011 at 11:49 AM, Dmitry Kan dmitry@gmail.com wrote:
The culprit seems to be the merger (frontend) SOLR. Talking to one shard
directly takes substantially less time (1-2 sec).
On Wed, Dec 7, 2011 at 4:10 PM, Dmitry Kan dmitry@gmail.com wrote:
Tomás: thanks. The page you gave didn't mention cache specifically, is
there more documentation on this specifically? I have used solrmeter
tool,
it draws the cache diagrams, is there a similar tool, but which would use
jmx directly and present the cache usage in runtime?
pravesh:
I have increased the size of filterCache, but the search hasn't become
any
faster, taking almost 9 sec on avg :(
name: search
class: org.apache.solr.handler.component.SearchHandler
version: $Revision: 1052938 $
description: Search using components:
org.apache.solr.handler.component.QueryComponent,org.apache.solr.handler.component.FacetComponent,org.apache.solr.handler.component.MoreLikeThisComponent,org.apache.solr.handler.component.HighlightComponent,org.apache.solr.handler.component.StatsComponent,org.apache.solr.handler.component.DebugComponent,
stats: handlerStart : 1323255147351
requests : 100
errors : 3
timeouts : 0
totalTime : 885438
avgTimePerRequest : 8854.38
avgRequestsPerSecond : 0.008789442
the stats (copying fieldValueCache as well here, to show term
statistics):
name: fieldValueCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=1, initialSize=10,
minSize=9000, acceptableSize=9500, cleanupThread=false)
stats: lookups : 79
hits : 77
hitratio : 0.97
inserts : 1
evictions : 0
size : 1
warmupTime : 0
cumulative_lookups : 79
cumulative_hits : 77
cumulative_hitratio : 0.97
cumulative_inserts : 1
cumulative_evictions : 0
item_shingleContent_trigram :
{field=shingleContent_trigram,memSize=326924381,tindexSize=4765394,time=215426,phase1=213868,nTerms=14827061,bigTerms=35,termInstances=114359167,uses=78}
name: filterCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=153600, initialSize=4096,
minSize=138240, acceptableSize=145920, cleanupThread=false)
stats: lookups : 1082854
hits : 940370
hitratio : 0.86
inserts : 142486
evictions : 0
size : 142486
warmupTime : 0
cumulative_lookups : 1082854
cumulative_hits : 940370
cumulative_hitratio : 0.86
cumulative_inserts : 142486
cumulative_evictions : 0
index size: 3,25 GB
Does anyone have some pointers to where to look at and optimize for query
time?
2011/12/7 Tomás Fernández Löbbe tomasflo...@gmail.com
Hi Dimitry, cache information is exposed via JMX, so you should be able
to
monitor that information with any JMX tool. See
http://wiki.apache.org/solr/SolrJmx
On Wed, Dec 7, 2011 at 6:19 AM, Dmitry Kan dmitry@gmail.com
wrote:
Yes, we do require that much.
Ok, thanks, I will try increasing the maxsize.
On Wed, Dec 7, 2011 at 10:56 AM, pravesh suyalprav...@yahoo.com
wrote:
facet.limit=50
your facet.limit seems too high. Do you actually require this much?
Since there a lot of evictions from filtercache, so, increase the
maxsize
value to your acceptable limit.
Regards
Pravesh
--
View this message in context:
http://lucene.472066.n3.nabble.com/cache-monitoring-tools-tp3566645p3566811.html
Sent from the Solr - User mailing list archive at Nabble.com.
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
Re: cache monitoring tools?
Otis, Tomás: thanks for the great links!
2011/12/7 Tomás Fernández Löbbe tomasflo...@gmail.com
Hi Dimitry, I pointed to the wiki page to enable JMX, then you can use any
tool that visualizes JMX stuff like Zabbix. See
http://www.lucidimagination.com/blog/2011/10/02/monitoring-apache-solr-and-lucidworks-with-zabbix/
On Wed, Dec 7, 2011 at 11:49 AM, Dmitry Kan dmitry@gmail.com wrote:
The culprit seems to be the merger (frontend) SOLR. Talking to one shard
directly takes substantially less time (1-2 sec).
On Wed, Dec 7, 2011 at 4:10 PM, Dmitry Kan dmitry@gmail.com wrote:
Tomás: thanks. The page you gave didn't mention cache specifically, is
there more documentation on this specifically? I have used solrmeter
tool,
it draws the cache diagrams, is there a similar tool, but which would
use
jmx directly and present the cache usage in runtime?
pravesh:
I have increased the size of filterCache, but the search hasn't become
any
faster, taking almost 9 sec on avg :(
name: search
class: org.apache.solr.handler.component.SearchHandler
version: $Revision: 1052938 $
description: Search using components:
org.apache.solr.handler.component.QueryComponent,org.apache.solr.handler.component.FacetComponent,org.apache.solr.handler.component.MoreLikeThisComponent,org.apache.solr.handler.component.HighlightComponent,org.apache.solr.handler.component.StatsComponent,org.apache.solr.handler.component.DebugComponent,
stats: handlerStart : 1323255147351
requests : 100
errors : 3
timeouts : 0
totalTime : 885438
avgTimePerRequest : 8854.38
avgRequestsPerSecond : 0.008789442
the stats (copying fieldValueCache as well here, to show term
statistics):
name: fieldValueCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=1, initialSize=10,
minSize=9000, acceptableSize=9500, cleanupThread=false)
stats: lookups : 79
hits : 77
hitratio : 0.97
inserts : 1
evictions : 0
size : 1
warmupTime : 0
cumulative_lookups : 79
cumulative_hits : 77
cumulative_hitratio : 0.97
cumulative_inserts : 1
cumulative_evictions : 0
item_shingleContent_trigram :
{field=shingleContent_trigram,memSize=326924381,tindexSize=4765394,time=215426,phase1=213868,nTerms=14827061,bigTerms=35,termInstances=114359167,uses=78}
name: filterCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=153600, initialSize=4096,
minSize=138240, acceptableSize=145920, cleanupThread=false)
stats: lookups : 1082854
hits : 940370
hitratio : 0.86
inserts : 142486
evictions : 0
size : 142486
warmupTime : 0
cumulative_lookups : 1082854
cumulative_hits : 940370
cumulative_hitratio : 0.86
cumulative_inserts : 142486
cumulative_evictions : 0
index size: 3,25 GB
Does anyone have some pointers to where to look at and optimize for
query
time?
2011/12/7 Tomás Fernández Löbbe tomasflo...@gmail.com
Hi Dimitry, cache information is exposed via JMX, so you should be
able
to
monitor that information with any JMX tool. See
http://wiki.apache.org/solr/SolrJmx
On Wed, Dec 7, 2011 at 6:19 AM, Dmitry Kan dmitry@gmail.com
wrote:
Yes, we do require that much.
Ok, thanks, I will try increasing the maxsize.
On Wed, Dec 7, 2011 at 10:56 AM, pravesh suyalprav...@yahoo.com
wrote:
facet.limit=50
your facet.limit seems too high. Do you actually require this
much?
Since there a lot of evictions from filtercache, so, increase the
maxsize
value to your acceptable limit.
Regards
Pravesh
--
View this message in context:
http://lucene.472066.n3.nabble.com/cache-monitoring-tools-tp3566645p3566811.html
Sent from the Solr - User mailing list archive at Nabble.com.
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
--
Regards,
Dmitry Kan
cache monitoring tools?
Hello list,
We've noticed quite huge strain on the filterCache in facet queries against
trigram fields (see schema in the end of this e-mail). The typical query
contains some keywords in the q parameter and boolean filter query on other
solr fields. It is also facet query, the facet field is of
type shingle_text_trigram (see schema) and facet.limit=50.
Questions: are there some tools (except for solrmeter) and/or approaches to
monitor / profile the load on caches, which would help to derive better
tuning parameters?
Can you recommend checking config parameters of other components but caches?
BTW, this has become much faster compared to solr 1.4 where we had to a lot
of optimizations on schema level (e.g. by making a number of stored fields
non-stored)
Here are the relevant stats from admin (SOLR 3.4):
description: Concurrent LRU Cache(maxSize=1, initialSize=10,
minSize=9000, acceptableSize=9500, cleanupThread=false)
stats: lookups : 93
hits : 90
hitratio : 0.96
inserts : 1
evictions : 0
size : 1
warmupTime : 0
cumulative_lookups : 93
cumulative_hits : 90
cumulative_hitratio : 0.96
cumulative_inserts : 1
cumulative_evictions : 0
item_shingleContent_trigram :
{field=shingleContent_trigram,memSize=326924381,tindexSize=4765394,time=222924,phase1=221106,nTerms=14827061,bigTerms=35,termInstances=114359167,uses=91}
name: filterCache
class: org.apache.solr.search.FastLRUCache
version: 1.0
description: Concurrent LRU Cache(maxSize=512, initialSize=512,
minSize=460, acceptableSize=486, cleanupThread=false)
stats: lookups : 1003486
hits : 2809
hitratio : 0.00
inserts : 1000694
evictions : 1000221
size : 473
warmupTime : 0
cumulative_lookups : 1003486
cumulative_hits : 2809
cumulative_hitratio : 0.00
cumulative_inserts : 1000694
cumulative_evictions : 1000221
schema excerpt:
fieldType name=shingle_text_trigram class=solr.TextField
positionIncrementGap=100
analyzer
tokenizer class=solr.StandardTokenizerFactory/
filter class=solr.LowerCaseFilterFactory/
filter class=solr.ShingleFilterFactory maxShingleSize=3
outputUnigrams=true/
/analyzer
/fieldType
--
Regards,
Dmitry Kan
