Hi Otis, I can't find the download for the free SPM. What Hardware and OS do I need for installing SPM to monitor my servers?
Regards Bernd Am 07.12.2011 18:47, schrieb Otis Gospodnetic:
Hi Dmitry, You should use SPM for Solr - it exposes all Solr metrics and more (JVM, system info, etc.) PLUS it's currently 100% free. http://sematext.com/spm/solr-performance-monitoring/index.html We use it with our clients on a regular basis and it helps us a TON - we just helped a very popular mobile app company improve Solr performance by a few orders of magnitude (including filter tuning) with the help of SPM. Otis ---- Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/________________________________ From: Dmitry Kan<dmitry....@gmail.com> To: solr-user@lucene.apache.org Sent: Wednesday, December 7, 2011 2:13 AM Subject: cache monitoring tools? Hello list, We've noticed quite huge strain on the filterCache in facet queries against trigram fields (see schema in the end of this e-mail). The typical query contains some keywords in the q parameter and boolean filter query on other solr fields. It is also facet query, the facet field is of type shingle_text_trigram (see schema) and facet.limit=500000. Questions: are there some tools (except for solrmeter) and/or approaches to monitor / profile the load on caches, which would help to derive better tuning parameters? Can you recommend checking config parameters of other components but caches? BTW, this has become much faster compared to solr 1.4 where we had to a lot of optimizations on schema level (e.g. by making a number of stored fields non-stored) Here are the relevant stats from admin (SOLR 3.4): description: Concurrent LRU Cache(maxSize=10000, initialSize=10, minSize=9000, acceptableSize=9500, cleanupThread=false) stats: lookups : 93 hits : 90 hitratio : 0.96 inserts : 1 evictions : 0 size : 1 warmupTime : 0 cumulative_lookups : 93 cumulative_hits : 90 cumulative_hitratio : 0.96 cumulative_inserts : 1 cumulative_evictions : 0 item_shingleContent_trigram : {field=shingleContent_trigram,memSize=326924381,tindexSize=4765394,time=222924,phase1=221106,nTerms=14827061,bigTerms=35,termInstances=114359167,uses=91} name: filterCache class: org.apache.solr.search.FastLRUCache version: 1.0 description: Concurrent LRU Cache(maxSize=512, initialSize=512, minSize=460, acceptableSize=486, cleanupThread=false) stats: lookups : 1003486 hits : 2809 hitratio : 0.00 inserts : 1000694 evictions : 1000221 size : 473 warmupTime : 0 cumulative_lookups : 1003486 cumulative_hits : 2809 cumulative_hitratio : 0.00 cumulative_inserts : 1000694 cumulative_evictions : 1000221 schema excerpt: <fieldType name="shingle_text_trigram" class="solr.TextField" positionIncrementGap="100"> <analyzer> <tokenizer class="solr.StandardTokenizerFactory"/> <filter class="solr.LowerCaseFilterFactory"/> <filter class="solr.ShingleFilterFactory" maxShingleSize="3" outputUnigrams="true"/> </analyzer> </fieldType> -- Regards, Dmitry Kan
