solr-cloud performance decrease day by day
Hello, i am using sold 4.1.0 and ihave used sold cloud in my product.I have found at first everything seems good,the search time is fast and delay is slow,but it becomes very slow after days.does any one knows if there maybe some params or optimization to use sold cloud?
Re: solr-cloud performance decrease day by day
Could you give more info about your index size and technical details of your machine? Maybe you are indexing more data day by day and your RAM capability is not enough anymore? 2013/4/19 qibaoyuan qibaoy...@gmail.com Hello, i am using sold 4.1.0 and ihave used sold cloud in my product.I have found at first everything seems good,the search time is fast and delay is slow,but it becomes very slow after days.does any one knows if there maybe some params or optimization to use sold cloud?
Re: solr-cloud performance decrease day by day
there are 6 shards and they are in one machine,and the jvm param is very big,the physical memory is 16GB,the total #docs is about 150k,the index size of each shard is about 1GB.AND there is indexing while searching,I USE auto commit each 10min.and the data comes about 100 per minutes. 在 2013-4-19，下午3:17，Furkan KAMACI furkankam...@gmail.com 写道： Could you give more info about your index size and technical details of your machine? Maybe you are indexing more data day by day and your RAM capability is not enough anymore? 2013/4/19 qibaoyuan qibaoy...@gmail.com Hello, i am using sold 4.1.0 and ihave used sold cloud in my product.I have found at first everything seems good,the search time is fast and delay is slow,but it becomes very slow after days.does any one knows if there maybe some params or optimization to use sold cloud?
Re: solr-cloud performance decrease day by day
Can happen for various reasons. Can you recreate the situation, meaning restarting the servlet or server would start with good qTime and decrease from that point? How fast does this happen? Start by monitoring the jvm process, with oracle visualVM for example. Monitor for frequent garbage collections or unreasonable memory peacks or opening threads. Then monitor your system to see if there's an io disk latency or disk usage that increases in time, the writing queue to disk exploads, cpu load becomes heavier or network usage's exeeds limit. If you can recreate the decrease and monitor well, one of the above params should pop up. Fixing it after defining the problem will be easier. Good day, Manu On Apr 19, 2013 10:26 AM, qibaoyuan qibaoy...@gmail.com wrote:
Re: solr-cloud performance decrease day by day
Thanks manu,i will check it. 在 2013-4-19，下午4:26，Manuel Le Normand manuel.lenorm...@gmail.com 写道： Can happen for various reasons. Can you recreate the situation, meaning restarting the servlet or server would start with good qTime and decrease from that point? How fast does this happen? Start by monitoring the jvm process, with oracle visualVM for example. Monitor for frequent garbage collections or unreasonable memory peacks or opening threads. Then monitor your system to see if there's an io disk latency or disk usage that increases in time, the writing queue to disk exploads, cpu load becomes heavier or network usage's exeeds limit. If you can recreate the decrease and monitor well, one of the above params should pop up. Fixing it after defining the problem will be easier. Good day, Manu On Apr 19, 2013 10:26 AM, qibaoyuan qibaoy...@gmail.com wrote:
Re: solr-cloud performance decrease day by day
How are you committing data? With 4.0, CommitWithin is now a soft commit, which means that the transaction log will grow until you do a hard commit. You need to periodically do a hard commit if you are continually updating the index. How much updating are you doing? Also, check how much heap is available about you first start the server and have done a few queries and then monitor heap available over time. Maybe you are hitting garbage collections. Maybe you have too much heap allocated so that even a normal Java GC just takes a very long time because so much garbage accumulates - which is why you want only a modest amount of heap available above what the data needs after a few queries have loaded caches. -- Jack Krupansky -Original Message- From: qibaoyuan Sent: Friday, April 19, 2013 3:15 AM To: solr-user@lucene.apache.org Subject: solr-cloud performance decrease day by day Hello, i am using sold 4.1.0 and ihave used sold cloud in my product.I have found at first everything seems good,the search time is fast and delay is slow,but it becomes very slow after days.does any one knows if there maybe some params or optimization to use sold cloud?=
Re: solr-cloud performance decrease day by day
How many segments each shard has and what is the reason of running multiple shards in one machine? Alex. -Original Message- From: qibaoyuan qibaoy...@gmail.com To: solr-user solr-user@lucene.apache.org Sent: Fri, Apr 19, 2013 12:26 am Subject: Re: solr-cloud performance decrease day by day there are 6 shards and they are in one machine,and the jvm param is very big,the physical memory is 16GB,the total #docs is about 150k,the index size of each shard is about 1GB.AND there is indexing while searching,I USE auto commit each 10min.and the data comes about 100 per minutes. 在 2013-4-19，下午3:17，Furkan KAMACI furkankam...@gmail.com 写道： Could you give more info about your index size and technical details of your machine? Maybe you are indexing more data day by day and your RAM capability is not enough anymore? 2013/4/19 qibaoyuan qibaoy...@gmail.com Hello, i am using sold 4.1.0 and ihave used sold cloud in my product.I have found at first everything seems good,the search time is fast and delay is slow,but it becomes very slow after days.does any one knows if there maybe some params or optimization to use sold cloud?
