Re: Checking of Solr Memory and Disk usage
On Fri, Apr 24, 2015 at 8:31 AM, Zheng Lin Edwin Yeo edwinye...@gmail.com wrote: Hi, So has anyone knows what is the issue with the Heap Memory Usage reading showing the value -1. Should I open an issue in Jira? I have solr 4.8.1 and solr 5.0.0 servers, on the solr 4.8.1 servers the core statistics have values for heap memory, on the solr 5.0.0 ones I also see the value -1. This is with CentOS 6/Java 1.7 OpenJDK on both versions. I don't see this issue in the fixed bugs in 5.1.0, but I only looked at the headlines of the tickets.. http://lucene.apache.org/solr/5_1_0/changes/Changes.html#v5.1.0.bug_fixes Cheers Tom
Re: Checking of Solr Memory and Disk usage
Meaning this was working fine until Solr 5.0.0? I'm quite new to Solr and I only started to use it when Solr 5.0.0 was released. Regards, Edwin On 24 April 2015 at 18:20, Tom Evans tevans...@googlemail.com wrote: On Fri, Apr 24, 2015 at 8:31 AM, Zheng Lin Edwin Yeo edwinye...@gmail.com wrote: Hi, So has anyone knows what is the issue with the Heap Memory Usage reading showing the value -1. Should I open an issue in Jira? I have solr 4.8.1 and solr 5.0.0 servers, on the solr 4.8.1 servers the core statistics have values for heap memory, on the solr 5.0.0 ones I also see the value -1. This is with CentOS 6/Java 1.7 OpenJDK on both versions. I don't see this issue in the fixed bugs in 5.1.0, but I only looked at the headlines of the tickets.. http://lucene.apache.org/solr/5_1_0/changes/Changes.html#v5.1.0.bug_fixes Cheers Tom
Re: Checking of Solr Memory and Disk usage
Hi, So has anyone knows what is the issue with the Heap Memory Usage reading showing the value -1. Should I open an issue in Jira? Regards, Edwin On 22 April 2015 at 21:23, Zheng Lin Edwin Yeo edwinye...@gmail.com wrote: I see. I'm running on SolrCloud with 2 replicia, so I guess mine will probably use much more when my system reaches millions of documents. Regards, Edwin On 22 April 2015 at 20:47, Shawn Heisey apa...@elyograg.org wrote: On 4/22/2015 12:11 AM, Zheng Lin Edwin Yeo wrote: Roughly how many collections and how much records do you have in your Solr? I have 8 collections with a total of roughly 227000 records, most of which are CSV records. One of my collections have 142000 records. The core that shows 82MB for heap usage has 16 million documents and is hit with an average of 1 or 2 queries per second. The entire Solr instance on this machine has about 55 million documents and a 6GB max heap. This is NOT running SolrCloud, though the indexes are distributed. There are 24 cores defined, but during normal operation, only four of them contain documents. All four of those cores show heap memory values less than 100MB, but the overall heap usage on that machine is measured in gigabytes. Thanks, Shawn
Re: Checking of Solr Memory and Disk usage
I see. I'm running on SolrCloud with 2 replicia, so I guess mine will probably use much more when my system reaches millions of documents. Regards, Edwin On 22 April 2015 at 20:47, Shawn Heisey apa...@elyograg.org wrote: On 4/22/2015 12:11 AM, Zheng Lin Edwin Yeo wrote: Roughly how many collections and how much records do you have in your Solr? I have 8 collections with a total of roughly 227000 records, most of which are CSV records. One of my collections have 142000 records. The core that shows 82MB for heap usage has 16 million documents and is hit with an average of 1 or 2 queries per second. The entire Solr instance on this machine has about 55 million documents and a 6GB max heap. This is NOT running SolrCloud, though the indexes are distributed. There are 24 cores defined, but during normal operation, only four of them contain documents. All four of those cores show heap memory values less than 100MB, but the overall heap usage on that machine is measured in gigabytes. Thanks, Shawn
Re: Checking of Solr Memory and Disk usage
On 4/22/2015 12:11 AM, Zheng Lin Edwin Yeo wrote: Roughly how many collections and how much records do you have in your Solr? I have 8 collections with a total of roughly 227000 records, most of which are CSV records. One of my collections have 142000 records. The core that shows 82MB for heap usage has 16 million documents and is hit with an average of 1 or 2 queries per second. The entire Solr instance on this machine has about 55 million documents and a 6GB max heap. This is NOT running SolrCloud, though the indexes are distributed. There are 24 cores defined, but during normal operation, only four of them contain documents. All four of those cores show heap memory values less than 100MB, but the overall heap usage on that machine is measured in gigabytes. Thanks, Shawn
Re: Checking of Solr Memory and Disk usage
Roughly how many collections and how much records do you have in your Solr? I have 8 collections with a total of roughly 227000 records, most of which are CSV records. One of my collections have 142000 records. Regards, Edwin On 22 April 2015 at 13:49, Shawn Heisey apa...@elyograg.org wrote: On 4/21/2015 11:33 PM, Zheng Lin Edwin Yeo wrote: I've got the amount of disk space used, but for the Heap Memory Usage reading, it is showing the value -1. Do we need to change any settings for it? When I check from the Windows Task Manager, it is showing about 300MB for shard1 and 150MB for shard2. But I suppose that is the usage for the entire Solr and not for individual collection. That -1 sounds like a bug, but I'd like others to have a chance to chime in before you open an issue in Jira. My Solr instances are older -- 4.7.2 and 4.9.1. One of the larger cores on a 4.7.2 server shows a heap memory value of 86656138 -- about 82MB. I have no way to verify, but this seems very low to me. Thanks, Shawn
Re: Checking of Solr Memory and Disk usage
On 4/21/2015 7:48 PM, Zheng Lin Edwin Yeo wrote: Does anyone knows the way to check the accurate memory and disk usage for each individual collections that's running in Solr? I'm using Solr-5.0.0 with 3 instance of external zookeeper-3.4.6, running on 2 shards/ Solr's admin UI will tell you the amount of disk space used by each *core* on the Overview tab for the core ... but you have to add them all up if you want to know that for each *collection*. The admin UI does have a Heap memory reading on the Overview tab for each core, but I do not know how accurate it is, or what exactly is being measured there. I am pretty sure that there is far more memory being used by each of my cores than I can see listed there, so it must not be counting everything. Thanks, Shawn
Re: Checking of Solr Memory and Disk usage
On 4/21/2015 11:33 PM, Zheng Lin Edwin Yeo wrote: I've got the amount of disk space used, but for the Heap Memory Usage reading, it is showing the value -1. Do we need to change any settings for it? When I check from the Windows Task Manager, it is showing about 300MB for shard1 and 150MB for shard2. But I suppose that is the usage for the entire Solr and not for individual collection. That -1 sounds like a bug, but I'd like others to have a chance to chime in before you open an issue in Jira. My Solr instances are older -- 4.7.2 and 4.9.1. One of the larger cores on a 4.7.2 server shows a heap memory value of 86656138 -- about 82MB. I have no way to verify, but this seems very low to me. Thanks, Shawn
