RE: High CPU usage observed while searching with lucene 6.2.1
Thanks Uwe for the info. Correct, It make sense. -Jayan -- Sent from: http://lucene.472066.n3.nabble.com/Lucene-Java-Users-f532864.html - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
RE: High CPU usage observed while searching with lucene 6.2.1
Hi, what's wrong with high CPU usage - nothing! It's just a sign that your index is configured perfectly, so no I/O is happening during the search and everything is done as fast as possible and therefore uses 100% of CPU on a single core. If you want to slow it down, you may be able to do this outside of Lucene, e.g. in the hypervisor of your virtual machine. In general, people complaining about high CPU usage are also those that execute the search (which is very fast) but then try to get ALL documents (possibly millions) with paged searching (docs 0-99, then 100 to 199, and so on). This produces high load and takes ages, because it has to decompress every document, reexecute the whole query each time, and finally produces lots of garbage by allocating huge arrays, because paged searching is only optimized for getting like "top 100" scoring documents, not millions. Uwe - Uwe Schindler Achterdiek 19, D-28357 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de > -Original Message- > From: jayanpraman [mailto:jayan.p.ra...@gmail.com] > Sent: Friday, January 5, 2018 12:48 PM > To: java-user@lucene.apache.org > Subject: Re: High CPU usage observed while searching with lucene 6.2.1 > > Hi Parit Bansal, > > Thanks a lot for your information. > > I have seen high CPU usage during query with 2 GB data index size. > > Regards, > Jayan > > > > -- > Sent from: http://lucene.472066.n3.nabble.com/Lucene-Java-Users- > f532864.html > > - > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > For additional commands, e-mail: java-user-h...@lucene.apache.org - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
Re: High CPU usage observed while searching with lucene 6.2.1
Hi Parit Bansal, Thanks a lot for your information. I have seen high CPU usage during query with 2 GB data index size. Regards, Jayan -- Sent from: http://lucene.472066.n3.nabble.com/Lucene-Java-Users-f532864.html - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
Re: High CPU usage observed while searching with lucene 6.2.1
Hi jay, I have used 6.2.1 previously and I didn't see any specific high CPU usage. Would be good if you could debug your indexing process via visualvm or similar tool to pinpoint where lucene is spending most of the time. Hope this helps. - Best Parit Bansal On 01/04/2018 12:25 PM, jayanpraman wrote: Hi, I am new into lucene, need clarification about the CPU usage for lucene . We are using lucene 6.2.1 as a search engine to our application . We have observed that , during search the CPU usage is going high(190%). The indexed data size is 2 GB. Please let me know anything missing or to be configured to reduce the CPU usage. Our VM has 8GB ram. Regards, Jay -- Sent from: http://lucene.472066.n3.nabble.com/Lucene-Java-Users-f532864.html - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
