Re: exceeded limit of maxWarmingSearchers ERROR
Hi Erickson,
Thanks for your reply.
Iam getting the following error with liferay tomcat.
2013/11/18 07:29:42 ERROR
com.liferay.portal.search.solr.SolrIndexWriterImpl.deleteDocument(SolrIndexWriterImpl.java:90)
[]
[liferay/search_writer]
org.apache.solr.common.SolrException: Not Found
Not Found
request:
http://10.43.4.155:8080/apache-solr-1.4.1/liferay/update?wt=javabinversion=2.2
org.apache.solr.common.SolrException: Not Found
Not Found
request:
http://10.43.4.155:8080/apache-solr-1.4.1/liferay/update?wt=javabinversion=2.2
at
org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:343)
at
org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:183)
at
com.liferay.portal.search.solr.server.BasicAuthSolrServer.request(BasicAuthSolrServer.java:93)
at
org.apache.solr.client.solrj.request.UpdateRequest.process(UpdateRequest.java:217)
at
org.apache.solr.client.solrj.SolrServer.deleteById(SolrServer.java:97)
at
com.liferay.portal.search.solr.SolrIndexWriterImpl.deleteDocument(SolrIndexWriterImpl.java:83)
at
com.liferay.portal.search.solr.SolrIndexWriterImpl.updateDocument(SolrIndexWriterImpl.java:133)
at
com.liferay.portal.kernel.search.messaging.SearchWriterMessageListener.doReceive
(SearchWriterMessageListener.java:86)
at
com.liferay.portal.kernel.search.messaging.SearchWriterMessageListener.receive
(SearchWriterMessageListener.java:33)
at
com.liferay.portal.kernel.messaging.InvokerMessageListener.receive(InvokerMessageListener.java:63)
at
com.liferay.portal.kernel.messaging.ParallelDestination$1.run(ParallelDestination.java:61)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)...
Can you help me why Iam getting this error.
PFA of the same error log and the solr-spring.xml files.
Regards,
Lokanadham Ganta
- Original Message -
From: Erick Erickson [via Lucene] ml-node+s472066n4101220...@n3.nabble.com
To: Loka lokanadham.ga...@zensar.in
Sent: Friday, November 15, 2013 7:14:26 PM
Subject: Re: exceeded limit of maxWarmingSearchers ERROR
That's a fine place to start. This form:
maxTime${solr.autoCommit.maxTime:15000}/maxTime
just allows you to define a sysvar to override the 15 second default, like
java -Dsolr.autoCommti.maxTime=3 -jar start.jar
On Fri, Nov 15, 2013 at 8:11 AM, Loka [hidden email] wrote:
Hi Erickson,
I have seen the following also from google, can I use the same in
updateHandler class=solr.DirectUpdateHandler2:
commitWithin softCommitfalse/softCommit/commitWithin
If the above one is correct to add, can I add the below tags aslo in
updateHandler class=solr.DirectUpdateHandler2 along with the above tag:
autoCommit
maxTime3/maxTime
/autoCommit
autoSoftCommit
maxTime1/maxTime
/autoSoftCommit
so finally, it will look like as:
updateHandler class=solr.DirectUpdateHandler2
autoCommit
maxTime3/maxTime
/autoCommit
autoSoftCommit
maxTime1/maxTime
/autoSoftCommit
commitWithin softCommitfalse/softCommit/commitWithin
/updateHandler
Is the above one fine?
Regards,
Lokanadham Ganta
- Original Message -
From: Lokanadham Ganta [hidden email]
To: Erick Erickson [via Lucene]
[hidden email]
Sent: Friday, November 15, 2013 6:33:20 PM
Subject: Re: exceeded limit of maxWarmingSearchers ERROR
Erickson,
Thanks for your reply, before your reply, I have googled and found the
following and added under
updateHandler class=solr.DirectUpdateHandler2 tag of solrconfig.xml
file.
autoCommit
maxTime3/maxTime
/autoCommit
autoSoftCommit
maxTime1/maxTime
/autoSoftCommit
Is the above one is fine or should I go strictly as per ypur suggestion
means as below:
autoCommit
maxTime${solr.autoCommit.maxTime:15000}/maxTime
openSearcherfalse/openSearcher
/autoCommit
!-- softAutoCommit is like autoCommit except it causes a
'soft' commit which only ensures that changes are visible
but does not ensure that data is synced to disk. This is
faster and more near-realtime friendly than a hard commit.
--
autoSoftCommit
maxTime${solr.autoSoftCommit.maxTime:1}/maxTime
/autoSoftCommit
Please confirm me.
But how can I check how much autowarming that Iam doing, as of now I have
set the maxWarmingSearchers as 2, should I increase the value?
Regards,
Lokanadham Ganta
- Original Message -
From: Erick Erickson [via Lucene]
[hidden email]
To: Loka [hidden email]
Sent: Friday, November 15, 2013 6:07:12 PM
Re: exceeded limit of maxWarmingSearchers ERROR
Erickson,
Thanks for your reply, before your reply, I have googled and found the
following and added under
updateHandler class=solr.DirectUpdateHandler2 tag of solrconfig.xml file.
autoCommit
maxTime3/maxTime
/autoCommit
autoSoftCommit
maxTime1/maxTime
/autoSoftCommit
Is the above one is fine or should I go strictly as per ypur suggestion means
as below:
autoCommit
maxTime${solr.autoCommit.maxTime:15000}/maxTime
openSearcherfalse/openSearcher
/autoCommit
!-- softAutoCommit is like autoCommit except it causes a
'soft' commit which only ensures that changes are visible
but does not ensure that data is synced to disk. This is
faster and more near-realtime friendly than a hard commit.
--
autoSoftCommit
maxTime${solr.autoSoftCommit.maxTime:1}/maxTime
/autoSoftCommit
Please confirm me.
But how can I check how much autowarming that Iam doing, as of now I have set
the maxWarmingSearchers as 2, should I increase the value?
Regards,
Lokanadham Ganta
- Original Message -
From: Erick Erickson [via Lucene] ml-node+s472066n4101203...@n3.nabble.com
To: Loka lokanadham.ga...@zensar.in
Sent: Friday, November 15, 2013 6:07:12 PM
Subject: Re: exceeded limit of maxWarmingSearchers ERROR
Where did you get that syntax? I've never seen that before.
What you want to configure is the maxTime in your
autocommit and autosoftcommit sections of solrconfig.xml,
as:
autoCommit
maxTime${solr.autoCommit.maxTime:15000}/maxTime
openSearcherfalse/openSearcher
/autoCommit
!-- softAutoCommit is like autoCommit except it causes a
'soft' commit which only ensures that changes are visible
but does not ensure that data is synced to disk. This is
faster and more near-realtime friendly than a hard commit.
--
autoSoftCommit
maxTime${solr.autoSoftCommit.maxTime:1}/maxTime
/autoSoftCommit
And you do NOT want to commit from your client.
Depending on how long autowarm takes, you may still see this error,
so check how much autowarming you're doing, i.e. how you've
configured the caches in solrconfig.xml and what you
have for newSearcher and firstSearcher.
I'd start with autowarm numbers of, maybe, 16 or so at most.
Best,
Erick
On Fri, Nov 15, 2013 at 2:46 AM, Loka [hidden email] wrote:
Hi Erickson,
Thanks for your reply, basically, I used commitWithin tag as below in
solrconfig.xml file
requestHandler name=/update class=solr.XmlUpdateRequestHandler
lst name=defaults
str name=update.processordedupe/str
/lst
add commitWithin=1/
/requestHandler
updateRequestProcessorChain name=dedupe
processor
class=org.apache.solr.update.processor.SignatureUpdateProcessorFactory
bool name=enabledtrue/bool
str name=signatureFieldid/str
bool name=overwriteDupesfalse/bool
str name=fieldsname,features,cat/str
str
name=signatureClassorg.apache.solr.update.processor.Lookup3Signature/str
/processor
processor class=solr.LogUpdateProcessorFactory /
processor class=solr.RunUpdateProcessorFactory /
/updateRequestProcessorChain
But this fix did not solve my problem, I mean I again got the same error.
PFA of schema.xml and solrconfig.xml file, solr-spring.xml,
messaging-spring.xml, can you sugest me where Iam doing wrong.
Regards,
Lokanadham Ganta
- Original Message -
From: Erick Erickson [via Lucene]
[hidden email]
To: Loka [hidden email]
Sent: Thursday, November 14, 2013 8:38:17 PM
Subject: Re: exceeded limit of maxWarmingSearchers ERROR
CommitWithin is either configured in solrconfig.xml for the
autoCommit or autoSoftCommit tags as the maxTime tag. I
recommend you do use this.
The other way you can do it is if you're using SolrJ, one of the
forms of the server.add() method takes a number of milliseconds
to force a commit.
You really, really do NOT want to use ridiculously short times for this
like a few milliseconds. That will cause new searchers to be
warmed, and when too many of them are warming at once you
get this error.
Seriously, make your commitWithin or autocommit parameters
as long as you can, for many reasons.
Here's a bunch of background:
http://searchhub.org/2013/08/23/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/
Best,
Erick
On Thu, Nov 14, 2013 at 5:13 AM, Loka [hidden email] wrote:
Hi Naveen,
Iam also getting the similar problem where I do not know how to use the
commitWithin Tag, can you help me how to use commitWithin Tag. can you
give
me the example
--
View this message in context:
http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR
Re: exceeded limit of maxWarmingSearchers ERROR
Hi Erickson,
I have seen the following also from google, can I use the same in
updateHandler class=solr.DirectUpdateHandler2:
commitWithin softCommitfalse/softCommit/commitWithin
If the above one is correct to add, can I add the below tags aslo in
updateHandler class=solr.DirectUpdateHandler2 along with the above tag:
autoCommit
maxTime3/maxTime
/autoCommit
autoSoftCommit
maxTime1/maxTime
/autoSoftCommit
so finally, it will look like as:
updateHandler class=solr.DirectUpdateHandler2
autoCommit
maxTime3/maxTime
/autoCommit
autoSoftCommit
maxTime1/maxTime
/autoSoftCommit
commitWithin softCommitfalse/softCommit/commitWithin
/updateHandler
Is the above one fine?
Regards,
Lokanadham Ganta
- Original Message -
From: Lokanadham Ganta lokanadham.ga...@zensar.in
To: Erick Erickson [via Lucene] ml-node+s472066n4101203...@n3.nabble.com
Sent: Friday, November 15, 2013 6:33:20 PM
Subject: Re: exceeded limit of maxWarmingSearchers ERROR
Erickson,
Thanks for your reply, before your reply, I have googled and found the
following and added under
updateHandler class=solr.DirectUpdateHandler2 tag of solrconfig.xml file.
autoCommit
maxTime3/maxTime
/autoCommit
autoSoftCommit
maxTime1/maxTime
/autoSoftCommit
Is the above one is fine or should I go strictly as per ypur suggestion means
as below:
autoCommit
maxTime${solr.autoCommit.maxTime:15000}/maxTime
openSearcherfalse/openSearcher
/autoCommit
!-- softAutoCommit is like autoCommit except it causes a
'soft' commit which only ensures that changes are visible
but does not ensure that data is synced to disk. This is
faster and more near-realtime friendly than a hard commit.
--
autoSoftCommit
maxTime${solr.autoSoftCommit.maxTime:1}/maxTime
/autoSoftCommit
Please confirm me.
But how can I check how much autowarming that Iam doing, as of now I have set
the maxWarmingSearchers as 2, should I increase the value?
Regards,
Lokanadham Ganta
- Original Message -
From: Erick Erickson [via Lucene] ml-node+s472066n4101203...@n3.nabble.com
To: Loka lokanadham.ga...@zensar.in
Sent: Friday, November 15, 2013 6:07:12 PM
Subject: Re: exceeded limit of maxWarmingSearchers ERROR
Where did you get that syntax? I've never seen that before.
What you want to configure is the maxTime in your
autocommit and autosoftcommit sections of solrconfig.xml,
as:
autoCommit
maxTime${solr.autoCommit.maxTime:15000}/maxTime
openSearcherfalse/openSearcher
/autoCommit
!-- softAutoCommit is like autoCommit except it causes a
'soft' commit which only ensures that changes are visible
but does not ensure that data is synced to disk. This is
faster and more near-realtime friendly than a hard commit.
--
autoSoftCommit
maxTime${solr.autoSoftCommit.maxTime:1}/maxTime
/autoSoftCommit
And you do NOT want to commit from your client.
Depending on how long autowarm takes, you may still see this error,
so check how much autowarming you're doing, i.e. how you've
configured the caches in solrconfig.xml and what you
have for newSearcher and firstSearcher.
I'd start with autowarm numbers of, maybe, 16 or so at most.
Best,
Erick
On Fri, Nov 15, 2013 at 2:46 AM, Loka [hidden email] wrote:
Hi Erickson,
Thanks for your reply, basically, I used commitWithin tag as below in
solrconfig.xml file
requestHandler name=/update class=solr.XmlUpdateRequestHandler
lst name=defaults
str name=update.processordedupe/str
/lst
add commitWithin=1/
/requestHandler
updateRequestProcessorChain name=dedupe
processor
class=org.apache.solr.update.processor.SignatureUpdateProcessorFactory
bool name=enabledtrue/bool
str name=signatureFieldid/str
bool name=overwriteDupesfalse/bool
str name=fieldsname,features,cat/str
str
name=signatureClassorg.apache.solr.update.processor.Lookup3Signature/str
/processor
processor class=solr.LogUpdateProcessorFactory /
processor class=solr.RunUpdateProcessorFactory /
/updateRequestProcessorChain
But this fix did not solve my problem, I mean I again got the same error.
PFA of schema.xml and solrconfig.xml file, solr-spring.xml,
messaging-spring.xml, can you sugest me where Iam doing wrong.
Regards,
Lokanadham Ganta
- Original Message -
From: Erick Erickson [via Lucene]
[hidden email]
To: Loka [hidden email]
Sent: Thursday, November 14, 2013 8:38:17 PM
Subject: Re: exceeded limit of maxWarmingSearchers ERROR
CommitWithin is either configured in solrconfig.xml for the
autoCommit or autoSoftCommit tags as the maxTime tag. I
recommend you do use this.
The other
Re: exceeded limit of maxWarmingSearchers ERROR
Hi Naveen, Iam also getting the similar problem where I do not know how to use the commitWithin Tag, can you help me how to use commitWithin Tag. can you give me the example -- View this message in context: http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4100864.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: exceeded limit of maxWarmingSearchers ERROR
Hi Erickson, Thanks for your reply, basically, I used commitWithin tag as below in solrconfig.xml file requestHandler name=/update class=solr.XmlUpdateRequestHandler lst name=defaults str name=update.processordedupe/str /lst add commitWithin=1/ /requestHandler updateRequestProcessorChain name=dedupe processor class=org.apache.solr.update.processor.SignatureUpdateProcessorFactory bool name=enabledtrue/bool str name=signatureFieldid/str bool name=overwriteDupesfalse/bool str name=fieldsname,features,cat/str str name=signatureClassorg.apache.solr.update.processor.Lookup3Signature/str /processor processor class=solr.LogUpdateProcessorFactory / processor class=solr.RunUpdateProcessorFactory / /updateRequestProcessorChain But this fix did not solve my problem, I mean I again got the same error. PFA of schema.xml and solrconfig.xml file, solr-spring.xml, messaging-spring.xml, can you sugest me where Iam doing wrong. Regards, Lokanadham Ganta - Original Message - From: Erick Erickson [via Lucene] ml-node+s472066n4100924...@n3.nabble.com To: Loka lokanadham.ga...@zensar.in Sent: Thursday, November 14, 2013 8:38:17 PM Subject: Re: exceeded limit of maxWarmingSearchers ERROR CommitWithin is either configured in solrconfig.xml for the autoCommit or autoSoftCommit tags as the maxTime tag. I recommend you do use this. The other way you can do it is if you're using SolrJ, one of the forms of the server.add() method takes a number of milliseconds to force a commit. You really, really do NOT want to use ridiculously short times for this like a few milliseconds. That will cause new searchers to be warmed, and when too many of them are warming at once you get this error. Seriously, make your commitWithin or autocommit parameters as long as you can, for many reasons. Here's a bunch of background: http://searchhub.org/2013/08/23/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/ Best, Erick On Thu, Nov 14, 2013 at 5:13 AM, Loka [hidden email] wrote: Hi Naveen, Iam also getting the similar problem where I do not know how to use the commitWithin Tag, can you help me how to use commitWithin Tag. can you give me the example -- View this message in context: http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4100864.html Sent from the Solr - User mailing list archive at Nabble.com. If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4100924.html To unsubscribe from exceeded limit of maxWarmingSearchers ERROR, click here . NAML solr-spring.xml (2K) http://lucene.472066.n3.nabble.com/attachment/4101152/0/solr-spring.xml messaging-spring.xml (2K) http://lucene.472066.n3.nabble.com/attachment/4101152/1/messaging-spring.xml schema.xml (6K) http://lucene.472066.n3.nabble.com/attachment/4101152/2/schema.xml solrconfig.xml (61K) http://lucene.472066.n3.nabble.com/attachment/4101152/3/solrconfig.xml -- View this message in context: http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-ERROR-tp3252844p4101152.html Sent from the Solr - User mailing list archive at Nabble.com.
