Could not find an instance of QueryComponent. Disabling collation verification against the index.
Hi Team, I am trying to configure the Auto-suggest feature for the businessProvince field in my schema. I followed the instructions here:- http://wiki.apache.org/solr/Suggester But then I got the following error:- INFO: Could not find an instance of QueryComponent. Disabling collation verification against the index. Based on this forum (http://stackoverflow.com/questions/10547438/solr-returns-only-one-collation-for-suggester-component), I added a query component. So now all these queries work:- http://localhost:8983/solr/collection1/cityProvinceSuggest?q=AZ - Searches the default field http://localhost:8983/solr/collection1/cityProvinceSuggest?q=businessProvince:AZ Searches the businessProvince field http://localhost:8983/solr/collection1/cityProvinceSuggest?q=businessCity:Phoenix Searches the businessCity field http://localhost:8983/solr/collection1/cityProvinceSuggest?q=name:Balaji Searches the name field So my question now is whether the field element is honored? Bcos holding all the data in the lookup data-structure may cause memory issues. Any help will be appreciated. searchComponent class=solr.SpellCheckComponent name=suggest lst name=spellchecker str name=namesuggest/str str name=classnameorg.apache.solr.spelling.suggest.Suggester/str str name=lookupImplorg.apache.solr.spelling.suggest.tst.TSTLookup/str str name=fieldbusinessProvince/str float name=threshold0.005/float str name=buildOnCommittrue/str /lst /searchComponent Thanks, Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/Could-not-find-an-instance-of-QueryComponent-Disabling-collation-verification-against-the-index-tp4057417.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Query parsing VS marshalling/unmarshalling
Hi, I am trying to do something similar:- Eg. Input: (name:John AND name:Doe) Output: ((firstName:John OR lastName:John) AND (firstName:John OR lastName:John)) How can I extract the fields, change them and repackage the query? Thanks, Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/Query-parsing-VS-marshalling-unmarshalling-tp3935430p4033985.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Rename fields in a query
Hi, I am trying to do something similar:- Eg. Input: (name:John AND name:Doe) Output: ((firstName:John OR lastName:John) AND (firstName:John OR lastName:John)) How can I extract the fields, change them and repackage the query? Thanks, Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/Rename-fields-in-a-query-tp2693739p4033988.html Sent from the Solr - User mailing list archive at Nabble.com.
Solr 4.0 and SIREn plugin
Hi Team, We are looking into using the SIREn plugin with Solr 4.0. I am just confirming if this plugin works with Solr 4.0. Also if someone has some good documentation on this, it will be of great help. Thanks, Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-0-and-SIREn-plugin-tp4024553.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Using AnalyzingQueryParser - Solr 4.0
Hi Jack, We have an email field defined like this:- fieldType name=text_email class=solr.TextField positionIncrementGap=100 analyzer tokenizer class=solr.StandardTokenizerFactory/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.PatternReplaceFilterFactory pattern=\. replacement= DOT replace=all/ filter class=solr.PatternReplaceFilterFactory pattern=@ replacement= AT replace=all/ filter class=solr.WordDelimiterFilterFactory generateWordParts=1 generateNumberParts=1 catenateWords=0 catenateNumbers=0 catenateAll=0 splitOnCaseChange=0/ /analyzer analyzer type=multiterm tokenizer class=solr.KeywordTokenizerFactory / /analyzer /fieldType A query like [emailAddress : bob*] would match b...@bob.com, but queries which include any special characters like [bob@], [bob@*] and [bob@bob.*] will not match any email addresses. Yes, I tried the multi-term and it does not fix the issue. Any thots? Thanks, Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/Using-AnalyzingQueryParser-Solr-4-0-tp4019193p4019341.html Sent from the Solr - User mailing list archive at Nabble.com.
Using AnalyzingQueryParser - Solr 4.0
Hi Team, Just trying to find out how to configure AnalyzingQueryParser in Solr 4.0. Please let me know. Thanks, Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/Using-AnalyzingQueryParser-Solr-4-0-tp4019193.html Sent from the Solr - User mailing list archive at Nabble.com.
After to SOLR 4.0.0 Upgrade - ClusterState says we are the leader, but locally we don't think so
Hi, After upgrading from Solr 4.0.0-Beta to Solr 4.0.0 we are getting this error from ALL the leader nodes:- Oct 31, 2012 6:44:03 AM org.apache.solr.update.processor.DistributedUpdateProcessor doDefensiveChecks SEVERE: ClusterState says we are the leader, but locally we don't think so Is there a configuration/schema change we are missing? Please let us know. Thanks, Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/After-to-SOLR-4-0-0-Upgrade-ClusterState-says-we-are-the-leader-but-locally-we-don-t-think-so-tp4017277.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: After to SOLR 4.0.0 Upgrade - ClusterState says we are the leader, but locally we don't think so
Mark, We have tried the following:- 1. Removing everything in the ZooKeeper snapshot directory 2. Removing the indexes We get the same error in both the cases. Attached the cloud dumps:- cloud_dump.json http://lucene.472066.n3.nabble.com/file/n4017315/cloud_dump.json Thanks, Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/After-to-SOLR-4-0-0-Upgrade-ClusterState-says-we-are-the-leader-but-locally-we-don-t-think-so-tp4017277p4017315.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Anyone working on adapting AnalyzingQueryParser to solr?
Hi, Is the AnalyzingQueryParser ported to SOLR? I read that it it available in Lucene. Not sure about SOLR. We are trying to workaround this limitation:- On wildcard and fuzzy searches, no text analysis is performed on the search word. http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters Thanks, Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/Anyone-working-on-adapting-AnalyzingQueryParser-to-solr-tp500199p4017364.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Anyone working on adapting AnalyzingQueryParser to solr?
Hi iorixxx, this is how we our email field defined. fieldType name=text_email class=solr.TextField positionIncrementGap=100 analyzer tokenizer class=solr.StandardTokenizerFactory/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.PatternReplaceFilterFactory pattern=\. replacement= DOT replace=all/ filter class=solr.PatternReplaceFilterFactory pattern=@ replacement= AT replace=all/ filter class=solr.WordDelimiterFilterFactory generateWordParts=1 generateNumberParts=1 catenateWords=0 catenateNumbers=0 catenateAll=0 splitOnCaseChange=0/ /analyzer analyzer type=multiterm tokenizer class=solr.KeywordTokenizerFactory / /analyzer /fieldType So a query like [emailAddress : bob*] would match b...@bob.com, but queries which include the special charecter like [bob@*] and [bob@bob.*] will not match any email addresses. Yes, I tried the multiterm and it does not fix the issue. Any thots? -- View this message in context: http://lucene.472066.n3.nabble.com/Anyone-working-on-adapting-AnalyzingQueryParser-to-solr-tp500199p4017404.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: Nodes cannot recover and become unavailable
Hi Team, What is the preferred way to upgrade from SOLR 4.0.0-BETA to SOLR 4.0.0? We saw the same errors happening when we did the upgrade:- Oct 29, 2012 4:55:00 PM org.apache.solr.common.SolrException log SEVERE: Error while trying to recover. core=mediacms:org.apache.solr.common.SolrException: We are not the leader at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:401) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181) at org.apache.solr.cloud.RecoveryStrategy.sendPrepRecoveryCmd(RecoveryStrategy.java:199) at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:388) at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:220) Thanks, Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/Nodes-cannot-recover-and-become-unavailable-tp4008916p4017037.html Sent from the Solr - User mailing list archive at Nabble.com.
SolrCloud - Replication - Runtime
Hi, I am trying to add new Solr nodes to an existing cluster for replication. Only newly added documents are added to the replicas. Please let me know the config for syncing the documents on adding the new nodes. Thanks, Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-Replication-Runtime-tp4015391.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: SolrCloud - Configuring replicationFactor
Thanks for ur reply. force the replicationFactor - I meant can we say 2 replicas and 2 nodes, like the below:- http://people.apache.org/~markrmiller/2shard4server2.jpg Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering | Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto:balaji.gan...@apollogrp.edu Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. On Oct 18, 2012, at 6:29 PM, Tomás Fernández Löbbe [via Lucene] ml-node+s472066n4014637...@n3.nabble.commailto:ml-node+s472066n4014637...@n3.nabble.com wrote: Hi Balaji, what do you mean with force the replicationFactor? There is not much documentation about the replicationFactor because it's very new, but see this previous discussion: http://find.searchhub.org/document/80b91db21b1befa6 and the comments here: https://issues.apache.org/jira/browse/SOLR-3488 , those may help you. Tomás On Thu, Oct 18, 2012 at 9:12 PM, balaji.gandhi [hidden email]/user/SendEmail.jtp?type=nodenode=4014637i=0wrote: Hi Team, We are trying to configure replicationFactor in SolrCloud mode to specify a minimum number of replicas in the cluster. We know that if (number of nodes) = 2 * (number of shards) Solr takes care of the replication. Is there a way to force the replicationFactor when (number of nodes) 2 * (number of shards)? Looking to setup something like the below from SolrCloud wiki:- http://people.apache.org/~markrmiller/2shard4server2.jpg http://people.apache.org/~markrmiller/2shard4server2.jpg Thanks, Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-Configuring-replicationFactor-tp4014625.html Sent from the Solr - User mailing list archive at Nabble.comhttp://Nabble.com. If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrCloud-Configuring-replicationFactor-tp4014625p4014637.html To unsubscribe from SolrCloud - Configuring replicationFactor, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=4014625code=YmFsYWppLmdhbmRoaUBhcG9sbG9ncnAuZWR1fDQwMTQ2MjV8LTEwNzE2NTA1NDI=. NAMLhttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml This message is private and confidential. If you have received it in error, please notify the sender and remove it from your system. -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-Configuring-replicationFactor-tp4014625p4014639.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: SolrCloud - Configuring replicationFactor
That was really helpful. I will try the Collections API. Is there a plan to support replication using solr.xml? Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering | Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto:balaji.gan...@apollogrp.edu Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. On Oct 18, 2012, at 6:47 PM, Mark Miller-3 [via Lucene] ml-node+s472066n4014641...@n3.nabble.commailto:ml-node+s472066n4014641...@n3.nabble.com wrote: It depends on how you create your collection. If you want to pre configure your collection in solr.xml (collection1 comes this way), then everything depends on what you set for numShards on startup. If you wanted to have one collection across 4 nodes with 2 shards, each shard with 1 leader and 1 replica, you would simply startup 4 nodes with numShards=2 set on each of them (only the first matters, but to avoid races you can pass it to each). Since it knows you want two shards, all Solr nodes started that are configured with SolrCore's part of your collection will automatically join one of the two shards as replicas. So to summarize - it's totally determined by the numShards startup system property. If you are using the Collections API to create your collection, you can explicitly specify the replicationFactor as well as numShards. In this case, the replicationFactor you pass will limit how many replicas are created to the given value. This is so that, even if you have 100 nodes, you can create new collections that span 10, or 20 nodes, rather than using every node that is available. - Mark On Oct 18, 2012, at 8:12 PM, balaji.gandhi [hidden email]/user/SendEmail.jtp?type=nodenode=4014641i=0 wrote: Hi Team, We are trying to configure replicationFactor in SolrCloud mode to specify a minimum number of replicas in the cluster. We know that if (number of nodes) = 2 * (number of shards) Solr takes care of the replication. Is there a way to force the replicationFactor when (number of nodes) 2 * (number of shards)? Looking to setup something like the below from SolrCloud wiki:- http://people.apache.org/~markrmiller/2shard4server2.jpg http://people.apache.org/~markrmiller/2shard4server2.jpg Thanks, Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-Configuring-replicationFactor-tp4014625.html Sent from the Solr - User mailing list archive at Nabble.comhttp://Nabble.com. If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrCloud-Configuring-replicationFactor-tp4014625p4014641.html To unsubscribe from SolrCloud - Configuring replicationFactor, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=4014625code=YmFsYWppLmdhbmRoaUBhcG9sbG9ncnAuZWR1fDQwMTQ2MjV8LTEwNzE2NTA1NDI=. NAMLhttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml This message is private and confidential. If you have received it in error, please notify the sender and remove it from your system. -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-Configuring-replicationFactor-tp4014625p4014645.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: SolrJ 4.0 Beta maxConnectionsPerHost
Hi Briggs, Did you try StreamingUpdateSolrServer? We are still facing the same issues but noticed this happens only when Physical Memory in Solr Admin is high. And yes SolrJ respects the connections. Hi Team, Another option we discussed was upgrading to HttpClient 4.2 in Solr war. Would that fix the issue? Thanks, Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-4-0-Beta-maxConnectionsPerHost-tp4012630p4012712.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: SolrJ - IOException
Hi Toke, Were you able to find anything on this issue? We are running at 30 TPS and using the default HttpSolrServer for the posts. [cid:image001.png@01CDA2EA.370A6ED0] Thanks, Balaji Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto:balaji.gan...@apollogrp.edu P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Toke Eskildsen [via Lucene] [mailto:ml-node+s472066n4010082...@n3.nabble.com] Sent: Tuesday, September 25, 2012 12:19 AM To: Balaji Gandhi Subject: Re: SolrJ - IOException On Tue, 2012-09-25 at 01:50 +0200, balaji.gandhi wrote: I am encountering this error randomly (under load) when posting to Solr using SolrJ. Has anyone encountered a similar error? org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8080/solr/profile at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) [...] This looks suspiciously like a potential bug in the HTTP keep-alive flow that we encountered some weeks ago. I am guessing that you are issuing more than 100 separate updates/second. Could you please provide the full stack trace? If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4010082.html To unsubscribe from SolrJ - IOException, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=4010026code=YmFsYWppLmdhbmRoaUBhcG9sbG9ncnAuZWR1fDQwMTAwMjZ8LTEwNzE2NTA1NDI=. NAMLhttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml This message is private and confidential. If you have received it in error, please notify the sender and remove it from your system. image001.png (37K) http://lucene.472066.n3.nabble.com/attachment/4012130/0/image001.png -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4012130.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: SolrJ - IOException
Sushil, 30 TPS = 30 transactions (updates) per second. Is the recommendation to use EmbeddedSolrServer instead of HttpSolrServer? Thanks, Balaji Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto:balaji.gan...@apollogrp.edu P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Sushil jain [via Lucene] [mailto:ml-node+s472066n4012172...@n3.nabble.com] Sent: Friday, October 05, 2012 1:14 PM To: Balaji Gandhi Subject: Re: SolrJ - IOException Balaji, What is 30 TPS ? Toke, You should use EmbeddedSolrServer Instead. On Fri, Oct 5, 2012 at 11:42 PM, balaji.gandhi [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=0wrote: Hi Toke, Were you able to find anything on this issue? We are running at 30 TPS and using the default HttpSolrServer for the posts. [cid:image001.png@01CDA2EA.370A6ED0] Thanks, Balaji Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=1mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=2 P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Toke Eskildsen [via Lucene] [mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=3] Sent: Tuesday, September 25, 2012 12:19 AM To: Balaji Gandhi Subject: Re: SolrJ - IOException On Tue, 2012-09-25 at 01:50 +0200, balaji.gandhi wrote: I am encountering this error randomly (under load) when posting to Solr using SolrJ. Has anyone encountered a similar error? org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8080/solr/profile at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) [...] This looks suspiciously like a potential bug in the HTTP keep-alive flow that we encountered some weeks ago. I am guessing that you are issuing more than 100 separate updates/second. Could you please provide the full stack trace? If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4010082.html To unsubscribe from SolrJ - IOException, click here . NAML http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml This message is private and confidential. If you have received it in error, please notify the sender and remove it from your system. image001.png (37K) http://lucene.472066.n3.nabble.com/attachment/4012130/0/image001.png -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4012130.html Sent from the Solr - User mailing list archive at Nabble.com. If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4012172.html To unsubscribe from SolrJ - IOException, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=4010026code=YmFsYWppLmdhbmRoaUBhcG9sbG9ncnAuZWR1fDQwMTAwMjZ8LTEwNzE2NTA1NDI=. NAMLhttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml This message is private and confidential. If you have received it in error, please notify the sender and remove it from your system. -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4012176.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: SolrJ - IOException
Sushil, we are trying to call the VIP in front of the SOLR nodes to distribute the update load. Also is EmbeddedSolrServer thread safe? Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto:balaji.gan...@apollogrp.edu P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Sushil jain [via Lucene] [mailto:ml-node+s472066n4012179...@n3.nabble.com] Sent: Friday, October 05, 2012 1:23 PM To: Balaji Gandhi Subject: Re: SolrJ - IOException Yes, I'd recommend EmbeddedSolrServer, because it doesn't require any web server for read/write/update/delete operations. On Sat, Oct 6, 2012 at 1:48 AM, balaji.gandhi [hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=0wrote: Sushil, 30 TPS = 30 transactions (updates) per second. Is the recommendation to use EmbeddedSolrServer instead of HttpSolrServer? Thanks, Balaji Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: [hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=1mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=2 P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Sushil jain [via Lucene] [mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=3] Sent: Friday, October 05, 2012 1:14 PM To: Balaji Gandhi Subject: Re: SolrJ - IOException Balaji, What is 30 TPS ? Toke, You should use EmbeddedSolrServer Instead. On Fri, Oct 5, 2012 at 11:42 PM, balaji.gandhi [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=0wrote: Hi Toke, Were you able to find anything on this issue? We are running at 30 TPS and using the default HttpSolrServer for the posts. [cid:image001.png@01CDA2EA.370A6ED0] Thanks, Balaji Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=1mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=2 P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Toke Eskildsen [via Lucene] [mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=3] Sent: Tuesday, September 25, 2012 12:19 AM To: Balaji Gandhi Subject: Re: SolrJ - IOException On Tue, 2012-09-25 at 01:50 +0200, balaji.gandhi wrote: I am encountering this error randomly (under load) when posting to Solr using SolrJ. Has anyone encountered a similar error? org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8080/solr/profile at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) [...] This looks suspiciously like a potential bug in the HTTP keep-alive flow that we encountered some weeks ago. I am guessing that you are issuing more than 100 separate updates/second. Could you please provide the full stack trace? If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4010082.html To unsubscribe from SolrJ - IOException, click here . NAML http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml This message is private and confidential. If you have received it in error, please notify the sender and remove it from your system. image001.png (37K) http://lucene.472066.n3.nabble.com/attachment/4012130/0/image001.png -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4012130.html Sent from the Solr - User mailing list archive at Nabble.com. If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4012172.html To unsubscribe from SolrJ - IOException, click here . NAML http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble
RE: SolrJ - IOException
Hi Toke, We encountered this issue again. This time the SOLR servers were stalled. We are at 30 TPS. Please let us know any updates in the HTTP issue. Thanks, Balaji Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto:balaji.gan...@apollogrp.edu P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Balaji Gandhi Sent: Thursday, September 27, 2012 10:52 AM To: 'Toke Eskildsen [via Lucene]' Subject: RE: SolrJ - IOException Here is the stack trace:- org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server: org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182) at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:122) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:107) at org.apache.solr.handler.dataimport.thread.task.SolrUploadTask.upload(SolrUploadTask.java:31) at org.apache.solr.handler.dataimport.thread.SolrUploader.run(SolrUploader.java:31) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.NoHttpResponseException: The target server failed to respond at org.apache.http.impl.conn.DefaultResponseParser.parseHead(DefaultResponseParser.java:101) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:252) at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:282) at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:247) at org.apache.http.impl.conn.AbstractClientConnAdapter.receiveResponseHeader(AbstractClientConnAdapter.java:216) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:298) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125) at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:647) at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:464) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353) ... 9 more Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto:balaji.gan...@apollogrp.edu P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Toke Eskildsen [via Lucene] [mailto:ml-node+s472066n4010082...@n3.nabble.com] Sent: Tuesday, September 25, 2012 12:19 AM To: Balaji Gandhi Subject: Re: SolrJ - IOException On Tue, 2012-09-25 at 01:50 +0200, balaji.gandhi wrote: I am encountering this error randomly (under load) when posting to Solr using SolrJ. Has anyone encountered a similar error? org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8080/solr/profile at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) [...] This looks suspiciously like a potential bug in the HTTP keep-alive flow that we encountered some weeks ago. I am guessing that you are issuing more than 100 separate updates/second. Could you please provide the full stack trace? If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4010082.html To unsubscribe from SolrJ - IOException, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=4010026code=YmFsYWppLmdhbmRoaUBhcG9sbG9ncnAuZWR1fDQwMTAwMjZ8LTEwNzE2NTA1NDI=. NAMLhttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml This message is private and confidential. If you have received it in error, please notify the sender
RE: SolrJ - IOException
Thanks for your reply. SOLR Server is not stalled. Just the add fails with this exception. Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto:balaji.gan...@apollogrp.edu P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: roz dev [via Lucene] [mailto:ml-node+s472066n4010037...@n3.nabble.com] Sent: Monday, September 24, 2012 5:46 PM To: Balaji Gandhi Subject: Re: SolrJ - IOException I have seen this happening We retry and that works. Is your solr server stalled? On Mon, Sep 24, 2012 at 4:50 PM, balaji.gandhi [hidden email]/user/SendEmail.jtp?type=nodenode=4010037i=0wrote: Hi, I am encountering this error randomly (under load) when posting to Solr using SolrJ. Has anyone encountered a similar error? org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8080/solr/profile at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182) at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:122) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:107) at Thanks, Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026.html Sent from the Solr - User mailing list archive at Nabble.com. If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4010037.html To unsubscribe from SolrJ - IOException, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=4010026code=YmFsYWppLmdhbmRoaUBhcG9sbG9ncnAuZWR1fDQwMTAwMjZ8LTEwNzE2NTA1NDI=. NAMLhttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml This message is private and confidential. If you have received it in error, please notify the sender and remove it from your system. -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4010795.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: SolrJ - IOException
Here is the stack trace:- org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server: org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182) at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:122) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:107) at org.apache.solr.handler.dataimport.thread.task.SolrUploadTask.upload(SolrUploadTask.java:31) at org.apache.solr.handler.dataimport.thread.SolrUploader.run(SolrUploader.java:31) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.NoHttpResponseException: The target server failed to respond at org.apache.http.impl.conn.DefaultResponseParser.parseHead(DefaultResponseParser.java:101) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:252) at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:282) at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:247) at org.apache.http.impl.conn.AbstractClientConnAdapter.receiveResponseHeader(AbstractClientConnAdapter.java:216) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:298) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125) at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:647) at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:464) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353) ... 9 more Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto:balaji.gan...@apollogrp.edu P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Toke Eskildsen [via Lucene] [mailto:ml-node+s472066n4010082...@n3.nabble.com] Sent: Tuesday, September 25, 2012 12:19 AM To: Balaji Gandhi Subject: Re: SolrJ - IOException On Tue, 2012-09-25 at 01:50 +0200, balaji.gandhi wrote: I am encountering this error randomly (under load) when posting to Solr using SolrJ. Has anyone encountered a similar error? org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8080/solr/profile at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) [...] This looks suspiciously like a potential bug in the HTTP keep-alive flow that we encountered some weeks ago. I am guessing that you are issuing more than 100 separate updates/second. Could you please provide the full stack trace? If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4010082.html To unsubscribe from SolrJ - IOException, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=4010026code=YmFsYWppLmdhbmRoaUBhcG9sbG9ncnAuZWR1fDQwMTAwMjZ8LTEwNzE2NTA1NDI=. NAMLhttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml This message is private and confidential. If you have received it in error, please notify the sender and remove it from your system. -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4010796.html Sent from the Solr - User mailing list archive at Nabble.com.
Persisting dataimport.properties in ZooKeeper directory
Hi, We are working on a DIH for our project and we are persisting the last_modified_date in the ZooKeeper directory. Our understanding is that the properties are uploaded to ZooKeeper when the first SOLR node comes up. When the SOLR nodes are restarted whatever is persisted in the properties is lost. Is there another way of maintaining state? Please let us know. Thanks, Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/Persisting-dataimport-properties-in-ZooKeeper-directory-tp4009965.html Sent from the Solr - User mailing list archive at Nabble.com.
